GitHub Trends

#rust#ai_gateway#ai_gateway_support#envoy#envoyproxy#gateway#generative_ai#llm_gateway#llm_inference#llm_proxy#llm_routing#llmops#llms#openai#prompt#proxy#proxy_server#routing Plano is an AI-native proxy server that handles key tasks for agentic apps like routing between agents, smart LLM model selection, safety guardrails, and automatic traces for observability. Define agents in simple YAML, write basic HTTP code in any language, and start Plano to run multi-agent systems without custom plumbing or framework lock-in. You benefit by building and shipping reliable agents to production much faster, focusing on core logic while gaining safety, low latency, and easy scaling. https://github.com/katanemo/plano

#jupyter_notebook#agent#agentic_ai#agents#authentication#bedrock#core#gateway#identity_management#memory_management#production_code#runtime Amazon Bedrock AgentCore lets you build, deploy, and run AI agents securely at scale with any framework like CrewAI or LangGraph and any model, without managing complex infrastructure. It offers serverless runtime for long tasks up to 8 hours, gateway to connect tools like Slack or APIs easily, memory for personalized experiences, identity management, built-in code interpreter and browser tools, plus observability. This saves time by skipping heavy setup, speeds prototypes to production, cuts costs with pay-per-use, and boosts security—helping you create powerful agents faster for real business needs. https://github.com/awslabs/amazon-bedrock-agentcore-samples

#python#agents#ai#api_gateway#asyncio#authentication_middleware#devops#docker#fastapi#federation#gateway#generative_ai#jwt#kubernetes#llm_agents#mcp#model_context_protocol#observability#prompt_engineering#python#tools The MCP Gateway is a powerful tool that unifies different AI service protocols like REST and MCP into one easy-to-use endpoint. It helps you manage multiple AI tools and services securely with features like authentication, retries, rate-limiting, and real-time monitoring through an admin UI. You can run it locally or in scalable cloud environments using Docker or Kubernetes. It supports various communication methods (HTTP, WebSocket, SSE, stdio) and offers observability with OpenTelemetry for tracking AI tool usage and performance. This gateway simplifies connecting AI clients to diverse services, making development and management more efficient and secure. https://github.com/IBM/mcp-context-forge

#typescript#ai_gateway#gateway#generative_ai#hacktoberfest#langchain#llama_index#llmops#llms#openai#prompt_engineering#router The AI Gateway by Portkey lets you connect to over 1600 AI models quickly and securely through one simple API, making it easy to integrate any language, vision, or audio AI model in under two minutes. It ensures fast responses with less than 1ms latency, automatic retries, load balancing, and fallback options to keep your AI apps reliable and scalable. It also offers strong security with role-based access, guardrails, and compliance with standards like SOC2 and GDPR. You can save costs with smart caching and optimize usage without changing your code. This helps you build powerful, cost-effective, and secure AI applications faster and with less hassle. https://github.com/Portkey-AI/gateway