Discover the future of intelligent API traffic management. Learn how AI-powered gateways enable smarter routing, adaptive security, and real-time decision-making to optimize and secure API ecosystems.
In February 2024, Kong became the first API platform to launch a dedicated AI gateway, designed to bring production-grade performance, observability, and policy enforcement to GenAI workloads. At its core, Kong’s AI Gateway provides a universal API to enable platform teams to centrally secure and…
[](/blog/engineering/ai-gateway-benchmark-kong-ai-gateway-portkey-litellm)
This started as an internal experiment to explore how AI could assist with API design, using similar standards to what Kong R&D applies to our own API design. It turned out to be useful enough that we decided to share it more broadly. Now it’s live at create-api.dev. No login. No setup. Just…
[](/blog/engineering/introducing-create-api-dev)
If you're a builder, you likely keep sending your LLM credentials on every request from your agents and applications. But if you operate in an enterprise environment, you'll want to store your credentials in a secure third-party like HashiCorp Vault or IDP provider and have the infrastructure…
[](/blog/product-releases/hashicorp-vault-support-for-llms)
Today, we're excited to announce the general availability of AI Manager in Kong Konnect, the platform to manage all of your API, AI, and event connectivity across all modern digital applications and AI agents. Kong already provides the fastest and most feature rich AI Gateway technology to manage…
[](/blog/product-releases/kong-ai-manager)
As businesses increasingly harness the power of artificial intelligence (AI) and large language models (LLMs), a new challenge emerges: managing the deluge of AI requests flooding systems. This exponential growth in AI traffic creates what could be considered a gratifying predicament—high demand…
[](/blog/enterprise/how-to-master-aillm-traffic-management-with-intelligent-gateways)
The world of artificial intelligence is undergoing a seismic shift, with the emergence of agentic AI redefining the landscape of API development and management. As businesses and developers navigate the complexities of digital transformation, understanding the implications of this groundbreaking…
[](/blog/enterprise/the-rise-of-agentic-ai-transforming-the-api-management)
The hype for Anthropic’s Model Context Protocol (MCP) has reached a boiling point. Everyone ( including Kong ) is releasing something around MCP to ensure they aren't seen as falling behind in the ever-changing AI landscape. The hype for Anthropic’s Model Context Protocol (MCP) has reached a…
[](/blog/learning-center/what-is-mcp)
As organizations continue to adopt AI-driven applications, managing usage and costs becomes more critical. Large language models (LLMs), such as those provided by OpenAI, Google, Anthropic, and Mistral, can incur significant expenses when overused. This blog will explore how you can streamline your…
[](/blog/engineering/token-rate-limiting-and-tiered-access-for-ai-usage)
Kong has supported Redis since its early versions. In fact, the integration between Kong Gateway and Redis is a powerful combination to enhance API management. We can summarize the integration points and use cases of Kong and Redis into three main groups: For all use cases, Kong supports multiple…
[](/blog/engineering/semantic-processing-and-vector-similarity-search-with-kong-and-redis)
The explosion of AI-native applications is upon us. With each new week, massive innovations are being made in how AI-centric applications are being built. There are a variety of tools developers need to consider, be it supplying live contextual data via the Model Context Protocol (MCP) or…
[](/blog/product-releases/securing-observing-governing-mcp-servers-with-ai-gateway)
Today, we’re excited to unveil Kong AI Gateway 3.10! This release introduces new functionality to enhance AI governance, reduce LLM hallucinations, and accelerate developer productivity when working with AI. Read on to learn more. Kong AI Gateway 3.10 ships with a new AI RAG Injector plugin that…
[](/blog/product-releases/ai-gateway-3-10)
The excitement around large language models (LLMs) and agentic AI is justified. These systems can summarize, generate, reason, and even take actions across APIs — all with minimal human input. However, as enterprises race to integrate LLMs into real-world workflows — especially when those…
[](/blog/enterprise/building-pii-sanitization-for-llms-and-agentic-ai)
AI is quickly transforming the way businesses operate, turning what was once futuristic into everyday reality. However, we're still in the early innings of AI, and there are still several key limitations with AI that organizations should remain aware of to ensure that AI is being leveraged in a…
[](/blog/enterprise/automated-rag-hallucination-proof-llms)
The AI Proxy Revolution has changed the way developers operate, helping save money and speed up development. This new approach improves how systems talk to each other and allows for quicker, more efficient data exchange. Modern software development is regularly burdened with challenges around costs…
[](/blog/enterprise/how-ai-proxies-cut-development-costs)
The rise of AI and LLMs in our world is revolutionizing the applications we’re building and the customer experiences we’re delivering. This is one of the pivotal moments in our industry where we cross over an intersection in our technology evolution to enter a new journey with a paradigm shift.…
[](/blog/enterprise/what-is-an-ai-gateway)