Discover the future of intelligent API traffic management. Learn how AI-powered gateways enable smarter routing, adaptive security, and real-time decision-making to optimize and secure API ecosystems.
While building a GenAI-powered agent for one of our company websites, I integrated components like LLM APIs, embedding models, and a RAG (Retrieval-Augmented Generation) pipeline. The application was deployed using a Flask API backend and secured with API keys. However, post-deployment, several…
[](/blog/engineering/how-kong-ai-gateway-streamlined-my-genai-application)
Organizations are gradually realizing that API and AI observability aren't two separate problems; they're intertwined and require unified solutions. Without waiting on engineering, it's hard to answer simple questions like "Who's using my APIs?" or "Which APIs are causing the most issues?" Now…
[](/blog/enterprise/observability-gap-between-api-ai-monitoring)
It's natural to consider the necessity of guardrails for your sophisticated AI implementations. The truth is, much like any powerful technology, AI requires a set of protective measures to ensure its reliability and integrity. These guardrails aren't just a good idea; they are fundamental for…
[](/blog/engineering/ai-guardrails)
Calling all builders, tinkerers, and API innovators. The Kong Hackathon is back for API Summit 2025 ! This year, we’re challenging developers worldwide to create projects that don’t just react, they think , adapt , and act . The theme? Agentic AI : solutions that take initiative, make decisions,…
[](/blog/news/kong-agentic-ai-hackathon-2025)
The OWASP Top 10 for LLM Applications 2025 represents a significant evolution in AI security guidance, reflecting the rapid maturation of enterprise AI deployments over the past year. The key updates include expanded focus on agentic AI systems with "excessive autonomy" risks, new attention to…
[](/blog/engineering/owasp-top-10-ai-and-llm-guide)
In the last two parts of this series, we discussed How to Strengthen a ReAct AI Agent with Kong AI Gateway and How to Build a Single-LLM AI Agent with Kong AI Gateway and LangGraph . In this third and final part, we're going to evolve the AI Agent with multiple LLMs and Semantic…
[](/blog/engineering/build-a-multi-llm-ai-agent-with-kong-ai-gateway-and-langgraph)
In my previous post, we discussed how we can implement a basic AI Agent with Kong AI Gateway. In part two of this series, we're going to review LangGraph fundamentals, rewrite the AI Agent and explore how Kong AI Gateway can be used to protect an LLM infrastructure as well as external functions.…
[](/blog/engineering/build-single-llm-ai-agent-with-kong-ai-gateway-langgraph)
This is part one of a series exploring how Kong AI Gateway can be used in an AI Agent development with LangGraph. The series comprises three parts: Basic ReAct AI Agent with Kong AI Gateway Single LLM ReAct AI Agent with Kong AI Gateway and LangGraph Multi-LLM ReAct AI Agent and LangGraph Server…
[](/blog/engineering/how-to-strengthen-a-basic-react-ai-agent)
Today, I'm excited to announce one of our largest Kong AI Gateway releases (3.11), which ships with several new features critical in building modern and reliable AI agents in production. We strongly recommend updating to this version to get access to the latest and greatest that AI infrastructure…
[](/blog/product-releases/ai-gateway-3-11)
What Is RAG, and Why Should You Use It? RAG (Retrieval-Augmented Generation) is not a new concept in AI, and unsurprisingly, when talking to companies, everyone seems to have their own interpretation of how to implement it. So, let’s start with a refresher. RAG (short for Retrieval-Augmented Gener…
[](/blog/engineering/build-your-own-internal-rag-agent)
In February 2024, Kong became the first API platform to launch a dedicated AI gateway, designed to bring production-grade performance, observability, and policy enforcement to GenAI workloads. At its core, Kong’s AI Gateway provides a universal API to enable platform teams to centrally secure and…
[](/blog/engineering/ai-gateway-benchmark-kong-ai-gateway-portkey-litellm)
This started as an internal experiment to explore how AI could assist with API design, using similar standards to what Kong R&D applies to our own API design. It turned out to be useful enough that we decided to share it more broadly. Now it’s live at create-api.dev. No login. No setup. Just…
[](/blog/engineering/introducing-create-api-dev)
If you're a builder, you likely keep sending your LLM credentials on every request from your agents and applications. But if you operate in an enterprise environment, you'll want to store your credentials in a secure third-party like HashiCorp Vault or IDP provider and have the infrastructure…
[](/blog/product-releases/hashicorp-vault-support-for-llms)
Today, we're excited to announce the general availability of AI Manager in Kong Konnect, the platform to manage all of your API, AI, and event connectivity across all modern digital applications and AI agents. Kong already provides the fastest and most feature rich AI Gateway technology to manage…
[](/blog/product-releases/kong-ai-manager)
As businesses increasingly harness the power of artificial intelligence (AI) and large language models (LLMs), a new challenge emerges: managing the deluge of AI requests flooding systems. This exponential growth in AI traffic creates what could be considered a gratifying predicament—high demand…
[](/blog/enterprise/how-to-master-aillm-traffic-management-with-intelligent-gateways)Secure your AI infrastructure with prompt guards, PII sanitization, and centralized governance. Control LLM costs with token-based rate limiting and semantic routing across providers.