The OWASP Top 10 for LLM Applications 2025 represents a significant evolution in AI security guidance, reflecting the rapid maturation of enterprise AI deployments over the past year. The key updates include expanded focus on agentic AI systems with "excessive autonomy" risks, new attention to…
[](/blog/engineering/owasp-top-10-ai-and-llm-guide)
In the last two parts of this series, we discussed How to Strengthen a ReAct AI Agent with Kong AI Gateway and How to Build a Single-LLM AI Agent with Kong AI Gateway and LangGraph . In this third and final part, we're going to evolve the AI Agent with multiple LLMs and Semantic…
[](/blog/engineering/build-a-multi-llm-ai-agent-with-kong-ai-gateway-and-langgraph)
Today, I'm excited to announce one of our largest Kong AI Gateway releases (3.11), which ships with several new features critical in building modern and reliable AI agents in production. We strongly recommend updating to this version to get access to the latest and greatest that AI infrastructure…
[](/blog/product-releases/ai-gateway-3-11)
What Is RAG, and Why Should You Use It? RAG (Retrieval-Augmented Generation) is not a new concept in AI, and unsurprisingly, when talking to companies, everyone seems to have their own interpretation of how to implement it. So, let’s start with a refresher. RAG (short for Retrieval-Augmented Gener…
[](/blog/engineering/build-your-own-internal-rag-agent)
If you're a builder, you likely keep sending your LLM credentials on every request from your agents and applications. But if you operate in an enterprise environment, you'll want to store your credentials in a secure third-party like HashiCorp Vault or IDP provider and have the infrastructure…
[](/blog/product-releases/hashicorp-vault-support-for-llms)
Enterprise adoption of large language models (LLMs) is surging. According to Gartner , more than 80% of enterprises will have deployed generative AI (GenAI) applications or used GenAI APIs by 2026, up from just 5% in 2023. That stark increase paints a telling picture: LLMs have evolved from a…
[](/blog/enterprise/enterprise-ai-spending-2025)
Today, we're excited to announce the general availability of AI Manager in Kong Konnect, the platform to manage all of your API, AI, and event connectivity across all modern digital applications and AI agents. Kong already provides the fastest and most feature rich AI Gateway technology to manage…
[](/blog/product-releases/kong-ai-manager)
AI is quickly transforming the way businesses operate, turning what was once futuristic into everyday reality. However, we're still in the early innings of AI, and there are still several key limitations with AI that organizations should remain aware of to ensure that AI is being leveraged in a…
[](/blog/enterprise/automated-rag-hallucination-proof-llms)
LLMs operate as highly capable, non-deterministic pattern matchers. But they come with two significant privacy challenges: If you pass raw user input, internal logs, or structured data directly into an LLM without safeguards, you’re risking the exposure of names, emails, credit cards, health info,…
[](/blog/enterprise/building-pii-sanitization-for-llms-and-agentic-ai)
Today at API Summit , we're introducing one of the biggest new releases of our AI Gateway technology : a new class of intelligent semantic plugins, new advanced load balancing capabilities for LLMs, and the official support for AWS Bedrock and GCP Vertex, in addition to all the other supported LLM…
[](/blog/product-releases/ai-gateway-3-8)
We’re pleased to announce the new LLM Usage reporting feature in Advanced Analytics, which aims to help organizations better manage their large language model (LLM) usage. This feature offers insights into token consumption, costs, and latency, allowing businesses to optimize their AI investments.…
[](/blog/product-releases/ai-analytics)
AI has been taking the world by storm. The innovative technology is responsible for revolutionizing the way users can synthesize information through Large Language Models (or LLMs) and interact with the world. However, the current state of AI isn't perfect and can be further optimized. This is…
[](/blog/engineering/gorilla-llm)Secure your AI infrastructure with prompt guards, PII sanitization, and centralized governance. Control LLM costs with token-based rate limiting and semantic routing across providers.