If you're a builder, you likely keep sending your LLM credentials on every request from your agents and applications. But if you operate in an enterprise environment, you'll want to store your credentials in a secure third-party like HashiCorp Vault or IDP provider and have the infrastructure inject the credentials for you dynamically. By doing so, you'll have:
✅ No leaks of credentials into agents
✅ Strong governance of LLM credentials in secure storage
✅ Ability to switch credentials on the fly without having to redeploy your agents
In this case, the infrastructure that secures the communication between the agents and the LLMs is an AI gateway, and the capability that allows you to manage and configure this behavior is our Kong Konnect AI Manager.
Today, we're introducing the ability to configure dynamic authentication using a third-party like HashiCorp Vault in our AI Manager product.
As we ramp up the creations of AI-powered agents, it's important to keep them lean and focused while we delegate as much as we can to our infrastructure.
Kong’s AI Gateway does just that. It removes 50+ capabilities that we usually would have built ourselves — like observability, security, semantic acceleration, RAG pipelines, and more — and allows us to instead focus on our agentic business logic and intelligence by leveraging all these capabilities out of the box from the AI Gateway itself.
One of these capabilities is certainly authentication to the models themselves:
You can get started with Kong AI Gateway and AI Manager by signing up on Konnect.
Kong Gateway is an API gateway and a core component of the Kong Konnect platform . Built on a plugin-based extensibility model, it centralizes essential functions such as proxying, routing, load balancing, and health checking, efficiently manag
Today, we're excited to announce the general availability of AI Manager in Kong Konnect, the platform to manage all of your API, AI, and event connectivity across all modern digital applications and AI agents. Kong already provides the fastest and m
Today at API Summit , we're introducing one of the biggest new releases of our AI Gateway technology : a new class of intelligent semantic plugins, new advanced load balancing capabilities for LLMs, and the official support for AWS Bedrock and GCP
We’re pleased to announce the new LLM Usage reporting feature in Advanced Analytics, which aims to help organizations better manage their large language model (LLM) usage. This feature offers insights into token consumption, costs, and latency, allo
Today, we're open-sourcing Volcano SDK, a TypeScript SDK for building AI agents that combines LLM reasoning with real-world actions through MCP tools. Why Volcano SDK? One reason: because 9 lines of code are faster to write and easier to manage tha
What does the solution space look like so far? The solution landscape is complicated by the fact that MCP is still finding its footing, and there are many various OSS projects and vendors that are rapidly shipping “MCP support” in an attempt to take
Why AI guardrails matter It's natural to consider the necessity of guardrails for your sophisticated AI implementations. The truth is, much like any powerful technology, AI requires a set of protective measures to ensure its reliability and integrit