Blog
  • AI Gateway
  • AI Security
  • AIOps
  • API Security
  • API Gateway
|
    • API Management
    • API Development
    • API Design
    • Automation
    • Service Mesh
    • Insomnia
    • View All Blogs
  1. Home
  2. Blog
  3. Product Releases
  4. Kong AI Manager: Govern & Observe Agentic Traffic to Thousands of LLMs
Product Releases
May 27, 2025
2 min read

Kong AI Manager: Govern & Observe Agentic Traffic to Thousands of LLMs

Marco Palladino
CTO and Co-Founder of Kong

Today, we're excited to announce the general availability of AI Manager in Kong Konnect, the platform to manage all of your API, AI, and event connectivity across all modern digital applications and AI agents.

Kong already provides the fastest and most feature rich AI Gateway technology to manage your LLM traffic (including MCP traffic), and with these new AI Manager capabilities in Konnect, you can now easily expose LLMs for consumption by your AI agents, and additionally govern, secure, and observe LLM traffic using a brand-new user interface straight from your browser. The new AI Manager capabilities are in addition to the existing API and declarative configuration that you can already use to govern all your LLM and MCP traffic across AI agents and applications via Kong’s AI Gateway technology.

See a video demonstration of the new AI Manager in action below:

With AI Manager, you can now:

  • Manage AI policies via Konnect: Govern, secure, accelerate, and observe AI traffic in a self-managed — or fully managed — AI infrastructure that's easy to deploy.
  • Curate your LLM catalog: See what LLMs are available for consumption by AI agents and applications, with custom tiers of access and governance controls.
  • Visualize the agentic map: Observe at any given time what agents are consuming the LLMs you've decided to expose to the organization.
  • Observe LLM analytics: Measure token, cost, and request consumption with custom dashboards and insights for fine-grained understanding of your AI traffic.

The new AI Manager is compatible with both hybrid deployments of AI Gateway — where you run the data plane in your own infrastructure — and also with managed Dedicated Cloud Gateways deployments — where you can press a button and provision AI infrastructure across all major clouds, with private networking, in a fully auto-scalable and managed way. And there's native support for Kubernetes, of course, via either the Ingress Controller or Operator.

Getting access to 50+ specialized AI capabilities, including federated governance, semantic routing, semantic caching, LLM security, and PII sanitization, has never been easier. Plus, get the ability to observe LLM traffic using the built-in analytics and agentic consumption map.

Get started today with AI Manager at https://konghq.com/products/kong-konnect/register.

AILLMKong KonnectAI Gateway

More on this topic

Videos

Usage‑Based API & AI Monetization with Konnect

Reports

Agentic AI in the Enterprise: Adoption, Governance, and Barriers

See Kong in action

Accelerate deployments, reduce vulnerabilities, and gain real-time visibility. 

Get a Demo
Topics
AILLMKong KonnectAI Gateway
Share on Social
Marco Palladino
CTO and Co-Founder of Kong

Recommended posts

AI Voice Agents with Kong AI Gateway and Cerebras

EngineeringNovember 24, 2025

Kong Gateway is an API gateway and a core component of the Kong Konnect platform . Built on a plugin-based extensibility model, it centralizes essential functions such as proxying, routing, load balancing, and health checking, efficiently manag

Claudio Acquaviva

Move More Agentic Workloads to Production with AI Gateway 3.13

Product ReleasesDecember 18, 2025

MCP ACLs, Claude Code Support, and New Guardrails New providers, smarter routing, stronger guardrails — because AI infrastructure should be as robust as APIs We know that successful AI connectivity programs often start with an intense focus on how

Greg Peranich

Kong Konnect: Introducing HashiCorp Vault Support for LLMs

Product ReleasesJune 26, 2025

If you're a builder, you likely keep sending your LLM credentials on every request from your agents and applications. But if you operate in an enterprise environment, you'll want to store your credentials in a secure third-party like HashiCorp Vault

Marco Palladino

Announcing Kong AI Gateway 3.8 With Semantic Caching and Security, 6 New LLM Load-Balancing Algorithms, and More LLMs

Product ReleasesSeptember 11, 2024

Today at API Summit , we're introducing one of the biggest new releases of our AI Gateway technology : a new class of intelligent semantic plugins, new advanced load balancing capabilities for LLMs, and the official support for AWS Bedrock and GCP

Marco Palladino

Introducing LLM Analytics in Kong Konnect for GenAI Traffic

Product ReleasesSeptember 11, 2024

We’re pleased to announce the new LLM Usage reporting feature in Advanced Analytics, which aims to help organizations better manage their large language model (LLM) usage. This feature offers insights into token consumption, costs, and latency, allo

Christian Heidenreich

From Strategy to Action: See Konnect Metering & Billing in Motion

Product ReleasesJanuary 22, 2026

We've talked about why 2026 is the year of AI unit economics . There, we explored the "2025 hangover" where organizations realized that without financial governance, AI isn't just a science project but has become a margin-bleeding cost center. But

Dan Temkin

KAi Just Got a Major Upgrade, Powered by the New Kong Konnect MCP Server

Product ReleasesJanuary 21, 2026

If you've used KAi before, you'll notice the difference immediately. The enhanced version has deeper access to your Konnect environment and new tools for debugging, analytics, and configuration management: Active tracing and debugging: KAi can now

Alex Drag

Ready to see Kong in action?

Get a personalized walkthrough of Kong's platform tailored to your architecture, use cases, and scale requirements.

Get a Demo
Powering the API world

Increase developer productivity, security, and performance at scale with the unified platform for API management, AI gateways, service mesh, and ingress controller.

Sign up for Kong newsletter

    • Platform
    • Kong Konnect
    • Kong Gateway
    • Kong AI Gateway
    • Kong Insomnia
    • Developer Portal
    • Gateway Manager
    • Cloud Gateway
    • Get a Demo
    • Explore More
    • Open Banking API Solutions
    • API Governance Solutions
    • Istio API Gateway Integration
    • Kubernetes API Management
    • API Gateway: Build vs Buy
    • Kong vs Postman
    • Kong vs MuleSoft
    • Kong vs Apigee
    • Documentation
    • Kong Konnect Docs
    • Kong Gateway Docs
    • Kong Mesh Docs
    • Kong AI Gateway
    • Kong Insomnia Docs
    • Kong Plugin Hub
    • Open Source
    • Kong Gateway
    • Kuma
    • Insomnia
    • Kong Community
    • Company
    • About Kong
    • Customers
    • Careers
    • Press
    • Events
    • Contact
    • Pricing
  • Terms
  • Privacy
  • Trust and Compliance
  • © Kong Inc. 2026