Blog
  • AI Gateway
  • AI Security
  • AIOps
  • API Security
  • API Gateway
|
    • API Management
    • API Development
    • API Design
    • Automation
    • Service Mesh
    • Insomnia
    • View All Blogs
  1. Home
  2. Blog
  3. AI Gateway

AI Gateway

Discover the future of intelligent API traffic management. Learn how AI-powered gateways enable smarter routing, adaptive security, and real-time decision-making to optimize and secure API ecosystems.

‹Prev12345Next›

Kong AI Gateway 3.11: Reduce Token Spend, Unlock Multimodal Innovation

AI GatewayJuly 9, 2025

Today, I'm excited to announce one of our largest Kong AI Gateway releases (3.11), which ships with several new features critical in building modern and reliable AI agents in production. We strongly recommend updating to this version to get access to the latest and greatest that AI infrastructure…

Marco Palladino

Build Your Own Internal RAG Agent with Kong AI Gateway

AI GatewayJuly 9, 2025

What Is RAG, and Why Should You Use It? RAG (Retrieval-Augmented Generation) is not a new concept in AI, and unsurprisingly, when talking to companies, everyone seems to have their own interpretation of how to implement it. So, let’s start with a refresher. RAG (short for Retrieval-Augmented Gener…

Antoine Jacquemin

AI Gateway Benchmark: Kong AI Gateway, Portkey, and LiteLLM

AI GatewayJuly 7, 2025

In February 2024, Kong became the first API platform to launch a dedicated AI gateway, designed to bring production-grade performance, observability, and policy enforcement to GenAI workloads. At its core, Kong’s AI Gateway provides a universal API to enable platform teams to centrally secure and…

Claudio Acquaviva

Introducing create-api.dev

AI GatewayJuly 1, 2025

This started as an internal experiment to explore how AI could assist with API design, using similar standards to what Kong R&D applies to our own API design. It turned out to be useful enough that we decided to share it more broadly. Now it’s live at create-api.dev. No login. No setup. Just…

Connor Church

Kong Konnect: Introducing HashiCorp Vault Support for LLMs

AIJune 26, 2025

If you're a builder, you likely keep sending your LLM credentials on every request from your agents and applications. But if you operate in an enterprise environment, you'll want to store your credentials in a secure third-party like HashiCorp Vault or IDP provider and have the infrastructure…

Marco Palladino

Kong AI Manager: Govern & Observe Agentic Traffic to Thousands of LLMs

AIMay 27, 2025

Today, we're excited to announce the general availability of AI Manager in Kong Konnect, the platform to manage all of your API, AI, and event connectivity across all modern digital applications and AI agents. Kong already provides the fastest and most feature rich AI Gateway technology to manage…

Marco Palladino

How to Master AI/LLM Traffic Management with Intelligent Gateways

How to Master AI/LLM Traffic Management with Intelligent Gateways
AI GatewayMay 26, 2025

As businesses increasingly harness the power of artificial intelligence (AI) and large language models (LLMs), a new challenge emerges: managing the deluge of AI requests flooding systems. This exponential growth in AI traffic creates what could be considered a gratifying predicament—high demand…

Kong

How the Rise of Agentic AI is Transforming API Development and Management

How the Rise of Agentic AI is Transforming API Development and Management
AIMay 20, 2025

The world of artificial intelligence is undergoing a seismic shift, with the emergence of agentic AI redefining the landscape of API development and management. As businesses and developers navigate the complexities of digital transformation, understanding the implications of this groundbreaking…

Kong

What is MCP? Diving Deep into the Future of Remote AI Context

AI GatewayMay 13, 2025

The hype for Anthropic’s Model Context Protocol (MCP) has reached a boiling point. Everyone ( including Kong ) is releasing something around MCP to ensure they aren't seen as falling behind in the ever-changing AI landscape. However, in this mad dash, there remains confusion around MCP and what…

Michael Field

Streamline AI Usage with Token Rate-Limiting & Tiered Access in Kong

AI GatewayMay 6, 2025

As organizations continue to adopt AI-driven applications, managing usage and costs becomes more critical. Large language models (LLMs), such as those provided by OpenAI, Google, Anthropic, and Mistral, can incur significant expenses when overused. This blog will explore how you can streamline your…

Jason Matis

Semantic Processing and Vector Similarity Search with Kong and Redis

AIApril 29, 2025

Kong has supported Redis since its early versions. In fact, the integration between Kong Gateway and Redis is a powerful combination to enhance API management. We can summarize the integration points and use cases of Kong and Redis into three main groups: For all use cases, Kong supports multiple…

Claudio Acquaviva

Securing, Observing, and Governing MCP Servers with Kong AI Gateway

AI GatewayApril 24, 2025

The explosion of AI-native applications is upon us. With each new week, massive innovations are being made in how AI-centric applications are being built. There are a variety of tools developers need to consider, be it supplying live contextual data via the Model Context Protocol (MCP) or…

Greg Peranich

Enhance AI Governance with Kong AI Gateway 3.10

AIApril 2, 2025

Today, we’re excited to unveil Kong AI Gateway 3.10! This release introduces new functionality to enhance AI governance, reduce LLM hallucinations, and accelerate developer productivity when working with AI. Read on to learn more. Kong AI Gateway 3.10 ships with a new AI RAG Injector plugin that…

Adam Jiroun

Consistently Hallucination-Proof Your LLMs with Automated RAG

AIApril 2, 2025

AI is quickly transforming the way businesses operate, turning what was once futuristic into everyday reality. However, we're still in the early innings of AI, and there are still several key limitations with AI that organizations should remain aware of to ensure that AI is being leveraged in a…

Adam Jiroun

PII Sanitization Needed for LLMs and Agentic AI is Now Easier to Build

AIApril 2, 2025

LLMs operate as highly capable, non-deterministic pattern matchers. But they come with two significant privacy challenges: If you pass raw user input, internal logs, or structured data directly into an LLM without safeguards, you’re risking the exposure of names, emails, credit cards, health info,…

Alex Drag
‹Prev12345Next›

See AI Gateway in Action

Secure your AI infrastructure with prompt guards, PII sanitization, and centralized governance. Control LLM costs with token-based rate limiting and semantic routing across providers.

Get a Demo
Powering the API world

Increase developer productivity, security, and performance at scale with the unified platform for API management, AI gateways, service mesh, and ingress controller.

Sign up for Kong newsletter

    • Platform
    • Kong Konnect
    • Kong Gateway
    • Kong AI Gateway
    • Kong Insomnia
    • Developer Portal
    • Gateway Manager
    • Cloud Gateway
    • Get a Demo
    • Explore More
    • Open Banking API Solutions
    • API Governance Solutions
    • Istio API Gateway Integration
    • Kubernetes API Management
    • API Gateway: Build vs Buy
    • Kong vs Postman
    • Kong vs MuleSoft
    • Kong vs Apigee
    • Documentation
    • Kong Konnect Docs
    • Kong Gateway Docs
    • Kong Mesh Docs
    • Kong AI Gateway
    • Kong Insomnia Docs
    • Kong Plugin Hub
    • Open Source
    • Kong Gateway
    • Kuma
    • Insomnia
    • Kong Community
    • Company
    • About Kong
    • Customers
    • Careers
    • Press
    • Events
    • Contact
    • Pricing
  • Terms
  • Privacy
  • Trust and Compliance
  • © Kong Inc. 2026