Blog
  • AI Gateway
  • AI Security
  • AIOps
  • API Security
  • API Gateway
    • API Management
    • API Development
    • API Design
    • Automation
    • Service Mesh
    • Insomnia
    • View All Blogs
  1. Home
  2. Blog
  3. LLM

Latest

AI Voice Agents with Kong AI Gateway and Cerebras

AI GatewayNovember 24, 2025

Kong Gateway is an API gateway and a core component of the Kong Konnect platform . Built on a plugin-based extensibility model, it centralizes essential functions such as proxying, routing, load balancing, and health checking, efficiently managing both microservices and traditional API traffic. An…

Claudio Acquaviva

The Hidden AI Fragmentation Tax: AI Innovation Speed and Program Margins

AIOctober 27, 2025

Everyone's telling you to innovate faster with AI. Move quicker. Ship more features. Deploy more agents. But before we sprint headlong into the AI revolution, we need to have a proper dollars-and-cents conversation that most companies are avoiding. Disclaimer: Statistics cited in this post were…

Alex Drag

Introducing the Volcano SDK to Build AI Agents in a Few Lines of Code

Agentic AIOctober 14, 2025

Today, we're open-sourcing Volcano SDK, a TypeScript SDK for building AI agents that combines LLM reasoning with real-world actions through MCP tools. Why Volcano SDK? One reason: because 9 lines of code are faster to write and easier to manage than 100+ . Without Volcano SDK? You'd need 100+ lines…

Marco Palladino

Make MCP Production-Ready: Introducing Kong’s Enterprise MCP Gateway

AI GatewayOctober 14, 2025

The solution landscape is complicated by the fact that MCP is still finding its footing, and there are many various OSS projects and vendors that are rapidly shipping “MCP support” in an attempt to take advantage of the hype and attention around MCP. Unfortunately, many early attempts at solutions…

Alex Drag

Subscribe to Kong’s newsletter

Stay ahead of API and AI Gateway trends. Get expert insights, technical guides, and best practices delivered to your inbox.

View All LLM Posts

What the 2025 Gartner Magic Quadrant for API Management Report Says About APIs and AI Success

Agentic AIOctober 10, 2025

The 2025 Gartner Magic Quadrant for API Management report was a great one for us here at Kong. We continue to move “up and to the right,” we remained in the “Leader” quadrant for the sixth year in a row, and we held our position as the “farthest right” on the “Completeness of vision”…

Alex Drag

From Chaos to Control: How Kong AI Gateway Streamlined My GenAI Application

AI GatewayOctober 6, 2025

While building a GenAI-powered agent for one of our company websites, I integrated components like LLM APIs, embedding models, and a RAG (Retrieval-Augmented Generation) pipeline. The application was deployed using a Flask API backend and secured with API keys. However, post-deployment, several…

Sachin Ghumbre

AI Guardrails: Ensure Safe, Responsible, Cost-Effective AI Integration

AI GatewayAugust 25, 2025

It's natural to consider the necessity of guardrails for your sophisticated AI implementations. The truth is, much like any powerful technology, AI requires a set of protective measures to ensure its reliability and integrity. These guardrails aren't just a good idea; they are fundamental for…

Jason Matis

Securing Enterprise AI: OWASP Top 10 LLM Vulnerabilities Guide

AIJuly 31, 2025

The OWASP Top 10 for LLM Applications 2025 represents a significant evolution in AI security guidance, reflecting the rapid maturation of enterprise AI deployments over the past year. The key updates include expanded focus on agentic AI systems with "excessive autonomy" risks, new attention to…

Michael Field

How to Build a Multi-LLM AI Agent with Kong AI Gateway and LangGraph

Kong GatewayJuly 31, 2025

In the last two parts of this series, we discussed How to Strengthen a ReAct AI Agent with Kong AI Gateway and How to Build a Single-LLM AI Agent with Kong AI Gateway and LangGraph . In this third and final part, we're going to evolve the AI Agent with multiple LLMs and Semantic…

Claudio Acquaviva

Kong AI Gateway 3.11: Reduce Token Spend, Unlock Multimodal Innovation

AI GatewayJuly 9, 2025

Today, I'm excited to announce one of our largest Kong AI Gateway releases (3.11), which ships with several new features critical in building modern and reliable AI agents in production. We strongly recommend updating to this version to get access to the latest and greatest that AI infrastructure…

Marco Palladino

Build Your Own Internal RAG Agent with Kong AI Gateway

AI GatewayJuly 9, 2025

What Is RAG, and Why Should You Use It? RAG (Retrieval-Augmented Generation) is not a new concept in AI, and unsurprisingly, when talking to companies, everyone seems to have their own interpretation of how to implement it. So, let’s start with a refresher. RAG (short for Retrieval-Augmented Gener…

Antoine Jacquemin

Kong Konnect: Introducing HashiCorp Vault Support for LLMs

AIJune 26, 2025

If you're a builder, you likely keep sending your LLM credentials on every request from your agents and applications. But if you operate in an enterprise environment, you'll want to store your credentials in a secure third-party like HashiCorp Vault or IDP provider and have the infrastructure…

Marco Palladino

72% Say Enterprise GenAI Spending Going Up in 2025, Study Finds

AIJune 18, 2025

Enterprise adoption of large language models (LLMs) is surging. According to Gartner , more than 80% of enterprises will have deployed generative AI (GenAI) applications or used GenAI APIs by 2026, up from just 5% in 2023. That stark increase paints a telling picture: LLMs have evolved from a…

Eric Pulsifer

Kong AI Manager: Govern & Observe Agentic Traffic to Thousands of LLMs

AIMay 27, 2025

Today, we're excited to announce the general availability of AI Manager in Kong Konnect, the platform to manage all of your API, AI, and event connectivity across all modern digital applications and AI agents. Kong already provides the fastest and most feature rich AI Gateway technology to manage…

Marco Palladino

Consistently Hallucination-Proof Your LLMs with Automated RAG

AIApril 2, 2025

AI is quickly transforming the way businesses operate, turning what was once futuristic into everyday reality. However, we're still in the early innings of AI, and there are still several key limitations with AI that organizations should remain aware of to ensure that AI is being leveraged in a…

Adam Jiroun

PII Sanitization Needed for LLMs and Agentic AI is Now Easier to Build

AIApril 2, 2025

LLMs operate as highly capable, non-deterministic pattern matchers. But they come with two significant privacy challenges: If you pass raw user input, internal logs, or structured data directly into an LLM without safeguards, you’re risking the exposure of names, emails, credit cards, health info,…

Alex Drag
12Next›

See AI Gateway in Action

Secure your AI infrastructure with prompt guards, PII sanitization, and centralized governance. Control LLM costs with token-based rate limiting and semantic routing across providers.

Get a Demo
Powering the API world

Increase developer productivity, security, and performance at scale with the unified platform for API management, AI gateways, service mesh, and ingress controller.

Sign up for Kong newsletter

Platform
Kong KonnectKong GatewayKong AI GatewayKong InsomniaDeveloper PortalGateway ManagerCloud GatewayGet a Demo
Explore More
Open Banking API SolutionsAPI Governance SolutionsIstio API Gateway IntegrationKubernetes API ManagementAPI Gateway: Build vs BuyKong vs PostmanKong vs MuleSoftKong vs Apigee
Documentation
Kong Konnect DocsKong Gateway DocsKong Mesh DocsKong AI GatewayKong Insomnia DocsKong Plugin Hub
Open Source
Kong GatewayKumaInsomniaKong Community
Company
About KongCustomersCareersPressEventsContactPricing
  • Terms•
  • Privacy•
  • Trust and Compliance•
  • © Kong Inc. 2025