In my previous post, we discussed how we can implement a basic AI Agent with Kong AI Gateway. In part two of this series, we're going to review LangGraph fundamentals, rewrite the AI Agent and explore how Kong AI Gateway can be used to protect an LLM infrastructure as well as external functions.…
This is part one of a series exploring how Kong AI Gateway can be used in an AI Agent development with LangGraph. The series comprises three parts: Basic ReAct AI Agent with Kong AI Gateway Single LLM ReAct AI Agent with Kong AI Gateway and LangGraph Multi-LLM ReAct AI Agent and LangGraph Server…
What Is RAG, and Why Should You Use It? RAG (Retrieval-Augmented Generation) is not a new concept in AI, and unsurprisingly, when talking to companies, everyone seems to have their own interpretation of how to implement it. So, let’s start with a refresher. RAG (short for Retrieval-Augmented Gener…
This started as an internal experiment to explore how AI could assist with API design, using similar standards to what Kong R&D applies to our own API design. It turned out to be useful enough that we decided to share it more broadly. Now it’s live at create-api.dev. No login. No setup. Just…
If you're a builder, you likely keep sending your LLM credentials on every request from your agents and applications. But if you operate in an enterprise environment, you'll want to store your credentials in a secure third-party like HashiCorp Vault or IDP provider and have the infrastructure…
Enterprise adoption of large language models (LLMs) is surging. According to Gartner , more than 80% of enterprises will have deployed generative AI (GenAI) applications or used GenAI APIs by 2026, up from just 5% in 2023. That stark increase paints a telling picture: LLMs have evolved from a…
Today, we're excited to announce the general availability of AI Manager in Kong Konnect, the platform to manage all of your API, AI, and event connectivity across all modern digital applications and AI agents. Kong already provides the fastest and most feature rich AI Gateway technology to manage…
As businesses increasingly harness the power of artificial intelligence (AI) and large language models (LLMs), a new challenge emerges: managing the deluge of AI requests flooding systems. This exponential growth in AI traffic creates what could be considered a gratifying predicament—high demand…
The world of artificial intelligence is undergoing a seismic shift, with the emergence of agentic AI redefining the landscape of API development and management. As businesses and developers navigate the complexities of digital transformation, understanding the implications of this groundbreaking…
The hype for Anthropic’s Model Context Protocol (MCP) has reached a boiling point. Everyone ( including Kong ) is releasing something around MCP to ensure they aren't seen as falling behind in the ever-changing AI landscape. However, in this mad dash, there remains confusion around MCP and what…
As organizations continue to adopt AI-driven applications, managing usage and costs becomes more critical. Large language models (LLMs), such as those provided by OpenAI, Google, Anthropic, and Mistral, can incur significant expenses when overused. This blog will explore how you can streamline your…
Kong has supported Redis since its early versions. In fact, the integration between Kong Gateway and Redis is a powerful combination to enhance API management. We can summarize the integration points and use cases of Kong and Redis into three main groups: For all use cases, Kong supports multiple…
The explosion of AI-native applications is upon us. With each new week, massive innovations are being made in how AI-centric applications are being built. There are a variety of tools developers need to consider, be it supplying live contextual data via the Model Context Protocol (MCP) or…
When was the last time your AI assistant confused a memo from the CEO with 'Game of Thrones' plot lines? Have you ever asked a chatbot a question, only to receive an answer that was not only wrong but hilariously outdated? Imagine asking about the latest iPhone model and getting a response…
Today, we’re excited to unveil Kong AI Gateway 3.10! This release introduces new functionality to enhance AI governance, reduce LLM hallucinations, and accelerate developer productivity when working with AI. Read on to learn more. Kong AI Gateway 3.10 ships with a new AI RAG Injector plugin that…
Secure your AI infrastructure with prompt guards, PII sanitization, and centralized governance. Control LLM costs with token-based rate limiting and semantic routing across providers.