We’re pleased to announce the new LLM Usage reporting feature in Advanced Analytics, which aims to help organizations better manage their large language model (LLM) usage. This feature offers insights into token consumption, costs, and latency, allowing businesses to optimize their AI investments.…
What do developers really think about artificial intelligence (AI)? To many, AI is synonymous with innovation. While some noisy naysayers on the sidelines may cry the promise of generative AI (GenAI) is overhyped, the reality experienced by actual developers and leaders in the digital trenches…
With API Summit 2024 coming up, we're thrilled to announce the 4th annual API Summit Hackathon ! This year’s Hackathon will focus on API innovation that emphasizes the use of artificial intelligence. AI has taken the world by storm, and it doesn’t seem to be slowing down. We want to share our…
We're introducing several new Kong AI Gateway capabilities in Kong Gateway 3.7 and Kong Gateway Enterprise 3.7, including enterprise-only and OSS improvements. Read on for a full rundown of the new AI-focused features. With the new Kong Gateway 3.7 release , we're promoting Kong AI Gateway to GA…
AI has been taking the world by storm. The innovative technology is responsible for revolutionizing the way users can synthesize information through Large Language Models (or LLMs) and interact with the world. However, the current state of AI isn't perfect and can be further optimized. This is…
In this post, we’ll see how ChatGPT can be used to reinvigorate APIs by creating an OpenAPI specification for an existing API that has existing documentation. ChatGPT , developed by OpenAI , has generated attention for its natural language processing capabilities. ChatGPT is based on machine…
Everyone’s talking AI — or artificial intelligence. But much of that talk falls into one of two extremes: AI will fix everything or AI will ruin everything. But let’s set aside hyperbolic ideas of AI as a silver bullet for all humanity's potential woes (or darkest timeline visions of Skynet) and…
We’re thrilled to announce the winners of the 3rd Annual Kong Hackathon, held in conjunction with API Summit 2023 ! This year's hackathon centered around API innovation using artificial intelligence, challenging participants to create AI-powered solutions revolving around APIs. Over the past month,…
In this post, Nathaniel Reynolds, Associate Director of Informatics Architecture & DevOps at Moderna Therapeutics, talks about service mesh, removing limitations with open source, and how AI helps developers do more. No one can predict the future, but here's a safe bet: in the next five to ten…
In our third Kong and Okta tutorial, we'll go through the introspection flow implementation. This series will show you how to implement service authentication and authorization for Kong Konnect and Okta using the OpenID Connect ( OIDC ) plugin. Parts 1, 2 and 4 cover: [iframe loading="lazy"…
In 2020, the acceleration of digital transformation quickly emerged as a top priority for many organizations as they grappled with the business impacts of an unexpected pandemic and raced to adapt to a new reality. As businesses begin to pivot out of the shadows of COVID-19 in 2021, what will this…
We are in the midst of an explosion of APIs and microservices. For some, the first instinct of creating an API is to get down to building one. Some level of planning will help manage the quality of APIs when working within a team. In this series of blogs, we will be sharing some…
Secure your AI infrastructure with prompt guards, PII sanitization, and centralized governance. Control LLM costs with token-based rate limiting and semantic routing across providers.