Understanding and monitoring the performance and health of applications and systems is critical. This is where observability comes into play.
Observability is about gaining a comprehensive understanding of a system's internal state by analyzing the data it generates within the context of real-time events and actions across the infrastructure. Unlike traditional monitoring, which might only tell you when something has gone wrong, observability equips you with the tools and insights needed to discern not just the occurrence of an issue but its underlying causes. This enables teams to proactively manage and optimize their systems rather than merely reacting to failures.
From another perspective, as the central hub for managing and routing traffic across distributed services, the API gateway provides a comprehensive view of how applications are consumed across an enterprise. By implementing observability at the API gateway layer, organizations can ensure better performance, security, and visibility across their entire API ecosystem. Here are some key benefits:
API Performance
API Security
API Consumption
Business & Performance Metrics — Gain valuable insights, such as:
For AI and LLM-based services the Gateway provides metrics per provider, model, embeddings, etc. allowing cost calculation as well as control over AI tokens counted by LLM providers.
To achieve this, observability relies on three primary pillars:
With this context in mind, let's explore how Kong Konnect and Dynatrace work together to build advanced observability processes using OpenTelemetry (OTel) standards.
OpenTelemetry is an open source observability framework designed for cloud native software, formed from the merger of the OpenTracing and OpenCensus projects in 2019. Since then, OpenTelemetry has evolved to be the open standard approach to instrumenting, generating, collecting, and exporting telemetry data such as metrics, logs, and traces.
OpenTelemetry signals come from many sources such as traces and logs, auto-instrumented code libraries or custom instrumentation as well as metrics from 3rd-party vendor platforms. These signals can then be sent to external observability solutions for in-depth analysis and visualization.
While OpenTelemetry represents an amazing set of standards for how to ingest, modify and egress instrumentation data, it does not actually provide a platform for storing, visualizing and analyzing this data.
Dynatrace simplifies cloud complexity and enables faster and more secure innovation. The Dynatrace platform combines broad and deep observability, monitoring, continuous runtime application security, and advanced AIOps with Davis® AI to provide answers and intelligent automation from data. This enables innovators to modernize and automate cloud operations, deliver software faster and more securely, and ensure flawless digital experiences.
Dynatrace fully integrates with these open standards, such as OpenTelemetry. As a leading committer to OpenTelemetry, Dynatrace works closely with the open source community to drive ongoing improvements, using our decades of experience in observability for insight into customer challenges and best practices.
Kong Gateway is a fundamental component of the Kong Konnect API management infrastructure, known for its platform-agnostic approach, scalability, and outstanding performance, all driven by its plugin-based extensibility. It centralizes critical functions such as proxying, routing, load balancing, and health checking, effectively managing both microservices and traditional API traffic.
A key strength of Kong Gateway is its extensibility, supported by a wide range of plugins that enable the implementation of various policies, including Authentication/Authorization, Rate Limiting, Proxy Caching, Requests and Responses Transformation, and Traffic Control.
For observability, Kong provides the OpenTelemetry plugin to propagate traces, Logging plugins to externalize transactional logs and the Prometheus plugin to produce metrics to any OpenTelemetry compatible server. Below is a reference to the architectural layers of an application using Kong and how it might be observed with a combination of OpenTelemetry and Dynatrace.
The Dynatrace distribution of the OpenTelemetry Collector is a customized Collector build tailored for typical use cases in a Dynatrace context and comes with support coverage. In the diagram above, an OpenTelemetry Collector receives all observability data originating through the Kong Gateway plugins and any other application you have in your environment. In turn, the Collector exports the data to Dynatrace unified end-to-end observability platform, which handles dashboards, alerts, analytics, automation, etc.
Dynatrace also provides capabilities that capture full visibility of how your users experience transactions across web and mobile as well as components to monitor platforms like Kubernetes and databases.
Dynatrace automates BizDevSecOps workflows across your ecosystem to inform administrators where specific events are identified. Moreover, Dynatrace can actively use Kong APIs to take actions, create or update Kong Gateway policies, and adapt the gateway to a new scenario.
The following picture shows a Dynatrace dashboard with Kong and application metrics, received and exported by the OTel Collector.
The integration of Dynatrace and Kong Konnect marks a new era of observability architectures based on the OpenTelemetry standards. By harnessing the combined strengths of these technologies, organizations can enhance their infrastructure with robust policies establishing a strong foundation for observability platforms.
Contact sales@konghq.com and sales@dynatrace.com if you have questions or need support.
We're very excited to announce Kong Mesh 2.12 to the world! Kong Mesh 2.12 delivers two very important features: SPIFFE / SPIRE support, which provides enterprise-class workload identity and trust models for your mesh, as well as a consistent Kuma R
Meet Emily. She’s an API product manager at ACME, Inc., an ecommerce company that runs on dozens of APIs. One morning, her team lead asks a simple question: “Who’s our top API consumer, and which of your APIs are causing the most issues right now?”
Today, we’re announcing that Kong has acquired OpenMeter , the open source and SaaS leader for real-time usage metering and billing. OpenMeter’s capabilities will be integrated into Kong Konnect, enabling usage-based pricing, entitlements, and invo
It’s been almost a year since we released our Konnect Terraform provider . In that time we’ve seen over 300,000 installs, have 1.7 times as many resources available, and have expanded the provider to include data sources to enable federated managem
In the last two parts of this series, we discussed How to Strengthen a ReAct AI Agent with Kong AI Gateway and How to Build a Single-LLM AI Agent with Kong AI Gateway and LangGraph . In this third and final part, we're going to evolve the AI Agen
In my previous post, we discussed how we can implement a basic AI Agent with Kong AI Gateway. In part two of this series, we're going to review LangGraph fundamentals, rewrite the AI Agent and explore how Kong AI Gateway can be used to protect an LLM