Insomnia’s new AI Runner offering is the easiest way to build production GenAI applications with multi-LLM support, semantic caching, and AI traffic analytics collection.
With the new Insomnia AI Runner, millions of Insomnia users can now consume multiple GenAI LLMs by writing their code only once. Out of the box, users can redirect their applications to use Azure AI, AWS Bedrock, GCP Vertex, OpenAI, Anthropic, Mistral, and Cohere without any code changes. This accelerates experimentation, benchmarking, and the final implementations of GenAI applications and agents.
Also, we are making it very easy to set up guardrails for improving GenAI security for content moderation, prompt jailbreaking, prompt injection, and a lot more.