Portkey logo

Portkey

Free tier

Production stack for Gen AI builders — AI Gateway, Observability, Guardrails & more

Free tier available·Technical·API available·Open source

Key strengths

Unified API access to 1,600+ LLMs via a single AI GatewayReal-time LLM observability, logging, and anomaly detectionBuilt-in guardrails and AI governance controlsPrompt management without hard-coded promptsOpen-source core with plug-and-play 3-line integration
Free tier + paid plans
San Francisco, USA
Founded 2023
Self-hostable
No ratings yet

Portkey is an open-source AI infrastructure layer that exposes a unified, OpenAI-compatible API to route requests across 1,600+ LLMs. It implements the AI Gateway pattern — acting as a centralized proxy that handles load balancing, caching, retries, and fallbacks — while layering on real-time observability, configurable guardrails, prompt versioning, and an MCP (Model Context Protocol) Gateway for secure tool access. The SDK is available for Node.js and Python and integrates in as few as 3 lines of code with no changes to existing stacks. It supports self-hosting and integrates with Azure, MongoDB, GitHub, Docker, Auth0, Cloudflare, and Figma ecosystems.