Portkey logo

Portkey

Free tier

Production stack for Gen AI builders — AI Gateway, Observability, Guardrails & more

Free tier available·Technical·Powered by Multi-provider (1,600+ LLMs supported via unified API)·API available·Open source

Key strengths

Unified API access to 1,600+ LLMs via a single AI GatewayReal-time LLM observability, logging, and anomaly detectionBuilt-in guardrails and AI governance controlsPrompt management without hard-coded promptsOpen-source core with plug-and-play 3-line integration
Free tier + paid plans · from $49 USD/mo
San Francisco, USA
Founded 2023
Self-hostable

Facts verified against portkey.ai on

Recent changes

  • Plans updated: Free tier (10k logs/month, 3-day retention); Production at $49/month (100k logs/month, 30-day retention, +$9 per additional 100k requests); Enterprise at custom pricing (10M+ logs/month, custom retention, private cloud, SSO, HIPAA, etc.)
What's changed across AI tools →

Get alerts when Portkey changes

Free. We'll email you when pricing, the free tier, API access or open-source status changes.

No ratings yet

Technical Use Cases

Portkey is purpose-built for AI/GenAI engineering teams deploying LLM-powered applications in production. Common technical use cases include:

  • Multi-provider LLM routing — Use the unified API to implement fallback chains, load balancing, or A/B testing across 1,600+ models without rewriting application logic
  • LLM observability pipelines — Stream request/response logs, token counts, latency metrics, and cost data into a centralized dashboard for debugging and performance tuning
  • Prompt versioning and deployment — Manage prompt templates with version control, enabling safe iteration and rollback without code deploys
  • Output validation and guardrails — Enforce deterministic or ML-based safety checks on LLM outputs before they are returned to end users
  • Cost and rate governance — Apply RBAC policies, per-team budget caps, and rate limits to prevent runaway LLM spend in multi-team environments
  • Caching layer — Implement semantic caching to serve repeated or near-duplicate queries from cache, reducing latency and API costs
  • Secure agentic workflows — Use the MCP Gateway to give AI agents controlled, auditable access to external tools and services
  • Compliant enterprise deployments — Deploy on private cloud with SOC2 Type 2, GDPR, and HIPAA controls for regulated industries
Alternatives

Alternatives to Portkey

See all alternatives
Browse all 35 ai infrastructure tools