DeepYardDeepYard
P

Portkey

AI gateway with guardrails, caching, and observability for 200+ LLMs — 11K+ stars

Open Sourcefreemium

About

Portkey is an AI gateway that sits between your application and LLM providers, offering unified API access to 200+ models, automatic retries and fallbacks, semantic caching, spend tracking, guardrails, and request/response logging. Production-grade reliability layer for AI applications.

Details

Typeapi-gateway, guardrails, caching, observability
Integrationsopenai, anthropic, gemini, azure, aws-bedrock, 200+ providers
Languagetypescript, python

Tags

api-gatewayguardrailscachingobservabilitymulti-modelopen-source