DeepYard

Arize Phoenix vs Portkey

Side-by-side comparison built from DeepYard's structured catalog. Content updated Aug 21, 2026.

Direct Answer

Arize Phoenix suits teams needing freemium free tier, evaluation focus, and 11,142 GitHub stars in current listing data. Portkey suits teams needing freemium free tier, api gateway focus, and 12,794 GitHub stars in current listing data. This summary reflects catalog metadata only for decision support, not independent testing.

What this comparison weighs

  • Pricing and free-tier availability
  • License model and deployment fit
  • GitHub adoption and contributor depth
  • Catalog tags, integrations, and supported workflows
A

Arize Phoenix

Open-source LLM observability with tracing, evaluation, and datasets — 8K+ stars

OSSfreemium
11.1K250.0K/wtoday207
Visit GitHub
P

Portkey

AI gateway with guardrails, caching, and observability for 200+ LLMs — 11K+ stars

OSSfreemium
12.8K12w ago102
Visit GitHub
MetricArize PhoenixPortkey
GitHub Stars11.1K12.8K
Contributors207102
Last CommitAug 22, 2026May 25, 2026
Open Issues929245
Licenseopen-sourceopen-source
Pricingfreemiumfreemium
Free TierYesYes
Categorydev-toolsdev-tools
TrendingNoNo

Choose Arize Phoenix if you need

  • • Arize Phoenix stands out for Evaluation workflows that are not listed for Portkey.
  • • Arize Phoenix is the stronger pick when Langchain matters because that capability is listed only on its profile.
  • • Arize Phoenix has a larger visible contributor base (207 vs 102).

Choose Portkey if you need

  • • Portkey stands out for Api Gateway workflows that are not listed for Arize Phoenix.
  • • Portkey is the stronger pick when Anthropic matters because that capability is listed only on its profile.
  • • Portkey shows broader GitHub adoption with 12,794 stars versus 11,142 for Arize Phoenix.

Meaningful differences

  • • Pricing model: Arize Phoenix is listed as freemium from Free (self-hosted), cloud plans available, while Portkey is listed as freemium.
  • • Workflow emphasis: Arize Phoenix highlights Evaluation, while Portkey highlights Api Gateway.
  • • GitHub adoption: Arize Phoenix shows 11,142 stars versus 12,794 for Portkey.
  • • Contributor count: Arize Phoenix lists 207 contributors and Portkey lists 102.

Shared capabilities

  • • Observability
  • • Open Source
  • • Openai

Shared Tags

observabilityopen-source

Only in Arize Phoenix

tracingevaluationopentelemetrydebugging

Only in Portkey

api-gatewayguardrailscachingmulti-model

Limitations and evidence

  • • DeepYard compares structured public metadata; this is not an independent benchmark unless a test record is shown.
  • • Signals such as stars, contributors, and last commit indicate public activity, not purchase fit or runtime quality.
  • • Pricing and feature coverage reflect the stored listing snapshot and may lag vendor changes between refreshes.

Source links

Manifest content date: 2026-08-21

About Arize Phoenix

Arize Phoenix is an open-source observability platform for LLM applications. It provides tracing for multi-step agent workflows, built-in evaluation with LLM-as-judge and code-based evals, dataset management for experiments, and a visual UI for debugging prompt/response pairs. Phoenix integrates with OpenTelemetry, LangChain, LlamaIndex, and OpenAI, and can run locally or in the cloud.

View full listing

About Portkey

Portkey is an AI gateway that sits between your application and LLM providers, offering unified API access to 200+ models, automatic retries and fallbacks, semantic caching, spend tracking, guardrails, and request/response logging. Production-grade reliability layer for AI applications.

View full listing

Also Compare

Arize PhoenixvsLangfuseLangfusevsPortkeyArize PhoenixvsHeliconeArize PhoenixvsLangSmith