DeepYard

Best promptfoo Alternatives

141 dev tools you can use instead of promptfoo. Ranked by popularity, tag overlap, and public GitHub signals when available.

evaluationtestingred-teamingsecurityci-cdopen-source
p

promptfoo

Reference

Test and evaluate LLM prompts and agents — 11K+ stars

24.4Ktoday318
View details Visit

Top Alternatives to promptfoo

B

Braintrust

AI evaluation and experiment tracking platform for production LLM apps

Commercialfreemium
Braintrust
1.2Ktoday93
3 shared tags
M

MCP-in-SoS

Security risk assessment framework for evaluating open-source MCP server implementations

OSSFree
Research
3 shared tags
L

Langfuse

Open-source LLM engineering platform — traces, evals, prompt management — 23K+ stars

OSSfreemium
Langfuse
33.5Ktoday196
2 shared tags
A

Arize Phoenix

Open-source LLM observability with tracing, evaluation, and datasets — 8K+ stars

OSSfreemium
Arize AI
11.1K250.0K/wtoday207
2 shared tags
A

AgentBeats

Agent-based evaluation framework where AI judges assess other agents through standardized protocols

OSSFree
Research
2 shared tags
A

AgentCheck

Debug LLM agents with reproducible recordings and controlled interventions over MCP

OSSFree
Research
2 shared tags
A

AgentDS

Benchmark framework measuring AI agent performance vs human experts on data science tasks

unknownFree
Research Team
2 shared tags
A

Agora Consensus Agent

Multi-agent framework for autonomous bug detection in distributed consensus protocols

OSSFree
Research Team
2 shared tags
A

Agora Consensus

Multi-agent framework for autonomous bug detection in distributed consensus protocols

OSSFree
Research Team
2 shared tags
A

Alipay-PIBench

Benchmark for testing coding agents on real-world Alipay payment integration scenarios

OSSFree
Alipay/Research
2 shared tags
A

ATLAS

LLM-powered automata learning for analyzing and explaining agent strategies

OSSFree
Research Collaboration
2 shared tags
B

BackendForge

Benchmark framework for evaluating AI agents on end-to-end backend code generation

OSSFree
Research
2 shared tags

Compare directly

promptfoo vs Braintrustpromptfoo vs Langfuse