DeepYardDeepYard

Best promptfoo Alternatives

53 dev tools you can use instead of promptfoo. Ranked by popularity, tag overlap, and live GitHub signals.

evaluationtestingred-teamingsecurityci-cdopen-source
p

promptfoo

Reference

Test and evaluate LLM prompts and agents — 11K+ stars

19.0Ktoday262
View details Visit

Top Alternatives to promptfoo

B

Braintrust

AI evaluation and experiment tracking platform for production LLM apps

Commercialfreemium
Braintrust
1.1Ktoday82
3 shared tags
M

MCP-in-SoS

Security risk assessment framework for evaluating open-source MCP server implementations

OSSFree
Research
3 shared tags
A

Arize Phoenix

Open-source LLM observability with tracing, evaluation, and datasets — 8K+ stars

OSSfreemiumTrending
Arize AI
8.5K250.0K/w4d ago120
2 shared tags
L

Langfuse

Open-source LLM engineering platform — traces, evals, prompt management — 23K+ stars

OSSfreemium
Langfuse
24.1Ktoday141
2 shared tags
A

AgentDS

Benchmark framework measuring AI agent performance vs human experts on data science tasks

unknownFree
Research Team
2 shared tags
C

ClawTrap

MITM red-teaming framework for testing autonomous web agent security in real-world scenarios

OSSFree
Independent Researchers
2 shared tags
C

Cognitive Firewall

Hybrid edge-cloud security defense against prompt injection attacks on browser AI agents

OSSFree
Research Team
2 shared tags
C

CUA-Suite

Large-scale human-annotated video dataset for training computer-use agents

OSSFree
Research Team
2 shared tags
E

EVMbench

Benchmark for evaluating AI agents on smart contract security tasks

OSSFree
Research Team (Wang et al.)
2 shared tags
F

FinToolBench

Specialized benchmark for evaluating LLM agents on real-world financial tool use and compliance

OSSFree
Research Collaboration
2 shared tags
L

LH-Bench

Evaluation framework for measuring long-horizon agent workflows on enterprise tasks

OSSFree
Research Project
2 shared tags
P

PostTrainBench

Benchmark for evaluating autonomous post-training of LLMs under compute constraints

OSSFree
Research Collaboration
2 shared tags

Compare directly

promptfoo vs Braintrustpromptfoo vs MCP-in-SoSpromptfoo vs Arize Phoenixpromptfoo vs Langfuse