p
promptfoo
Test and evaluate LLM prompts and agents — 11K+ stars
Open SourceFree
About
promptfoo is an open-source tool for testing, evaluating, and red-teaming LLM applications. Run automated evaluations across multiple models and prompts, compare outputs side-by-side, detect regressions, and test for security vulnerabilities. Supports custom assertions, CI/CD integration, and model-graded evaluations.
Details
| Type | evaluation, testing, red-teaming |
| Integrations | openai, anthropic, gemini, any-llm |
| Language | typescript |
Tags
evaluationtestingred-teamingsecurityci-cdopen-source
Quick Info
- Organization
- promptfoo
- Pricing
- open-source
- Free Tier
- Yes
- Updated
- Apr 1, 2026
19.0Ktoday262
Also in Dev Tools
C
Crawl4AI
Open-source web crawler optimized for LLMs and AI agents — 62K+ stars
OSSFree
unclecode
63.1Ktoday72
F
Firecrawl
Web scraping API built for LLMs — turn any website into LLM-ready data — 89K+ stars
OSSfreemium
Mendable
102.1Ktoday138
H
Headroom Context Optimization
Reduce LLM API costs by 50-90% through advanced context compression
OSSFree
Shubham Saboo
104.2Ktoday74