DeepYardDeepYard

Chroma vs promptfoo

Side-by-side comparison with live GitHub signals. Last updated May 16, 2026.

C

Chroma

The open-source AI-native vector database — 27K+ stars

OSSfreemium
28.0Ktoday183
p

promptfoo

Test and evaluate LLM prompts and agents — 11K+ stars

OSSFree
21.3Ktoday278
MetricChromapromptfoo
GitHub Stars28.0K21.3K
Contributors183278
Last CommitMay 15, 2026May 16, 2026
Open Issues625268
Licenseopen-sourceopen-source
Pricingfreemiumopen-source
Free TierYesYes
Categorydev-toolsdev-tools
TrendingNoNo

Shared Tags

open-source

Only in Chroma

vector-databaseembeddingsragsimilarity-searchpython

Only in promptfoo

evaluationtestingred-teamingsecurityci-cd

About Chroma

Chroma is the open-source vector database built for AI applications. Store embeddings alongside metadata, perform similarity search, and build RAG pipelines with a simple Python/JavaScript API. Runs locally or as a hosted service, with built-in support for automatic embedding generation.

View full listing

About promptfoo

promptfoo is an open-source tool for testing, evaluating, and red-teaming LLM applications. Run automated evaluations across multiple models and prompts, compare outputs side-by-side, detect regressions, and test for security vulnerabilities. Supports custom assertions, CI/CD integration, and model-graded evaluations.

View full listing