DeepYardDeepYard

LlamaIndex vs promptfoo

Side-by-side comparison with live GitHub signals. Last updated May 16, 2026.

L

LlamaIndex

Data framework for LLM applications — RAG, agents, and workflows — 47K+ stars

OSSFree
49.4Ktoday473
p

promptfoo

Test and evaluate LLM prompts and agents — 11K+ stars

OSSFree
21.3Ktoday278
MetricLlamaIndexpromptfoo
GitHub Stars49.4K21.3K
Contributors473278
Last CommitMay 15, 2026May 16, 2026
Open Issues374268
Licenseopen-sourceopen-source
Pricingopen-sourceopen-source
Free TierYesYes
Categorydev-toolsdev-tools
TrendingNoNo

Shared Tags

open-source

Only in LlamaIndex

ragdata-frameworkagentsworkflowspython

Only in promptfoo

evaluationtestingred-teamingsecurityci-cd

About LlamaIndex

LlamaIndex is the leading data framework for building LLM-powered applications. Provides data connectors for 160+ sources, advanced RAG pipelines, document agents, and a workflow engine for complex agentic applications. The standard for connecting LLMs to your data.

View full listing

About promptfoo

promptfoo is an open-source tool for testing, evaluating, and red-teaming LLM applications. Run automated evaluations across multiple models and prompts, compare outputs side-by-side, detect regressions, and test for security vulnerabilities. Supports custom assertions, CI/CD integration, and model-graded evaluations.

View full listing