DeepYard

Best LangSmith Alternatives

141 dev tools you can use instead of LangSmith. Ranked by popularity, tag overlap, and public GitHub signals when available.

observabilitytracingevaluationlangchainllm-ops
L

LangSmith

Reference

Observability, tracing, and evaluation platform for LLM applications

1.0Ktoday103
View details Visit

Top Alternatives to LangSmith

L

Langfuse

Open-source LLM engineering platform — traces, evals, prompt management — 23K+ stars

OSSfreemium
Langfuse
33.5Ktoday196
3 shared tags
A

Arize Phoenix

Open-source LLM observability with tracing, evaluation, and datasets — 8K+ stars

OSSfreemium
Arize AI
11.1K250.0K/wtoday207
3 shared tags
J

JetBrains AI Toolkit

In-IDE LLM tracing and evaluation for JetBrains developers

Commercialpaid
JetBrains
3 shared tags
L

LEDGER

Claim-to-evidence trace graphs for auditing and verifying LLM agent reasoning

OSSFree
Research (Daehong Kim et al.)
3 shared tags
H

Helicone

Open-source LLM observability proxy with one-line integration

OSSfreemium
Helicone
6.1K6d ago96
2 shared tags
B

Braintrust

AI evaluation and experiment tracking platform for production LLM apps

Commercialfreemium
Braintrust
1.2Ktoday93
2 shared tags
A

AgentBeats

Agent-based evaluation framework where AI judges assess other agents through standardized protocols

OSSFree
Research
2 shared tags
A

AgentCheck

Debug LLM agents with reproducible recordings and controlled interventions over MCP

OSSFree
Research
2 shared tags
A

ATLAS

LLM-powered automata learning for analyzing and explaining agent strategies

OSSFree
Research Collaboration
2 shared tags
C

CausalFlow

Causal debugging framework that converts failed LLM agent traces into minimal counterfactual fixes

OSSFree
Research
2 shared tags
C

ClawTrap

MITM red-teaming framework for testing autonomous web agent security in real-world scenarios

OSSFree
Independent Researchers
2 shared tags
C

CUA-Suite

Large-scale human-annotated video dataset for training computer-use agents

OSSFree
Research Team
2 shared tags

Compare directly

LangSmith vs LangfuseLangSmith vs Arize Phoenix