DeepYardDeepYard

Best LangSmith Alternatives

95 dev tools you can use instead of LangSmith. Ranked by popularity, tag overlap, and live GitHub signals.

observabilitytracingevaluationlangchainllm-ops
L

LangSmith

Reference

Observability, tracing, and evaluation platform for LLM applications

957today96
View details Visit

Top Alternatives to LangSmith

L

Langfuse

Open-source LLM engineering platform — traces, evals, prompt management — 23K+ stars

OSSfreemium
Langfuse
30.5Ktoday180
3 shared tags
A

Arize Phoenix

Open-source LLM observability with tracing, evaluation, and datasets — 8K+ stars

OSSfreemium
Arize AI
10.4K250.0K/wtoday186
3 shared tags
J

JetBrains AI Toolkit

In-IDE LLM tracing and evaluation for JetBrains developers

Commercialpaid
JetBrains
3 shared tags
H

Helicone

Open-source LLM observability proxy with one-line integration

OSSfreemium
Helicone
5.9Ktoday96
2 shared tags
B

Braintrust

AI evaluation and experiment tracking platform for production LLM apps

Commercialfreemium
Braintrust
1.2K2d ago88
2 shared tags
A

AgentBeats

Agent-based evaluation framework where AI judges assess other agents through standardized protocols

OSSFree
Research
2 shared tags
C

CausalFlow

Causal debugging framework that converts failed LLM agent traces into minimal counterfactual fixes

OSSFree
Research
2 shared tags
C

ClawTrap

MITM red-teaming framework for testing autonomous web agent security in real-world scenarios

OSSFree
Independent Researchers
2 shared tags
C

CUA-Suite

Large-scale human-annotated video dataset for training computer-use agents

OSSFree
Research Team
2 shared tags
M

MCP-in-SoS

Security risk assessment framework for evaluating open-source MCP server implementations

OSSFree
Research
2 shared tags
S

SpecOps

Automated testing framework for GUI-based AI agents in real-world environments

OSSFree
Research
2 shared tags
V

Vera

Automated safety testing framework for LLM agents with risk discovery and verification

OSSFree
Multiple Authors
2 shared tags

Compare directly

LangSmith vs LangfuseLangSmith vs Arize PhoenixLangSmith vs JetBrains AI ToolkitLangSmith vs Helicone