L
LangSmith
Observability, tracing, and evaluation platform for LLM applications
commercialfreemium
About
LangSmith is LangChain's production-grade observability and evaluation platform for LLM applications. It provides full trace visibility into every LLM call, tool invocation, and chain execution — including latency, token usage, and cost. Teams use LangSmith to debug regressions, run automated evaluations against labeled datasets, and monitor live production traffic with alerting.
Details
| Type | observability, evaluation |
| Integrations | langchain, openai, anthropic, huggingface, litellm |
| Language | python, typescript |
Tags
observabilitytracingevaluationlangchainllm-ops
Also in Dev Tools
C
Crawl4AI
Open-source web crawler optimized for LLMs and AI agents — 62K+ stars
OSSFree
unclecode
63.1Ktoday72
F
Firecrawl
Web scraping API built for LLMs — turn any website into LLM-ready data — 89K+ stars
OSSfreemium
Mendable
102.1Ktoday138
H
Headroom Context Optimization
Reduce LLM API costs by 50-90% through advanced context compression
OSSFree
Shubham Saboo
104.2Ktoday74