Observability
25 tools across 4 categories tagged with “observability”
dev tools
(17)Arize Phoenix
Open-source LLM observability with tracing, evaluation, and datasets — 8K+ stars
Langfuse
Open-source LLM engineering platform — traces, evals, prompt management — 23K+ stars
Portkey
AI gateway with guardrails, caching, and observability for 200+ LLMs — 11K+ stars
Helicone
Open-source LLM observability proxy with one-line integration
AegisUI
Semantic security layer detecting malicious UI behaviors in AI agent systems beyond schema validation
Agent Audit
Security analysis system for LLM agent applications and MCP configurations
Agent Lifecycle Toolkit (ALTK)
Standardized middleware for production-ready AI agents with built-in failure handling
ClawTrap
MITM red-teaming framework for testing autonomous web agent security in real-world scenarios
Cognitive Firewall
Hybrid edge-cloud security defense against prompt injection attacks on browser AI agents
CUA-Suite
Large-scale human-annotated video dataset for training computer-use agents
ElephantBroker
Knowledge-grounded cognitive runtime for trustworthy AI agents with verifiable memory
LangSmith
Observability, tracing, and evaluation platform for LLM applications
MCP-in-SoS
Security risk assessment framework for evaluating open-source MCP server implementations
mcp-sec-audit
Security auditing toolkit for MCP servers with static analysis and sandboxed testing
RuView
WiFi-based human pose estimation and vital sign monitoring using commodity hardware
SpecOps
Automated testing framework for GUI-based AI agents in real-world environments
TrendRadar
AI-powered trend monitoring with multi-platform aggregation and natural language analysis via MCP
frameworks
(6)agentdev
Lightweight AI agent framework with built-in debugger for OpenAI, Anthropic & MCP
Reactive Agents
Effect-TS based agent framework with fine-grained control and MCP support
Reactive Agents
Type-safe AI agent framework with Effect-TS and React Loop patterns for composable agents
Reactive Agents
Effect-TS framework for composable AI agents with React-style loops and MCP support
Reactive Agents
Effect-TS framework for composable AI agents with structured dimensions and MCP integration
TITAN Agent
Autonomous AI agent framework with Mission Control GUI and multi-channel communication