V
VulnGym
Repository-level vulnerability detection benchmark for autonomous coding agents
Open SourceFree
About
Academic benchmark designed to evaluate how well coding agents can autonomously explore entire codebases to detect security vulnerabilities. Unlike traditional vulnerability classification tasks that provide pre-selected code snippets, VulnGym tests agents' ability to navigate repositories, identify relevant files, and locate vulnerable code independently—mimicking real-world security auditing scenarios.
Details
| Type | |
| Integrations | |
| Language |
Tags
coding-agentevaluationautonomousopen-sourcepython
Quick Info
- Organization
- Research Team
- Pricing
- open-source
- Free Tier
- Yes
- Updated
- Aug 4, 2026
Also in Dev Tools
C
Crawl4AI
Open-source web crawler optimized for LLMs and AI agents — 62K+ stars
OSSFree
unclecode
76.0K5d ago82
F
Firecrawl
Web scraping API built for LLMs — turn any website into LLM-ready data — 89K+ stars
OSSfreemium
Mendable
160.4Ktoday159
H
Headroom Context Optimization
Reduce LLM API costs by 50-90% through advanced context compression
OSSFree
Shubham Saboo
130.3Ktoday91