DeepYardDeepYard

Best VulnGym Alternatives

121 dev tools you can use instead of VulnGym. Ranked by popularity, tag overlap, and live GitHub signals.

coding-agentevaluationautonomousopen-sourcepython
V

VulnGym

Reference

Repository-level vulnerability detection benchmark for autonomous coding agents

View details Visit

Top Alternatives to VulnGym

E

EvoRepair

Self-evolving AI agent that learns from past fixes to automatically repair code vulnerabilities

OSSFree
Research Team
5 shared tags
T

TML-Bench

Benchmark for evaluating data science agents on Kaggle-style tabular ML tasks

OSSFree
Independent
5 shared tags
V

Veritas

LLM-powered binary analysis for detecting memory corruption vulnerabilities in stripped code

OSSFree
Columbia University / King's College London
5 shared tags
A

AgentDS

Benchmark framework measuring AI agent performance vs human experts on data science tasks

unknownFree
Research Team
4 shared tags
A

Agora Consensus Agent

Multi-agent framework for autonomous bug detection in distributed consensus protocols

OSSFree
Research Team
4 shared tags
A

Alipay-PIBench

Benchmark for testing coding agents on real-world Alipay payment integration scenarios

OSSFree
Alipay/Research
4 shared tags
B

BackendForge

Benchmark framework for evaluating AI agents on end-to-end backend code generation

OSSFree
Research
4 shared tags
C

CapCode

Cheat-proof coding evaluation framework with performance-capped randomized tests

OSSFree
Research Team
4 shared tags
C

CausalFlow

Causal debugging framework that converts failed LLM agent traces into minimal counterfactual fixes

OSSFree
Research
4 shared tags
C

Change2Task

Transform merged PRs into verified coding agent tasks for training data generation

OSSFree
Research
4 shared tags
C

CUA-Gym

Reinforcement learning benchmark suite for training GUI automation agents with verifiable rewards

OSSFree
Research
4 shared tags
C

CUA-Suite

Large-scale human-annotated video dataset for training computer-use agents

OSSFree
Research Team
4 shared tags

Compare directly

VulnGym vs EvoRepairVulnGym vs TML-BenchVulnGym vs VeritasVulnGym vs AgentDS