DeepYardDeepYard

Best ICAE-Bench Alternatives

116 dev tools you can use instead of ICAE-Bench. Ranked by popularity, tag overlap, and live GitHub signals.

evaluationcoding-agentautonomousframeworkopen-sourcetool-use
I

ICAE-Bench

Reference

Benchmark for evaluating coding agents on end-to-end project building from vague intent

View details Visit

Top Alternatives to ICAE-Bench

B

BackendForge

Benchmark framework for evaluating AI agents on end-to-end backend code generation

OSSFree
Research
5 shared tags
C

CapCode

Cheat-proof coding evaluation framework with performance-capped randomized tests

OSSFree
Research Team
5 shared tags
E

EVMbench

Benchmark for evaluating AI agents on smart contract security tasks

OSSFree
Research Team (Wang et al.)
5 shared tags
F

FluxBench

Benchmark framework for evaluating AI agents on complete chip design workflows

OSSFree
Research Team (arXiv)
5 shared tags
I

IssueTrojanBench

Security benchmark testing AI coding agents against malicious issue requests and backdoors

OSSFree
Research Community
5 shared tags
L

LH-Bench

Evaluation framework for measuring long-horizon agent workflows on enterprise tasks

OSSFree
Research Project
5 shared tags
M

MalSkillBench

Security benchmark for detecting malicious AI agent skills with runtime verification

OSSFree
Research Team
5 shared tags
O

OmniaBench

Comprehensive benchmark suite for evaluating general-purpose AI agents across diverse scenarios

OSSFree
Research
5 shared tags
S

SlopCodeBench

Benchmark for measuring coding agent performance degradation across iterative tasks

OSSFree
Research Collaboration
5 shared tags
T

TDAD

Pre-change impact analysis for AI coding agents using graph-based dependency mapping

OSSFree
Research Project
5 shared tags
T

ToolBench-X

Benchmark framework testing agent robustness with unreliable tools and error conditions

OSSFree
Research (Yang Tian et al.)
5 shared tags
V

Veritas

LLM-powered binary analysis for detecting memory corruption vulnerabilities in stripped code

OSSFree
Columbia University / King's College London
5 shared tags

Compare directly

ICAE-Bench vs BackendForgeICAE-Bench vs CapCodeICAE-Bench vs EVMbenchICAE-Bench vs FluxBench