ScaBench and SCONE-bench: Contest-derived and Anthropic smart-contract benchmarks
================================================================================

ScaBench draws ground truth from 31 projects audited on Code4rena, Cantina and Sherlock and is the benchmark behind Hound's published recall; SCONE-bench is Anthropic's smart-contract benchmark.

Maintainer: scabench-org; Anthropic
Website: https://github.com/scabench-org/scabench
Category: Benchmarks and research
Targets: Solidity, 31 projects from Code4rena, Cantina, Sherlock
Approach: Ground truth from public contest findings; SCONE-bench from Anthropic
Access: Open source
Status: Active
Strengths: Realistic ground truth. | Open.
Limits: Public findings are in training data. | Solidity only.
Firms using it: none listed
Sources: https://github.com/scabench-org/scabench | https://github.com/anthropics/scone-bench

Source page: https://agentsast.com/tools/scabench/
Compiled by: agentsast editors (https://agentsast.com/about/)
Last reviewed: 2026-09-13