Sherlock AI: Solidity auditor with a controlled precision study =============================================================== Sherlock AI is Sherlock's Solidity auditor. In Sherlock's own controlled benchmark on the Flayer and Moongate codebase, scored by an independent researcher, version 2.2 produced 21 valid findings out of 38 (55 percent precision) against 4 of 8 for GPT-5.2 and 1 of 16 for Claude Sonnet 4.5. Maintainer: Sherlock Website: https://sherlock.xyz/solutions/ai Category: Smart-contract AI auditors Targets: Solidity, EVM Approach: Multi-step LLM reasoning trained on top researchers' findings; GitHub PR integration; codebase chat; verification tests for fixes Access: Commercial (contact sales) Status: Active (v2 May 2026) Strengths: Published precision. | PR-native workflow. | Backed by a contest platform with human researchers. Limits: Solidity only. | Vendor-run benchmark. | Pricing not public. Firms using it: Sherlock Sources: https://sherlock.xyz/solutions/ai | https://sherlock.xyz/post/controlled-benchmark-chatgpt-and-claude-vs-sherlock-ai Source page: https://agentsast.com/tools/sherlock-ai/ Compiled by: agentsast editors (https://agentsast.com/about/) Last reviewed: 2026-09-13