EVMbench is OpenAI’s attempt to see whether modern AI systems are up to the task of helping prevent smart contract issues.
Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.