Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Codex can exploit vulnerable crypto smart contracts 72% of the time, raising urgent questions about AI-powered cyber offense and defense.