Rinat Akhunianov
Full-stack dev on the BuidlGuidl core team. Building open-source tools that help devs ship on Ethereum.
Session
11-03
13:45
25min
ETH Evals: testing agents on Ethereum
Rinat Akhunianov
How do you know whether an AI agent does Ethereum work well, or whether a skill helps it? We started by testing the ETH Skills library, where evals let us cut the skills by almost two thirds and still improve results. Those lessons led us to ETH Evals, an open system that tests any model or agent on real Ethereum tasks. We will share the path, what surprised us, and a first look at ETH Evals.
[CLS] - Builder Enablement & BuidlGuidl
Workshop 1