EvoMap Open Sources AutoResearch for AI Agent Experiments
EvoMap announced in a press release that it has released AutoResearch, an open source system for AI agents to move research ideas from hypothesis to experiment and then use evidence to decide the next step.
AutoResearch uses multiple AI models to generate and cross review research ideas. Accepted ideas are turned into executable research plans with metrics, success criteria, resource budgets and evaluation steps. Separate agents handle planning, implementation, experimentation, analysis and review.
The system stores research state, code, experiment logs, metrics, failures and decisions in a persistent workspace. EvoMap said this lets AutoResearch continue unfinished work rather than restart from the beginning. Independent and blind review is used before a research direction can be closed.
EvoMap said AutoResearch was tested on a Django issue from SWE-bench Lite, where it moved from 2 of 7 to 4 of 7 on official new feature tests, then reached 7 of 7 while keeping 203 of 203 regression tests passing. On the RSICD benchmark, an AutoResearch generated idea improved mean Recall from 32.84 to 34.69.
The AutoResearch code is available on GitHub, and the paper, "AutoResearch: Insight In, Hallucination Out," is available on arXiv.
We hope you enjoyed this article.
Consider subscribing to one of our newsletters like Daily AI Brief.
Also, consider following us on social media:
Subscribe to Daily AI Brief
Daily report covering major AI developments and industry news, with both top stories and complete market updates
Market report
Superagency in the Workplace: Empowering People to Unlock AI’s Full Potential
This report explores the transformative potential of artificial intelligence in the workplace, emphasizing the readiness of employees versus the slower adaptation of leadership. It highlights the significant productivity growth potential AI offers, akin to historical technological shifts, and discusses the barriers to achieving AI maturity within organizations. The report also examines the role of leadership in steering companies towards effective AI integration and the need for strategic investments to harness AI's full capabilities.
Read more