A major step toward Artificial General Intelligence (AGI) and Super Intelligence is AI's ability to autonomously conduct research - what we term Artificial General Research Intelligence (AGRI). If machines could generate hypotheses, conduct experiments, and write research papers without human intervention, it would transform science. Recently, Sakana.ai introduced the AI Scientist, a system claiming to automate the research lifecycle, generating both excitement and skepticism. We evaluated the AI Scientist and found it a milestone in AI-driven research. While it streamlines some aspects, it falls short of expectations. Literature reviews are weak, nearly half the experiments failed, and manuscripts sometimes contain hallucinated results. Most notably, users must provide an experimental pipeline, limiting the AI Scientist's autonomy in research design and execution. Despite its limitations, the AI Scientist advances research automation. Many reviewers or instructors who assess work superficially may not recognize its output as AI-generated. The system produces research papers with minimal human effort and low cost. Our analysis suggests a paper costs a few USD with a few hours of human involvement, making it significantly faster than human researchers. Compared to AI capabilities from a few years ago, this marks progress toward AGRI. The rise of AI-driven research systems requires urgent discussion within Information Retrieval (IR) and broader scientific communities. Enhancing literature retrieval, citation validation, and evaluation benchmarks could improve AI-generated research reliability. We propose concrete steps, including AGRI-specific benchmarks, refined peer review, and standardized attribution frameworks. Whether AGRI becomes a stepping stone to AGI depends on how the academic and AI communities shape its development.

本研究探讨了AI科学家在自主开展研究中的能力，评估其是否能实现人工通用研究智能（AGRI）。尽管该系统能够在一定程度上自动化研究生命周期，但在文献综述和实验结果的可靠性方面存在不足，用户仍需提供实验设计，这限制了其自主性。尽管如此，AI科学家在推动研究自动化方面取得重要进展，并要求学术界和AI社区紧急讨论相关问题。

An Evaluation of Sakana's AI Scientist for Autonomous Research: Wishful
  Thinking or an Emerging Reality Towards 'Artificial General Research
  Intelligence' (AGRI)?

对Sakana.ai自主研究AI科学家的评估：美好的愿望还是朝向“人工通用研究智能”（AGRI）的新现实？