A major challenge facing the world is the provision of equitable and universal access to quality education. Recent advances in generative AI (gen AI) have created excitement about the potential of new technologies to offer a personal tutor for every learner and a teaching assistant for every teacher. The full extent of this dream, however, has not yet materialised. We argue that this is primarily due to the difficulties with verbalising pedagogical intuitions into gen AI prompts and the lack of good evaluation practices, reinforced by the challenges in defining excellent pedagogy. Here we present our work collaborating with learners and educators to translate high level principles from learning science into a pragmatic set of seven diverse educational benchmarks, spanning quantitative, qualitative, automatic and human evaluations; and to develop a new set of fine-tuning datasets to improve the pedagogical capabilities of Gemini, introducing LearnLM-Tutor. Our evaluations show that LearnLM-Tutor is consistently preferred over a prompt tuned Gemini by educators and learners on a number of pedagogical dimensions. We hope that this work can serve as a first step towards developing a comprehensive educational evaluation framework, and that this can enable rapid progress within the AI and EdTech communities towards maximising the positive impact of gen AI in education.

我们通过与学习者和教育工作者的合作，将学习科学的高级原则转化为七个多样化的教育基准，并开发了一套新的微调数据集，以提高Gemini的教学能力，引入LearnLM-Tutor。我们的评估结果显示，在教学维度上，教育工作者和学习者一致认为LearnLM-Tutor优于经过提示调优的Gemini。我们希望这项工作能作为发展综合教育评估框架的第一步，并通过AI和教育技术社区的快速进展，最大限度地发挥gen AI在教育中的积极影响。

走向负责任的基于生成AI技术的教育开发：一种以评估为驱动的方法