Question answering (QA) is a fundamental means to facilitate assessment and
training of narrative comprehension skills for both machines and young
children, yet there is scarcity of high-quality QA datasets carefully designed
to serve this purpose. In particular, existing datasets rarely distinguish
fine-grained reading skills, such as the understanding of varying narrative
elements. Drawing on the reading education research, we introduce FairytaleQA,
a dataset focusing on narrative comprehension of kindergarten to eighth-grade
students. Generated by educational experts based on an evidence-based
theoretical framework, FairytaleQA consists of 10,580 explicit and implicit
questions derived from 278 children-friendly stories, covering seven types of
narrative elements or relations. Our dataset is valuable in two folds: First,
we ran existing QA models on our dataset and confirmed that this annotation
helps assess models' fine-grained learning skills. Second, the dataset supports
question generation (QG) task in the education domain. Through benchmarking
with QG models, we show that the QG model trained on FairytaleQA is capable of
asking high-quality and more diverse questions.

提出了一个基于故事的问答数据集 FairytaleQA，用于评估和训练机器和儿童的叙事理解技能。该数据集由教育专家根据基于证据的理论框架生成，包括来自 278 个儿童友好的故事的 10,580 个问题，覆盖七种叙事元素或关系，并支持教育领域中的问题生成任务。通过与问题生成模型的基准测试，我们展示了在 FairytaleQA 上训练的 QG 模型能够提出高质量和更多样化的问题。