Existing approaches on zero-shot event detection usually train models on
datasets annotated with known event types, and prompt them with unseen event
definitions. These approaches yield sporadic successes, yet generally fall
short of expectations. In this work, we aim to improve zero-shot event
detection by training models to better follow event definitions. We hypothesize
that a diverse set of event types and definitions are the key for models to
learn to follow event definitions while existing event extraction datasets
focus on annotating many high-quality examples for a few event types. To verify
our hypothesis, we construct an automatically generated Diverse Event
Definition (DivED) dataset and conduct comparative studies. Our experiments
reveal that a large number of event types (200) and diverse event definitions
can significantly boost event extraction performance; on the other hand, the
performance does not scale with over ten examples per event type. Beyond
scaling, we incorporate event ontology information and hard-negative samples
during training, further boosting the performance. Based on these findings, we
fine-tuned a LLaMA-2-7B model on our DivED dataset, yielding performance that
surpasses SOTA large language models like GPT-3.5 across three open benchmarks
on zero-shot event detection.

通过研究零样本事件检测中的事件类型和定义，提出了使用多样化的事件类型和定义来提高模型遵循事件定义的方法，并构建了一个自动生成的多样化事件定义（DivED）数据集进行实证研究，结果显示，大量的事件类型和多样化的事件定义可以显著提升事件提取性能，同时在训练中引入事件本体信息和困难负样本可以进一步提高性能，基于这些发现，在 DivED 数据集上微调 LLaMA-2-7B 模型，在三个零样本事件检测基准上取得了超越 GPT-3.5 等最新大语言模型的性能。