This paper details the efforts of the WisPerMed team in the BioLaySumm2024
Shared Task on automatic lay summarization in the biomedical domain, aimed at
making scientific publications accessible to non-specialists. Large language
models (LLMs), specifically the BioMistral and Llama3 models, were fine-tuned
and employed to create lay summaries from complex scientific texts. The
summarization performance was enhanced through various approaches, including
instruction tuning, few-shot learning, and prompt variations tailored to
incorporate specific context information. The experiments demonstrated that
fine-tuning generally led to the best performance across most evaluated
metrics. Few-shot learning notably improved the models' ability to generate
relevant and factually accurate texts, particularly when using a well-crafted
prompt. Additionally, a Dynamic Expert Selection (DES) mechanism to optimize
the selection of text outputs based on readability and factuality metrics was
developed. Out of 54 participants, the WisPerMed team reached the 4th place,
measured by readability, factuality, and relevance. Determined by the overall
score, our approach improved upon the baseline by approx. 5.5 percentage points
and was only approx 1.5 percentage points behind the first place.

本研究介绍了 WisPerMed 团队在生物医学领域的自动文献概述共享任务中的工作，通过精细调整和使用 BioMistral 和 Llama3 模型，从复杂的科学文本中生成面向非专业人士的概述，最终在可读性、准确性和相关性方面实现了显著的性能提升。