Clinical documentation is an important aspect of clinicians' daily work and often demands a significant amount of time. The BioNLP 2024 Shared Task on Streamlining Discharge Documentation (Discharge Me!) aims to alleviate this documentation burden by automatically generating discharge summary sections, including brief hospital course and discharge instruction, which are often time-consuming to synthesize and write manually. We approach the generation task by fine-tuning multiple open-sourced language models (LMs), including both decoder-only and encoder-decoder LMs, with various configurations on input context. We also examine different setups for decoding algorithms, model ensembling or merging, and model specialization. Our results show that conditioning on the content of discharge summary prior to the target sections is effective for the generation task. Furthermore, we find that smaller encoder-decoder LMs can work as well or even slightly better than larger decoder based LMs fine-tuned through LoRA. The model checkpoints from our team (aehrc) are openly available.

通过调整多个开源语言模型的输入上下文、解码算法以及模型的特定领域训练，我们的研究解决了医护人员日常工作中繁琐的临床文档编写问题，并以生成出院小结为例，得出了在目标部分之前依赖于出院小结内容的生成方法要更加有效，同时较小的编码-解码模型也能比基于解码的较大语言模型在此任务中表现得更好。我们团队（aehrc）的模型训练结果已公开提供。

2024年“出院我”电子健康CSIRO: 用精细调整的语言模型生成出院小结部分