Medical professionals frequently work in a data constrained setting to
provide insights across a unique demographic. A few medical observations, for
instance, informs the diagnosis and treatment of a patient. This suggests a
unique setting for meta-learning, a method to learn models quickly on new
tasks, to provide insights unattainable by other methods. We investigate the
use of meta-learning and robustness techniques on a broad corpus of benchmark
text and medical data. To do this, we developed new data pipelines, combined
language models with meta-learning approaches, and extended existing
meta-learning algorithms to minimize worst case loss. We find that
meta-learning on text is a suitable framework for text-based data, providing
better data efficiency and comparable performance to few-shot language models
and can be successfully applied to medical note data. Furthermore,
meta-learning models coupled with DRO can improve worst case loss across
disease codes.

通过研究 meta-learning 和鲁棒性技术在基准文本和医学数据上的应用，我们发现 meta-learning 是基于文本的数据的合适框架，具有更好的数据效率和与 few-shot 语言模型可比的性能，并且可以成功地应用于医疗笔记数据，同时与 DRO 结合的 meta-learning 模型还可以提高疾病编码的最坏情况损失。