Effective representation learning of electronic health records is a
challenging task and is becoming more important as the availability of such
data is becoming pervasive. The data contained in these records are irregular
and contain multiple modalities such as notes, and medical codes. They are
preempted by medical conditions the patient may have, and are typically jotted
down by medical staff. Accompanying codes are notes containing valuable
information about patients beyond the structured information contained in
electronic health records. We use transformer networks and the recently
proposed BERT language model to embed these data streams into a unified vector
representation. The presented approach effectively encodes a patient's visit
data into a single distributed representation, which can be used for downstream
tasks. Our model demonstrates superior performance and generalization on
mortality, readmission and length of stay tasks using the publicly available
MIMIC-III ICU dataset. Code avaialble at
this https URL

应用 Transformer 网络和 BERT 语言模型，将包含多种数据模式的电子病历编入一个统一矢量表示，从而实现了病人就诊数据的高效表示，这种方法在 MIMIC-III ICU 数据集上得到了出色的性能和可泛化性。