We consider the problem of learning predictive models from longitudinal data, consisting of irregularly repeated, sparse observations from a set of individuals over time. Effective approaches to this problem have to account for the complex multi-level correlation structure in the data. Gaussian process models offer an attractive framework for longitudinal data analysis (LDA) because they require fewer assumptions about the underlying data distribution compared to parametric models and model complex correlation structure using a composition of kernels. However, such methods have two key shortcomings: (i) The kernel often relies on ad hoc heuristics or a tedious process of trial and error; and (ii) The methods do not scale with increasing number of individuals, observations per individual, or the number of covariates. We present L-DKGPR, an effective and scalable longitudinal deep kernel Gaussian process regression model that overcomes the key limitations of existing GP based approaches to predictive modeling from longitudinal data. Specifically, L-DKGPR eliminates the need for trial and error or ad hoc heuristics in choosing a kernel function using a deep kernel learning technique which combines the advantages of modern deep neural networks (DNN) with the non-parametric flexibility of kernel methods, to automate the discovery of the rich correlation structure from the data. L-DKGPR adopts a multilevel model to account for the time-invariant individual-specific random effects and the time-varying fixed effects. We show how L-DKGPR can be efficiently trained using a variant of the stochastic variational method. We report the results of extensive experiments using both simulated and real-world benchmark longitudinal data sets that demonstrate the superior performance of L-DKGPR over the state-of-the-art methods.

L-DKGPR是一种从纵向数据中自动发现复杂的多层关联结构的方法，使用新颖的深度核学习技术，结合了深度神经网络的表达能力和非参数核方法的灵活性，通过引入变分推断的方式从潜变量先验中推理出后验。实验表明该方法较之前的LDA方法有明显的提高。

纵向深度核高斯过程回归