We consider joint estimation of multiple graphical models arising from
heterogeneous and high-dimensional observations. Unlike most previous
approaches which assume that the cluster structure is given in advance, an
appealing feature of our method is to learn cluster structure while estimating
heterogeneous graphical models. This is achieved via a high dimensional version
of Expectation Conditional Maximization (ECM) algorithm (Meng and Rubin, 1993).
A joint graphical lasso penalty is imposed on the conditional maximization step
to extract both homogeneity and heterogeneity components across all clusters.
Our algorithm is computationally efficient due to fast sparse learning routines
and can be implemented without unsupervised learning knowledge. The superior
performance of our method is demonstrated by extensive experiments and its
application to a Glioblastoma cancer dataset reveals some new insights in
understanding the Glioblastoma cancer. In theory, a non-asymptotic error bound
is established for the output directly from our high dimensional ECM algorithm,
and it consists of two quantities: statistical error (statistical accuracy) and
optimization error (computational complexity). Such a result gives a
theoretical guideline in terminating our ECM iterations.

本文提出了一种基于高维 Expectation Conditional Maximization 算法的、能够在估计异构性图模型的同时学习群集结构的方法，通过在条件极大化步骤中施加联合图套索惩罚来提取所有群集中的同质性和异质性组件来实现学习群集结构，算法具有计算效率并且可以在不需要无监督学习知识的情况下实现，并通过广泛实验和应用于 Glioblastoma 癌症数据集揭示了对 Glioblastoma 癌症的新见解。