Laplacian regularized stratified models (LRSM) are models that utilize the
explicit or implicit network structure of the sub-problems as defined by the
categorical features called strata (e.g., age, region, time, forecast horizon,
etc.), and draw upon data from neighboring strata to enhance the parameter
learning of each sub-problem. They have been widely applied in machine learning
and signal processing problems, including but not limited to time series
forecasting, representation learning, graph clustering, max-margin
classification, and general few-shot learning. Nevertheless, existing works on
LRSM have either assumed a known graph or are restricted to specific
applications. In this paper, we start by showing the importance and sensitivity
of graph weights in LRSM, and provably show that the sensitivity can be
arbitrarily large when the parameter scales and sample sizes are heavily
imbalanced across nodes. We then propose a generic approach to jointly learn
the graph while fitting the model parameters by solving a single optimization
problem. We interpret the proposed formulation from both a graph connectivity
viewpoint and an end-to-end Bayesian perspective, and propose an efficient
algorithm to solve the problem. Convergence guarantees of the proposed
optimization algorithm is also provided despite the lack of global strongly
smoothness of the Laplacian regularization term typically required in the
existing literature, which may be of independent interest. Finally, we
illustrate the efficiency of our approach compared to existing methods by
various real-world numerical examples.

本文讨论了 Laplacian regularized stratified models (LRSM) 的图权重敏感性问题，并提出了一种通用的学习图权重和模型参数的解决方案。我们从图连通性和贝叶斯视角解释了所提出的公式，并提出了一种有效的算法来解决问题。我们还提供了所提出的优化算法的收敛保证，最后我们通过各种现实世界的数值例子证明了我们的方法相对于现有方法的效率。