We investigate probabilistic graphical models that allow for both cycles and
latent variables. For this we introduce directed graphs with hyperedges
(HEDGes), generalizing and combining both marginalized directed acyclic graphs
(mDAGs) that can model latent (dependent) variables, and directed mixed graphs
(DMGs) that can model cycles. We define and analyse several different Markov
properties that relate the graphical structure of a HEDG with a probability
distribution on a corresponding product space over the set of nodes, for
example factorization properties, structural equations properties,
ordered/local/global Markov properties, and marginal versions of these. The
various Markov properties for HEDGes are in general not equivalent to each
other when cycles or hyperedges are present, in contrast with the simpler case
of directed acyclic graphical (DAG) models (also known as Bayesian networks).
We show how the Markov properties for HEDGes - and thus the corresponding
graphical Markov models - are logically related to each other.

研究了允许存在循环和潜变量的概率图模型，并引入了带有超边的有向图，定义并分析了多个与图形结构相关的马尔可夫属性。

具有循环和潜变量的图模型的马尔可夫属性

Markov Properties for Graphical Models with Cycles and Latent Variables

We investigate the low-dimensional structure of deterministic transformations
between random variables, i.e., transport maps between probability measures. In
the context of statistics and machine learning, these transformations can be
used to couple a tractable "reference" measure (e.g., a standard Gaussian) with
a target measure of interest. Direct simulation from the desired measure can
then be achieved by pushing forward reference samples through the map. Yet
characterizing such a map---e.g., representing and evaluating it---grows
challenging in high dimensions. The central contribution of this paper is to
establish a link between the Markov properties of the target measure and the
existence of low-dimensional couplings, induced by transport maps that are
sparse and/or decomposable. Our analysis not only facilitates the construction
of transformations in high-dimensional settings, but also suggests new
inference methodologies for continuous non-Gaussian graphical models. For
instance, in the context of nonlinear state-space models, we describe new
variational algorithms for filtering, smoothing, and sequential parameter
inference. These algorithms can be understood as the natural
generalization---to the non-Gaussian case---of the square-root
Rauch-Tung-Striebel Gaussian smoother.

通过探究概率分布之间的确定性变换结构，我们建立了目标分布的马尔可夫特性与较低维耦合间的联系，从而解决高维情形下的非高斯图模型推断问题，并提出了相应的方案。

通过低维耦合进行推断

Inference via low-dimensional couplings

The statistical literature discusses different types of Markov properties for
chain graphs that lead to four possible classes of chain graph Markov models.
The different models are rather well understood when the observations are
continuous and multivariate normal, and it is also known that one model class,
referred to as models of LWF (Lauritzen--Wermuth--Frydenberg) or block
concentration type, yields discrete models for categorical data that are
smooth. This paper considers the structural properties of the discrete models
based on the three alternative Markov properties. It is shown by example that
two of the alternative Markov properties can lead to non-smooth models. The
remaining model class, which can be viewed as a discrete version of
multivariate regressions, is proven to comprise only smooth models. The proof
employs a simple change of coordinates that also reveals that the model's
likelihood function is unimodal if the chain components of the graph are
complete sets.

该论文研究了基于三种不同的马尔科夫属性的离散模型的结构特性，其中一等级类别的 LWF 模型可以产生平滑的分类数据的离散模型，并且还证明了这种模型的似然函数在图中的链组成是完全的情况下是单峰的。