In the principles-and-parameters framework, the structural features of
languages depend on parameters that may be toggled on or off, with a single
parameter often dictating the status of multiple features. The implied
covariance between features inspires our probabilisation of this line of
linguistic inquiry---we develop a generative model of language based on
exponential-family matrix factorisation. By modelling all languages and
features within the same architecture, we show how structural similarities
between languages can be exploited to predict typological features with
near-perfect accuracy, outperforming several baselines on the task of
predicting held-out features. Furthermore, we show that language embeddings
pre-trained on monolingual text allow for generalisation to unobserved
languages. This finding has clear practical and also theoretical implications:
the results confirm what linguists have hypothesised, i.e.~that there are
significant correlations between typological features and languages.

使用指令与参数框架、生成式语言模型、指数族矩阵分解等方法建立语言结构的概率模型，实现了对不同语言之间结构的预测，并表明语言嵌入的预训练可以推广到未观察的语言。