Viktor Schlegel, Kamen V. Pavlov, Ian Pratt-Hartmann
TL;DR本文对深度学习在自然语言处理（NLP）方面的最新应用进行了调查研究，发现transformer-based language models在检测受控自然语言片段的有效推理方面表现出明显的过拟合问题，未能获取主导推理的逻辑原则。
Abstract
State-of-the-art deep-learning-based approaches to Natural Language Processing (nlp) are credited with various capabilities that involve reasoning with natural language texts. In this paper we carry out a large-scale empirical study investigating the detection of formally valid