Transformers have revolutionized machine learning across diverse domains, yet
understanding their behavior remains crucial, particularly in high-stakes
applications. This paper introduces the contextual counting task, a novel toy
problem aimed at enhancing our understanding of Transformers in quantitative
and scientific contexts. This task requires precise localization and
computation within datasets, akin to object detection or region-based
scientific analysis. We present theoretical and empirical analysis using both
causal and non-causal Transformer architectures, investigating the influence of
various positional encodings on performance and interpretability. In
particular, we find that causal attention is much better suited for the task,
and that no positional embeddings lead to the best accuracy, though rotary
embeddings are competitive and easier to train. We also show that out of
distribution performance is tightly linked to which tokens it uses as a bias
term.

该研究论文介绍了一种上下文计数任务，通过理论和实证分析，揭示了 Transformer 在性能和可解释性方面的影响因素，特别是发现因果关注机制更适合该任务，并且没有位置编码可以获得最佳准确性。