Based on one million arXiv papers submitted from May 2018 to January 2024, we
assess the textual density of ChatGPT's writing style in their abstracts by
means of a statistical analysis of word frequency changes. Our model is
calibrated and validated on a mixture of real abstracts and ChatGPT-modified
abstracts (simulated data) after a careful noise analysis. We find that ChatGPT
is having an increasing impact on arXiv abstracts, especially in the field of
computer science, where the fraction of ChatGPT-revised abstracts is estimated
to be approximately 35%, if we take the output of one of the simplest prompts,
"revise the following sentences", as a baseline. We conclude with an analysis
of both positive and negative aspects of the penetration of ChatGPT into
academics' writing style.

通过对从 2018 年 5 月到 2024 年 1 月提交的 100 万篇 arXiv 论文进行统计分析，我们评估了 ChatGPT 在其摘要中的文本密度，通过词频变化的统计分析。我们的模型在真实摘要和 ChatGPT 修改后的摘要（模拟数据）的混合数据上进行校准和验证，经过仔细的噪声分析。我们发现，ChatGPT 对 arXiv 摘要的影响正在增加，特别是在计算机科学领域，ChatGPT 修改的摘要比例估计约为 35%，如果我们以 “修改以下句子” 作为基准。最后，我们分析了 ChatGPT 对学术写作风格渗透的积极和消极方面。

ChatGPT 是否正在改变学术写作风格？

Is ChatGPT Transforming Academics' Writing Style?

Effective figure captions are crucial for clear comprehension of scientific
figures, yet poor caption writing remains a common issue in scientific
articles. Our study of arXiv cs.CL papers found that 53.88% of captions were
rated as unhelpful or worse by domain experts, showing the need for better
caption generation. Previous efforts in figure caption generation treated it as
a vision task, aimed at creating a model to understand visual content and
complex contextual information. Our findings, however, demonstrate that over
75% of figure captions' tokens align with corresponding figure-mentioning
paragraphs, indicating great potential for language technology to solve this
task. In this paper, we present a novel approach for generating figure captions
in scientific documents using text summarization techniques. Our approach
extracts sentences referencing the target figure, then summarizes them into a
concise caption. In the experiments on real-world arXiv papers (81.2% were
published at academic conferences), our method, using only text data,
outperformed previous approaches in both automatic and human evaluations. We
further conducted data-driven investigations into the two core challenges: (i)
low-quality author-written captions and (ii) the absence of a standard for good
captions. We found that our models could generate improved captions for figures
with original captions rated as unhelpful, and the model trained on captions
with more than 30 tokens produced higher-quality captions. We also found that
good captions often include the high-level takeaway of the figure. Our work
proves the effectiveness of text summarization in generating figure captions
for scholarly articles, outperforming prior vision-based approaches. Our
findings have practical implications for future figure captioning systems,
improving scientific communication clarity.

本文介绍用纯文本方法生成科学文献图注的一种新方法，使用了提取目标图像引用的句子然后将其总结为简明的图注的技术。通过真实世界 arXiv 论文的实验，我们的方法在自动和人工评估中都优于以前的方法，证明了纯文本技术在生成学术文章中的图片标注方面的有效性。