Automatic speech recognition (ASR) systems, increasingly prevalent in
education, healthcare, employment, and mobile technology, face significant
challenges in inclusivity, particularly for the 80 million-strong global
community of people who stutter. These systems often fail to accurately
interpret speech patterns deviating from typical fluency, leading to critical
usability issues and misinterpretations. This study evaluates six leading ASRs,
analyzing their performance on both a real-world dataset of speech samples from
individuals who stutter and a synthetic dataset derived from the widely-used
LibriSpeech benchmark. The synthetic dataset, uniquely designed to incorporate
various stuttering events, enables an in-depth analysis of each ASR's handling
of disfluent speech. Our comprehensive assessment includes metrics such as word
error rate (WER), character error rate (CER), and semantic accuracy of the
transcripts. The results reveal a consistent and statistically significant
accuracy bias across all ASRs against disfluent speech, manifesting in
significant syntactical and semantic inaccuracies in transcriptions. These
findings highlight a critical gap in current ASR technologies, underscoring the
need for effective bias mitigation strategies. Addressing this bias is
imperative not only to improve the technology's usability for people who
stutter but also to ensure their equitable and inclusive participation in the
rapidly evolving digital landscape.

这项研究评估了六个领先的自动语音识别系统对有语吃现象的言语的处理性能，并发现这些系统普遍存在的准确性偏差对不流利言语的处理，导致语法和语义不准确的转录，揭示了当前自动语音识别技术存在的重要差距，强调了有效的偏见缓解策略的必要性。