Named Entity Recognition (NER) is a Natural Language Processing technique for
extracting information from textual documents. However, much of the existing
research on NER has been centered around English-language documents, leaving a
gap in the availability of datasets tailored to the financial domain in
Portuguese. This study addresses the need for NER within the financial domain,
focusing on Portuguese-language texts extracted from earnings call
transcriptions of Brazilian banks. By curating a comprehensive dataset
comprising 384 transcriptions and leveraging weak supervision techniques for
annotation, we evaluate the performance of monolingual models trained on
Portuguese (BERTimbau and PTT5) and multilingual models (mBERT and mT5).
Notably, we introduce a novel approach that reframes the token classification
task as a text generation problem, enabling fine-tuning and evaluation of T5
models. Following the fine-tuning of the models, we conduct an evaluation on
the test dataset, employing performance and error metrics. Our findings reveal
that BERT-based models consistently outperform T5-based models. Furthermore,
while the multilingual models exhibit comparable macro F1-scores, BERTimbau
demonstrates superior performance over PTT5. A manual analysis of sentences
generated by PTT5 and mT5 unveils a degree of similarity ranging from 0.89 to
1.0, between the original and generated sentences. However, critical errors
emerge as both models exhibit discrepancies, such as alterations to monetary
and percentage values, underscoring the importance of accuracy and consistency
in the financial domain. Despite these challenges, PTT5 and mT5 achieve
impressive macro F1-scores of 98.52% and 98.85%, respectively, with our
proposed approach. Furthermore, our study sheds light on notable disparities in
memory and time consumption for inference across the models.

研究涉及到从金融领域的葡萄牙语文本中提取信息的 NER 技术，评估了在葡萄牙语训练的 BERT 模型和多语言模型之间的性能差异，同时展示了关键词识别任务作为文本生成问题的新方法。

评估命名实体识别：对巴西企业收益电话会议转录中单语和多语言 Transformer 模型的比较分析

Evaluating Named Entity Recognition: Comparative Analysis of Mono- and  Multilingual Transformer Models on Brazilian Corporate Earnings Call  Transcriptions