Identifying adverse and hostile content on the web and more particularly, on
social media, has become a problem of paramount interest in recent years. With
their ever increasing popularity, fine-tuning of pretrained Transformer-based
encoder models with a classifier head are gradually becoming the new baseline
for natural language classification tasks. In our work, we explore the gains
attributed to Task Adaptive Pretraining (TAPT) prior to fine-tuning of
Transformer-based architectures. We specifically study two problems, namely,
(a) Coarse binary classification of Hindi Tweets into Hostile or Not, and (b)
Fine-grained multi-label classification of Tweets into four categories: hate,
fake, offensive, and defamation. Building up on an architecture which takes
emojis and segmented hashtags into consideration for classification, we are
able to experimentally showcase the performance upgrades due to TAPT. Our
system (with team name 'iREL IIIT') ranked first in the 'Hostile Post Detection
in Hindi' shared task with an F1 score of 97.16% for coarse-grained detection
and a weighted F1 score of 62.96% for fine-grained multi-label classification
on the provided blind test corpora.

本篇研究通过使用 Task Adaptive Pretraining (TAPT) 来完善预训练的基于 Transformer 架构的分类器并结合表情符号和分段的标签来对 Hindi Tweets 进行自然语言粗分类，细分类以及 Twitter 内容分类识别，并在相关比赛中获得了较高的 F1 分数。