Review rating prediction of text reviews is a rapidly growing technology with
a wide range of applications in natural language processing. However, most
existing methods either use hand-crafted features or learn features using deep
learning with simple text corpus as input for review rating prediction,
ignoring the hierarchies among data. In this paper, we propose a Hierarchical
bi-directional self-attention Network framework (HabNet) for paper review
rating prediction and recommendation, which can serve as an effective
decision-making tool for the academic paper review process. Specifically, we
leverage the hierarchical structure of the paper reviews with three levels of
encoders: sentence encoder (level one), intra-review encoder (level two) and
inter-review encoder (level three). Each encoder first derives contextual
representation of each level, then generates a higher-level representation, and
after the learning process, we are able to identify useful predictors to make
the final acceptance decision, as well as to help discover the inconsistency
between numerical review ratings and text sentiment conveyed by reviewers.
Furthermore, we introduce two new metrics to evaluate models in data imbalance
situations. Extensive experiments on a publicly available dataset (PeerRead)
and our own collected dataset (OpenReview) demonstrate the superiority of the
proposed approach compared with state-of-the-art methods.

本文提出了一个基于层次自注意力网络框架（HabNet）的论文审阅评级预测和推荐方法，该方法能够作为学术论文审阅过程的有效决策工具，并通过三级编码器中的分层结构来识别有用的预测器，以及帮助发现评审者所传达的数值评级和文本情感之间的不一致性，进一步引入了两个新的度量标准来评估数据不平衡情况下的模型，经过对公开数据集（PeerRead）和我们自己收集的数据集（OpenReview）的广泛实验，证明了该方法相比于最先进的方法有着更为卓越的表现。