The objective of topic inference in research proposals aims to obtain the
most suitable disciplinary division from the discipline system defined by a
funding agency. The agency will subsequently find appropriate peer review
experts from their database based on this division. Automated topic inference
can reduce human errors caused by manual topic filling, bridge the knowledge
gap between funding agencies and project applicants, and improve system
efficiency. Existing methods focus on modeling this as a hierarchical
multi-label classification problem, using generative models to iteratively
infer the most appropriate topic information. However, these methods overlook
the gap in scale between interdisciplinary research proposals and
non-interdisciplinary ones, leading to an unjust phenomenon where the automated
inference system categorizes interdisciplinary proposals as
non-interdisciplinary, causing unfairness during the expert assignment. How can
we address this data imbalance issue under a complex discipline system and
hence resolve this unfairness? In this paper, we implement a topic label
inference system based on a Transformer encoder-decoder architecture.
Furthermore, we utilize interpolation techniques to create a series of
pseudo-interdisciplinary proposals from non-interdisciplinary ones during
training based on non-parametric indicators such as cross-topic probabilities
and topic occurrence probabilities. This approach aims to reduce the bias of
the system during model training. Finally, we conduct extensive experiments on
a real-world dataset to verify the effectiveness of the proposed method. The
experimental results demonstrate that our training strategy can significantly
mitigate the unfairness generated in the topic inference task.

基于 Transformer 编码器 - 解码器架构实现的主题标签推断系统，利用插值技术在训练时从非跨学科提案中创建一系列伪跨学科提案，旨在减少模型训练中的偏见，进行了大量实验证明了该方法在主题推断任务中显著减轻了产生的不公平。

不平衡研究提案主题推理中的跨学科公平性：一种基于层次变压器的选择插值方法

Interdisciplinary Fairness in Imbalanced Research Proposal Topic  Inference: A Hierarchical Transformer-based Method with Selective  Interpolation

Many classification models work poorly on short texts due to data sparsity.
To address this issue, we propose topic memory networks for short text
classification with a novel topic memory mechanism to encode latent topic
representations indicative of class labels. Different from most prior work that
focuses on extending features with external knowledge or pre-trained topics,
our model jointly explores topic inference and text classification with memory
networks in an end-to-end manner. Experimental results on four benchmark
datasets show that our model outperforms state-of-the-art models on short text
classification, meanwhile generates coherent topics.

我们提出了用于短文本分类的主题记忆网络，采用新颖的主题记忆机制来编码类别标签的潜在主题表示，实验结果表明，我们的模型在短文本分类方面优于现有模型，并生成连贯的主题。

用于短文本分类的主题记忆网络

Topic Memory Networks for Short Text Classification

Latent Dirichlet Allocation (LDA) is a three-level hierarchical Bayesian
model for topic inference. In spite of its great success, inferring the latent
topic distribution with LDA is time-consuming. Motivated by the transfer
learning approach proposed by~\newcite{hinton2015distilling}, we present a
novel method that uses LDA to supervise the training of a deep neural network
(DNN), so that the DNN can approximate the costly LDA inference with less
computation. Our experiments on a document classification task show that a
simple DNN can learn the LDA behavior pretty well, while the inference is
speeded up tens or hundreds of times.

本研究提出了一种使用深度神经网络预测 LDA 模型中潜在主题分布的方法，借鉴了迁移学习的思想，实现了在大大降低计算时间的同时取得较好的分类效果。