Accurate estimation of multiple quality variables is critical for building
industrial soft sensor models, which have long been confronted with data
efficiency and negative transfer issues. Methods sharing backbone parameters
among tasks address the data efficiency issue; however, they still fail to
mitigate the negative transfer problem. To address this issue, a balanced
Mixture-of-Experts (BMoE) is proposed in this work, which consists of a
multi-gate mixture of experts (MMoE) module and a task gradient balancing (TGB)
module. The MoE module aims to portray task relationships, while the TGB module
balances the gradients among tasks dynamically. Both of them cooperate to
mitigate the negative transfer problem. Experiments on the typical sulfur
recovery unit demonstrate that BMoE models task relationship and balances the
training process effectively, and achieves better performance than baseline
models significantly.

本研究提出了一种基于混合专家（MoE）和任务梯度平衡（TGB）的平衡混合专家模型（BMoE），通过表述任务关系和动态平衡任务梯度，解决了工业软传感模型中的数据效率和负迁移问题，并在典型的硫回收装置上获得了显著优异的表现。