Given the increasing demand for mental health assistance, artificial
intelligence (AI), particularly large language models (LLMs), may be valuable
for integration into automated clinical support systems. In this work, we
leverage a decision transformer architecture for topic recommendation in
counseling conversations between patients and mental health professionals. The
architecture is utilized for offline reinforcement learning, and we extract
states (dialogue turn embeddings), actions (conversation topics), and rewards
(scores measuring the alignment between patient and therapist) from previous
turns within a conversation to train a decision transformer model. We
demonstrate an improvement over baseline reinforcement learning methods, and
propose a novel system of utilizing our model's output as synthetic labels for
fine-tuning a large language model for the same task. Although our
implementation based on LLaMA-2 7B has mixed results, future work can
undoubtedly build on the design.

通过离线强化学习，我们利用决策变压器架构在患者和心理健康专业人员之间的咨询对话中进行主题推荐，展示了优于基准强化学习方法的改进，并提出了一种新的系统来利用我们模型的输出作为相同任务的大型语言模型的合成标签进行微调。