Many people engage in self-directed sports training at home but lack the
real-time guidance of professional coaches, making them susceptible to injuries
or the development of incorrect habits. In this paper, we propose a novel
application framework called MAAIG(Motion Analysis And Instruction Generation).
It can generate embedding vectors for each frame based on user-provided sports
action videos. These embedding vectors are associated with the 3D skeleton of
each frame and are further input into a pretrained T5 model. Ultimately, our
model utilizes this information to generate specific sports instructions. It
has the capability to identify potential issues and provide real-time guidance
in a manner akin to professional coaches, helping users improve their sports
skills and avoid injuries.

提出了一种名为 MAAIG 的新的应用框架，可以为每个帧生成嵌入向量，以用户提供的运动动作视频为基础，然后将这些嵌入向量与每个帧的 3D 骨架相关联，并进一步输入预训练的 T5 模型，最终利用这些信息生成具体的运动指导，类似于专业教练的方式提供潜在问题的识别和实时指导，帮助用户提高运动技能，避免受伤。

MAAIG：运动分析与指导生成

MAAIG: Motion Analysis And Instruction Generation

Automatically analyzing dialogue can help understand and guide behavior in
domains such as counseling, where interactions are largely mediated by
conversation. In this paper, we study modeling behavioral codes used to asses a
psychotherapy treatment style called Motivational Interviewing (MI), which is
effective for addressing substance abuse and related problems. Specifically, we
address the problem of providing real-time guidance to therapists with a
dialogue observer that (1) categorizes therapist and client MI behavioral codes
and, (2) forecasts codes for upcoming utterances to help guide the conversation
and potentially alert the therapist. For both tasks, we define neural network
models that build upon recent successes in dialogue modeling. Our experiments
demonstrate that our models can outperform several baselines for both tasks. We
also report the results of a careful analysis that reveals the impact of the
various network design tradeoffs for modeling therapy dialogue.

本文使用对话模型来分析行为特征，实现实时指导，探讨应对物质滥用问题有效的 Motivational Interviewing 治疗方式。