Many people engage in self-directed sports training at home but lack the
real-time guidance of professional coaches, making them susceptible to injuries
or the development of incorrect habits. In this paper, we propose a novel
application framework called MAAIG(Motion Analysis And Instruction Generation).
It can generate embedding vectors for each frame based on user-provided sports
action videos. These embedding vectors are associated with the 3D skeleton of
each frame and are further input into a pretrained T5 model. Ultimately, our
model utilizes this information to generate specific sports instructions. It
has the capability to identify potential issues and provide real-time guidance
in a manner akin to professional coaches, helping users improve their sports
skills and avoid injuries.

提出了一种名为 MAAIG 的新的应用框架，可以为每个帧生成嵌入向量，以用户提供的运动动作视频为基础，然后将这些嵌入向量与每个帧的 3D 骨架相关联，并进一步输入预训练的 T5 模型，最终利用这些信息生成具体的运动指导，类似于专业教练的方式提供潜在问题的识别和实时指导，帮助用户提高运动技能，避免受伤。