While action recognition has been addressed extensively in the field of computer vision, action quality assessment has not been given much attention. Estimating action quality is crucial in areas such as sports and health care, while being useful in other areas like video retrieval. Unlike action recognition, which has millions of examples to learn from, the action quality datasets that are currently available are small -- typically comprised of only a few hundred samples. We develop quality assessment frameworks which use SVR, LSTM and LSTM-SVR on top of spatiotemporal features learned using 3D convolutional neural networks (C3D). We demonstrate an efficient training mechanism for action quality LSTM suitable for limited data scenarios. The proposed systems show significant improvement over existing quality assessment approaches on the task of predicting scores of Olympic events both with short-time length actions (10m platform diving) and long-time length actions (figure skating short program). While SVR based frameworks yields better results, LSTM based frameworks are more intuitive and natural for describing the action, and can be used for improvement feedback.

本研究使用三种基于神经网络模型的框架(SVR, LSTM, LSTM+SVR)对奥林匹克运动会项目（跳水、跳马和花样滑冰）的比赛评价进行实验。实验结果表明，三种框架均显著优于现有的比赛质量评估方法，其中基于SVR的框架取得最好的效果，而基于LSTM的框架则更符合动作的描述和改进反馈。

学习如何给奥林匹克比赛打分