Manipulatives used in the right way help improve mathematical concepts leading to better learning outcomes. In this paper, we present a phygital (physical + digital) curriculum inspired teaching system for kids aged 5-8 to learn geometry using shape tile manipulatives. Combining smaller shapes to form larger ones is an important skill kids learn early on which requires shape tiles to be placed close to each other in the play area. This introduces a challenge of oriented object detection for densely packed objects with arbitrary orientations. Leveraging simulated data for neural network training and light-weight mobile architectures, we enable our system to understand user interactions and provide real-time audiovisual feedback. Experimental results show that our network runs real-time with high precision/recall on consumer devices, thereby providing a consistent and enjoyable learning experience.

本文介绍了一种五至八岁儿童使用物理数字教学系统，通过形状拼图来掌握几何概念。 通过利用模拟数据进行神经网络训练，并使用轻量级移动体系结构，让系统能够理解用户互动并提供实时音像反馈，本研究证明了我们的系统在消费设备上运行实时并具有很高的精度/召回率，从而提供一种连贯且愉快的学习体验。

使用目标检测技术进行数学教育游戏化