Eye-tracking technology is integral to numerous consumer electronics
applications, particularly in the realm of virtual and augmented reality
(VR/AR). These applications demand solutions that excel in three crucial
aspects: low-latency, low-power consumption, and precision. Yet, achieving
optimal performance across all these fronts presents a formidable challenge,
necessitating a balance between sophisticated algorithms and efficient backend
hardware implementations. In this study, we tackle this challenge through a
synergistic software/hardware co-design of the system with an event camera.
Leveraging the inherent sparsity of event-based input data, we integrate a
novel sparse FPGA dataflow accelerator customized for submanifold sparse
convolution neural networks (SCNN). The SCNN implemented on the accelerator can
efficiently extract the embedding feature vector from each representation of
event slices by only processing the non-zero activations. Subsequently, these
vectors undergo further processing by a gated recurrent unit (GRU) and a fully
connected layer on the host CPU to generate the eye centers. Deployment and
evaluation of our system reveal outstanding performance metrics. On the
Event-based Eye-Tracking-AIS2024 dataset, our system achieves 81% p5 accuracy,
99.5% p10 accuracy, and 3.71 Mean Euclidean Distance with 0.7 ms latency while
only consuming 2.29 mJ per inference. Notably, our solution opens up
opportunities for future eye-tracking systems. Code is available at
this https URL

基于眼动追踪技术和 FPGA 数据流加速器的稀疏卷积神经网络系统拥有优秀的性能度量指标。

与子流形稀疏 CNN 共同设计的亚毫秒延迟事件驱动眼动追踪系统

Co-designing a Sub-millisecond Latency Event-based Eye Tracking System  with Submanifold Sparse CNN

Despite the proliferation of Blockchain Metaverse projects, the inclusion of
physically disabled individuals in the Metaverse remains distant, with limited
standards and regulations in place. However, the article proposes a concept of
the Metaverse that leverages emerging technologies, such as Virtual and
Augmented Reality, and the Internet of Things, to enable greater engagement of
disabled creatives. This approach aims to enhance inclusiveness in the
Metaverse landscape. Based on the findings, the paper concludes that the active
involvement of physically disabled individuals in the design and development of
Metaverse platforms is crucial for promoting inclusivity. The proposed
framework for accessibility and inclusiveness in Virtual, Augmented, and Mixed
realities of decentralised Metaverses provides a basis for the meaningful
participation of disabled creatives. The article emphasises the importance of
addressing the mechanisms for art production by individuals with disabilities
in the emerging Metaverse landscape. Additionally, it highlights the need for
further research and collaboration to establish standards and regulations that
facilitate the inclusion of physically disabled individuals in Metaverse
projects.

该研究论文提出了一种利用虚拟和增强现实以及物联网等新兴技术的 Metaverse 概念，旨在促进残障创作者更好地参与其中，以提高 Metaverse 中的包容性。其结论表明，残障人士在 Metaverse 平台的设计和开发中的积极参与对于促进包容性至关重要。提出的无障碍和含义广泛的 Metaverse 虚拟、增强和混合现实框架为残障创作者有意义的参与提供了基础。文章强调了解决残障人士在新兴 Metaverse 领域中的艺术创作机制的重要性，并强调了需要进一步的研究和合作来建立促进残障人士参与 Metaverse 项目的标准和规定。