In this paper, we present a low-budget and high-authenticity bidirectional telepresence system, Tele-Aloha, targeting peer-to-peer communication scenarios. Compared to previous systems, Tele-Aloha utilizes only four sparse RGB cameras, one consumer-grade GPU, and one autostereoscopic screen to achieve high-resolution (2048x2048), real-time (30 fps), low-latency (less than 150ms) and robust distant communication. As the core of Tele-Aloha, we propose an efficient novel view synthesis algorithm for upper-body. Firstly, we design a cascaded disparity estimator for obtaining a robust geometry cue. Additionally a neural rasterizer via Gaussian Splatting is introduced to project latent features onto target view and to decode them into a reduced resolution. Further, given the high-quality captured data, we leverage weighted blending mechanism to refine the decoded image into the final resolution of 2K. Exploiting world-leading autostereoscopic display and low-latency iris tracking, users are able to experience a strong three-dimensional sense even without any wearable head-mounted display device. Altogether, our telepresence system demonstrates the sense of co-presence in real-life experiments, inspiring the next generation of communication.

本文介绍了一种低成本、高真实性的双向远程呈现系统Tele-Aloha，它采用四个稀疏的RGB相机、一台消费级GPU和一个自动立体屏幕，实现了高分辨率(2048x2048)、实时性(30 fps)、低延迟性(小于150ms)和稳定的远程沟通。我们提出了一种有效的新型视图合成算法用于上半身，通过级联视差估计器和高斯喷洒的神经光栅化器，我们能够在目标视角上投影潜在特征并将其解码为降低分辨率的图像，然后利用加权混合机制将解码图像进一步优化至2K分辨率。利用世界领先的自动立体显示和低延迟虹膜追踪技术，用户可以在没有任何佩戴式头戴显示设备的情况下体验到强烈的立体感。总的来说，我们的远程呈现系统在实生实验中呈现了共存感，为下一代通信技术提供了启示。

Tele-Aloha: 一种低成本、高真实度的远程存在感系统，使用稀疏的RGB摄像头