In today's globalized world, effective communication with people from diverse
linguistic backgrounds has become increasingly crucial. While traditional
methods of language translation, such as written text or voice-only
translations, can accomplish the task, they often fail to capture the complete
context and nuanced information conveyed through nonverbal cues like facial
expressions and lip movements. In this paper, we present an end-to-end video
translation system that not only translates spoken language but also
synchronizes the translated speech with the lip movements of the speaker. Our
system focuses on translating educational lectures in various Indian languages,
and it is designed to be effective even in low-resource system settings. By
incorporating lip movements that align with the target language and matching
them with the speaker's voice using voice cloning techniques, our application
offers an enhanced experience for students and users. This additional feature
creates a more immersive and realistic learning environment, ultimately making
the learning process more effective and engaging.

本文介绍了一种视频翻译系统，不仅能够翻译语言，还能将翻译的声音与说话者的唇部运动同步。该系统专注于翻译印度各种语言的教育讲座，在低资源环境中也能高效运行。通过将目标语言与说话者的唇部运动结合，并使用语音克隆技术将它们与说话者的声音匹配，我们的应用程序为学生和用户提供了更加沉浸式和真实的学习环境，从而增强了学习的效果和吸引力。