The popularity of Metaverse as an entertainment, social, and work platform
has led to a great need for seamless avatar integration in the virtual world.
In Metaverse, avatars must be updated and rendered to reflect users' behaviour.
Achieving real-time synchronization between the virtual bilocation and the user
is complex, placing high demands on the Metaverse Service Provider (MSP)'s
rendering resource allocation scheme. To tackle this issue, we propose a
semantic communication framework that leverages contest theory to model the
interactions between users and MSPs and determine optimal resource allocation
for each user. To reduce the consumption of network resources in wireless
transmission, we use the semantic communication technique to reduce the amount
of data to be transmitted. Under our simulation settings, the encoded semantic
data only contains 51 bytes of skeleton coordinates instead of the image size
of 8.243 megabytes. Moreover, we implement Deep Q-Network to optimize reward
settings for maximum performance and efficient resource allocation. With the
optimal reward setting, users are incentivized to select their respective
suitable uploading frequency, reducing down-sampling loss due to rendering
resource constraints by 66.076\% compared with the traditional average
distribution method. The framework provides a novel solution to resource
allocation for avatar association in VR environments, ensuring a smooth and
immersive experience for all users.

建议使用语义通信框架和深度 Q 网络优化资源分配，以实现虚拟现实环境中的角色关联的资源分配，确保用户在 Metaverse 中获得流畅而沉浸的体验。

基于视觉的元宇宙服务语义传播：竞赛理论方法

Vision-based Semantic Communications for Metaverse Services: A Contest  Theoretic Approach

In this paper, a semantic communication framework is proposed for textual
data transmission. In the studied model, a base station (BS) extracts the
semantic information from textual data, and transmits it to each user. The
semantic information is modeled by a knowledge graph (KG) that consists of a
set of semantic triples. After receiving the semantic information, each user
recovers the original text using a graph-to-text generation model. To measure
the performance of the considered semantic communication framework, a metric of
semantic similarity (MSS) that jointly captures the semantic accuracy and
completeness of the recovered text is proposed. Due to wireless resource
limitations, the BS may not be able to transmit the entire semantic information
to each user and satisfy the transmission delay constraint. Hence, the BS must
select an appropriate resource block for each user as well as determine and
transmit part of the semantic information to the users. As such, we formulate
an optimization problem whose goal is to maximize the total MSS by jointly
optimizing the resource allocation policy and determining the partial semantic
information to be transmitted. To solve this problem, a
proximal-policy-optimization-based reinforcement learning (RL) algorithm
integrated with an attention network is proposed. The proposed algorithm can
evaluate the importance of each triple in the semantic information using an
attention network and then, build a relationship between the importance
distribution of the triples in the semantic information and the total MSS.
Compared to traditional RL algorithms, the proposed algorithm can dynamically
adjust its learning rate thus ensuring convergence to a locally optimal
solution.

本文提出一种基于语义的通信框架，其中基站从文本数据中提取语义信息并采用知识图表达，将其发给每个用户，用户再采用图到文本生成模型进行还原。为了优化性能，本文提出了一个同时考虑语义精度和完整性的语义相似度度量方法，同时解决了基站资源分配、文本内容和时延约束之间的优化问题。这里采用了基于强化学习的算法，结合了注意力网络来评估语义信息中每个三元组的重要性。