A reasonable and balanced diet is essential for maintaining good health. With
the advancements in deep learning, automated nutrition estimation method based
on food images offers a promising solution for monitoring daily nutritional
intake and promoting dietary health. While monocular image-based nutrition
estimation is convenient, efficient, and economical, the challenge of limited
accuracy remains a significant concern. To tackle this issue, we proposed
DPF-Nutrition, an end-to-end nutrition estimation method using monocular
images. In DPF-Nutrition, we introduced a depth prediction module to generate
depth maps, thereby improving the accuracy of food portion estimation.
Additionally, we designed an RGB-D fusion module that combined monocular images
with the predicted depth information, resulting in better performance for
nutrition estimation. To the best of our knowledge, this was the pioneering
effort that integrated depth prediction and RGB-D fusion techniques in food
nutrition estimation. Comprehensive experiments performed on Nutrition5k
evaluated the effectiveness and efficiency of DPF-Nutrition.

通过深度学习，本研究提出了 DPF-Nutrition 这种基于单目图像的营养估计方法，通过引入深度预测模块和 RGB-D 融合模块，在食物的部分估计和营养估计方面提高了准确性，并在 Nutrition5k 数据集上进行了广泛的实验评估。