Surgical triplet recognition is an essential building block to enable
next-generation context-aware operating rooms. The goal is to identify the
combinations of instruments, verbs, and targets presented in surgical video
frames. In this paper, we propose DiffTriplet, a new generative framework for
surgical triplet recognition employing the diffusion model, which predicts
surgical triplets via iterative denoising. To handle the challenge of triplet
association, two unique designs are proposed in our diffusion framework, i.e.,
association learning and association guidance. During training, we optimize the
model in the joint space of triplets and individual components to capture the
dependencies among them. At inference, we integrate association constraints
into each update of the iterative denoising process, which refines the triplet
prediction using the information of individual components. Experiments on the
CholecT45 and CholecT50 datasets show the superiority of the proposed method in
achieving a new state-of-the-art performance for surgical triplet recognition.
Our codes will be released.

在本文中，我们提出了 DiffTriplet，一种利用扩散模型的新的生成性手术三元组识别框架，通过迭代去噪来预测手术三元组。我们的 Diffusion 框架提出了两种独特的设计来解决三元组关联的挑战，即关联学习和关联引导。实验证明，我们的方法在手术三元组识别方面取得了卓越的性能，达到了最新的最先进水平。