Relying on either deep models or physical models are two mainstream
approaches for solving inverse sample reconstruction problems in programmable
illumination computational microscopy. Solutions based on physical models
possess strong generalization capabilities while struggling with global
optimization of inverse problems due to a lack of insufficient physical
constraints. In contrast, deep learning methods have strong problem-solving
abilities, but their generalization ability is often questioned because of the
unclear physical principles. Besides, conventional deep models are difficult to
apply to some specific scenes because of the difficulty in acquiring
high-quality training data and their limited capacity to generalize across
different scenarios. In this paper, to combine the advantages of deep models
and physical models together, we propose a hybrid framework consisting of three
sub-neural networks (two deep learning networks and one physics-based network).
We first obtain a result with rich semantic information through a light deep
learning neural network and then use it as the initial value of the physical
network to make its output comply with physical process constraints. These two
results are then used as the input of a fusion deep learning neural work which
utilizes the paired features between the reconstruction results of two
different models to further enhance imaging quality. The final result
integrates the advantages of both deep models and physical models and can
quickly solve the computational reconstruction inverse problem in programmable
illumination computational microscopy and achieve better results. We verified
the feasibility and effectiveness of the proposed hybrid framework with
theoretical analysis and actual experiments on resolution targets and
biological samples.

采用深度模型或物理模型是解决可编程照明计算显微术中逆采样重建问题的两种主流方法。本文结合深度模型和物理模型的优势，提出了一个由三个子神经网络组成的混合框架，在计算显微术中快速解决计算重建逆问题并取得更好的结果。该框架通过深度学习神经网络获得富含语义信息的结果，并将其作为物理网络的初始值，保证输出符合物理过程约束。两个结果作为输入传递给融合深度学习神经网络，进一步增强图像质量。验证了该混合框架的可行性和有效性，通过理论分析和实际实验在分辨目标和生物样本上。