Generative models reliant on sequential autoregression have been at the
forefront of language generation for an extensive period, particularly
following the introduction of widely acclaimed transformers. Despite its
excellent performance, there are always some issues that we face today. For
example, problems such as hallucinations and getting trapped in a logic loop
may occur. To enhance the performance of existing systems, this paper
introduces a new method for generating sequences in natural language, which
involves generating the targeted sentence in a tree-traversing order. The paper
includes an illustration of the theoretical basis and validity of the approach,
as well as a comparison of its fundamentals with the diffusion model in graphic
generation. Finally, a module called SenTree is introduced for generating an
approximating binary tree. It is already available at
this https URL Additionally, a joint training framework
based on this approach is proposed, incorporating the intrinsics of generative
adversarial networks.

通过生成具有树遍历顺序的目标句子的新方法，本研究旨在提高现有系统的性能。此外，还引入了一个名为 SenTree 的模块来生成近似二叉树，并提出了一个基于该方法的联合训练框架，结合生成对抗网络的内在机制。