Large Language Models (LLMs) are powerful models for generation tasks, but
they may not generate good quality outputs in their first attempt. Apart from
model fine-tuning, existing approaches to improve prediction accuracy and
quality typically involve LLM self-improvement / self-reflection that
incorporate feedback from models themselves. Despite their effectiveness, these
methods are hindered by their high computational cost and lack of scalability.
In this work, we propose CERET, a method for refining text generations by
considering semantic stability, entailment and inter-sample uncertainty
measures. Experimental results show that CERET outperforms Self-consistency and
Self-rerank baselines consistently under various task setups, by ~1.6% in
Rouge-1 for abstractive summarization and ~3.5% in hit rate for question
answering. Compared to LLM Self-rerank method, our approach only requires 9.4%
of its latency and is more cost-effective.

通过考虑语义稳定性、蕴涵和样本间不确定度的方法，我们提出了 CERET，以改进文本生成的质量，实验结果表明 CERET 在各种任务设置下持续优于其他方法，相对于 LLM 自排方法，我们的方法仅需其延迟的 9.4% 且更具成本效益。