BriefGPT.xyz
May, 2024
基于语法对齐的解码
Grammar-Aligned Decoding
HTML
PDF
Kanghee Park, Jiayu Wang, Taylor Berg-Kirkpatrick, Nadia Polikarpova, Loris D'Antoni
TL;DR
通过提出自适应采样算法(ASAp)来解决语法对齐解码(GAD)问题,该算法确保输出结果遵循给定的语法约束,同时与语言模型的条件概率分布相匹配,以高概率生成高质量的输出。
Abstract
large language models
(LLMs) struggle with reliably generating highly structured outputs, such as program code, mathematical formulas, or well-formed markup.
constrained decoding
approaches mitigate this problem
→