Zero-shot In-context learning is the phenomenon where models can perform the
task simply given the instructions. However, pre-trained large language models
are known to be poorly calibrated for this task. One of the most effective
approaches to handling this bias is to adopt a contrastive decoding objective,
which accounts for the prior probability of generating the next token by
conditioning on some context. This work introduces an Anti-Language Model
objective with a decay factor designed to address the weaknesses of In-context
Machine Translation. We conduct our experiments across 3 model types and sizes,
3 language directions, and for both greedy decoding and beam search ($B=5$).
The proposed method outperforms other state-of-art decoding objectives, with up
to $20$ BLEU point improvement from the default objective observed in some
settings.

零射一上下文学习是一种模型能够根据指令进行任务处理的现象。该研究提出了一种具有衰减因子的反语言模型目标，旨在解决上下文机器翻译的弱点，并在实验中表现出优于其他最先进解码目标的性能。