Large LMs such as GPT-3, while powerful, are not immune to mistakes, but are prohibitively costly to retrain. One failure mode is misinterpreting a user's instruction (e.g., GPT-3 interpreting "What word is similar to good?" to mean a homonym, while the user intended a synonym). Our goal is to allow users to correct such errors directly through interaction -- without retraining. Our approach pairs GPT-3 with a growing memory of cases where the model misunderstood the user's intent and was provided with feedback, clarifying the instruction. Given a new query, our memory-enhanced GPT-3 uses feedback from similar, prior queries to enrich the prompt. Through simple proof-of-concept experiments, we show how a (simulated) user can interactively teach a deployed GPT-3, doubling its accuracy on basic lexical tasks (e.g., generate a synonym) where users query in different, novel (often misunderstood) ways. In such scenarios, memory helps avoid repeating similar past mistakes. Our simple idea is a first step towards strengthening deployed models, potentially broadening their utility. All the code and data is available at https://github.com/madaan/memprompt.

利用用户交互纠正GPT-3模型的错误，而无需进行重新训练。本文中提出了将GPT-3与一个不断增长的记录案例和用户反馈的记忆相结合的方法，以产生一个可查询该记忆进行错误纠正的系统。通过证明方法可以增强大型预训练语言模型的实用性，特别是在与用户交互时，已经部署的GPT-3的准确性可以得到大幅提高。

部署后记忆辅助提示编辑以改进GPT-3