Prompt-based techniques have demostrated great potential for improving the
few-shot generalization of pretrained language models. However, their
performance heavily relies on the manual design of prompts and thus requires a
lot of human efforts. In this paper, we introduce Genetic Prompt Search (GPS)
to improve few-shot learning with prompts, which utilizes a genetic algorithm
to automatically search for high-performing prompts. GPS is gradient-free and
requires no update of model parameters but only a small validation set.
Experiments on diverse datasets proved the effectiveness of GPS, which
outperforms manual prompts by a large margin of 2.6 points. Our method is also
better than other parameter-efficient tuning methods such as prompt tuning.

本文介绍了使用遗传算法自动搜索高性能提示信息的 Genetic Prompt Search（GPS）来改善少样本学习的性能，该方法不需要模型参数更新，只需要一个小型验证集。实验结果表明，GPS 比手动提示信息的性能高出 2.6 个百分点，并且比其他参数高效调整方法更好。