This paper investigates the complexities of integrating Large Language Models
(LLMs) into software products, with a focus on the challenges encountered for
determining their readiness for release. Our systematic review of grey
literature identifies common challenges in deploying LLMs, ranging from
pre-training and fine-tuning to user experience considerations. The study
introduces a comprehensive checklist designed to guide practitioners in
evaluating key release readiness aspects such as performance, monitoring, and
deployment strategies, aiming to enhance the reliability and effectiveness of
LLM-based applications in real-world settings.

本研究探讨将大型语言模型集成到软件产品中的复杂性，重点关注确定其发布准备工作中遇到的挑战。我们系统性地审查了灰色文献，确定了在部署大型语言模型方面的常见挑战，从预训练和微调到用户体验的考虑。该研究介绍了一份全面的检查清单，旨在指导从业人员评估关键的发布准备方面，如性能、监控和部署策略，以提高大型语言模型应用于现实世界环境中的可靠性和效果。