Deep Neural Networks (DNNs) are being adopted as components in software
systems. Creating and specializing DNNs from scratch has grown increasingly
difficult as state-of-the-art architectures grow more complex. Following the
path of traditional software engineering, machine learning engineers have begun
to reuse large-scale pre-trained models (PTMs) and fine-tune these models for
downstream tasks. Prior works have studied reuse practices for traditional
software packages to guide software engineers towards better package
maintenance and dependency management. We lack a similar foundation of
knowledge to guide behaviors in pre-trained model ecosystems.
In this work, we present the first empirical investigation of PTM reuse. We
interviewed 12 practitioners from the most popular PTM ecosystem, Hugging Face,
to learn the practices and challenges of PTM reuse. From this data, we model
the decision-making process for PTM reuse. Based on the identified practices,
we describe useful attributes for model reuse, including provenance,
reproducibility, and portability. Three challenges for PTM reuse are missing
attributes, discrepancies between claimed and actual performance, and model
risks. We substantiate these identified challenges with systematic measurements
in the Hugging Face ecosystem. Our work informs future directions on optimizing
deep learning ecosystems by automated measuring useful attributes and potential
attacks, and envision future research on infrastructure and standardization for
model registries.

本文是关于使用预训练模型的实践和挑战，通过对 Hugging Face 生态系统中从业者的访谈和系统化的测量，确定了模型重用的实践和决策制定过程，并提出了模型重用的有用属性和挑战，以及对深度学习生态系统自动化地测量有用属性和潜在攻击的未来方向进行了展望。