Automated machine learning (AutoML) is a collection of techniques designed to
automate the machine learning development process. While traditional AutoML
approaches have been successfully applied in several critical steps of model
development (e.g. hyperparameter optimization), there lacks a AutoML system
that automates the entire end-to-end model production workflow. To fill this
blank, we present AutoMMLab, a general-purpose LLM-empowered AutoML system that
follows user's language instructions to automate the whole model production
workflow for computer vision tasks. The proposed AutoMMLab system effectively
employs LLMs as the bridge to connect AutoML and OpenMMLab community,
empowering non-expert individuals to easily build task-specific models via a
user-friendly language interface. Specifically, we propose RU-LLaMA to
understand users' request and schedule the whole pipeline, and propose a novel
LLM-based hyperparameter optimizer called HPO-LLaMA to effectively search for
the optimal hyperparameters. Experiments show that our AutoMMLab system is
versatile and covers a wide range of mainstream tasks, including
classification, detection, segmentation and keypoint estimation. We further
develop a new benchmark, called LAMP, for studying key components in the
end-to-end prompt-based model training pipeline. Code, model, and data will be
released.

AutoMMLab 是一个通用的、基于 LLM（语言模型）驱动的 AutoML 系统，通过用户友好的语言界面，自动化计算机视觉任务的整个模型生产流程，并利用 LLM 作为桥梁连接 AutoML 和 OpenMMLab 社区，使非专家个体能够轻松构建特定任务的模型。