BriefGPT.xyz
Dec, 2017
TensorFlow-Serving:灵活、高性能的机器学习服务
TensorFlow-Serving: Flexible, High-Performance ML Serving
HTML
PDF
Christopher Olston, Noah Fiedel, Kiril Gorovoy, Jeremiah Harmsen, Li Lao...
TL;DR
TensorFlow-Serving是一个可用于Google内部和云端的机器学习模型服务系统,支持多种ML平台,优化模型查找和推理性能,用于多租户模型托管服务TFS^2等生产环境。
Abstract
We describe
tensorflow-serving
, a system to serve
machine learning models
inside Google which is also available in the cloud and via open-source. It is extremely flexible in terms of the types of
→