BriefGPT.xyz
Jul, 2022
Celeritas: 面向大型数据流图的快速优化器
Celeritas: Fast Optimizer for Large Dataflow Graphs
HTML
PDF
Hengwei Xu, Yong Liao, Haiyong Xie, Pengyuan Zhou
TL;DR
Celeritas是一个快速的框架，通过一系列调度算法优化大型模型的设备配置，减少设备配置时间和提高运行效率。
Abstract
The rapidly enlarging
neural network models
are becoming increasingly challenging to run on a single device. Hence
model parallelism
over multiple devices is critical to guarantee the efficiency of training
→