We propose a unified coded framework for distributed computing with
straggling servers, by introducing a tradeoff between "latency of computation"
and "load of communication" for some linear computation tasks. We show that the
coded scheme of [1]-[3] that repeats the intermediate computations to create
coded multicasting opportunities to reduce communication load, and the coded
scheme of [4], [5] that generates redundant intermediate computations to combat
against straggling servers can be viewed as special instances of the proposed
framework, by considering two extremes of this tradeoff: minimizing either the
load of communication or the latency of computation individually. Furthermore,
the latency-load tradeoff achieved by the proposed coded framework allows to
systematically operate at any point on that tradeoff to perform distributed
computing tasks. We also prove an information-theoretic lower bound on the
latency-load tradeoff, which is shown to be within a constant multiplicative
gap from the achieved tradeoff at the two end points.

本文介绍了一种针对分布式计算的编码框架，通过在某些线性计算任务中引入 “计算延迟” 和 “通信负载” 之间的权衡来解决延迟和通信负载问题，从而实现在延迟和负载之间取得权衡来执行分布式计算任务。