This paper presents a selective review of statistical computation methods for
massive data analysis. A huge amount of statistical methods for massive data
computation have been rapidly developed in the past decades. In this work, we
focus on three categories of statistical computation methods: (1) distributed
computing, (2) subsampling methods, and (3) minibatch gradient techniques. The
first class of literature is about distributed computing and focuses on the
situation, where the dataset size is too huge to be comfortably handled by one
single computer. In this case, a distributed computation system with multiple
computers has to be utilized. The second class of literature is about
subsampling methods and concerns about the situation, where the sample size of
dataset is small enough to be placed on one single computer but too large to be
easily processed by its memory as a whole. The last class of literature studies
those minibatch gradient related optimization techniques, which have been
extensively used for optimizing various deep learning models.

该论文选择性地回顾了大数据分析的统计计算方法。该文重点研究了三类统计计算方法：(1) 分布式计算，(2) 子采样方法，以及 (3) 小批量梯度技术。