The trend towards increasingly deep neural networks has been driven by a
general observation that increasing depth increases the performance of a
network. Recently, however, evidence has been amassing that simply increasing
depth may not be the best way to increase performance, particu