Deep neural networks are generally designed as a stack of differentiable
layers, in which a prediction is obtained only after running the full stack.
Recently, some contributions have proposed techniques to endow the networks
with early exits, allowing to obtain predictions at intermediate points of the
stack. These multi-output networks have a number of advantages, including: (i)
significant reductions of the inference time, (ii) reduced tendency to
overfitting and vanishing gradients, and (iii) capability of being distributed
over multi-tier computation platforms. In addition, they connect to the wider
themes of biological plausibility and layered cognitive reasoning. In this
paper, we provide a comprehensive introduction to this family of neural
networks, by describing in a unified fashion the way these architectures can be
designed, trained, and actually deployed in time-constrained scenarios. We also
describe in-depth their application scenarios in 5G and Fog computing
environments, as long as some of the open research questions connected to them.

本研究介绍了一种多输出深度神经网络，它具有提高推理速度、减少过拟合以及利用多层次计算平台的优势，并描述了在 5G 和雾计算环境中的应用场景以及相关的开放式研究问题。