We consider an asynchronous decentralized learning system, which consists of
a network of connected devices trying to learn a machine learning model without
any centralized parameter server. The users in the network have their own local
training data, which is used for learning across