AFMeta: Asynchronous Federated Meta-learning with Temporally Weighted Aggregation

Download paper here

Abstract: The ever-increasing concerns on data security and user privacy have significantly impacted the current centralized mechanism of intelligent systems in bridging private data islands and idle computing resources commonly dispersed at the edge. To resolve that, a novel distributed learning paradigm, called Federated Learning (FL), which can learn a global model in a collaborative and privacy-preserving manner, has been proposed and widely discussed. Furthermore, to tackle the data heterogeneity and model adaptation issues faced by FL, meta-learning starts to be applied together with FL to rapidly train a global model with high generalization. However, since federated meta-learning is still in its infancy to collaborate with participants in synchronous mode, straggler and over-fitting issues may impede its application in ubiquitous intelligence, such as smart health and intelligent transportation. Motivated by this, this paper proposes a novel asynchronous federated meta-learning mechanism, called AFMeta, that can measure the staleness of local models to enhance model aggregation. To the best of our knowledge, AFMeta is the first work studying the asynchronous mode in federated meta-learning. We evaluate AFMeta against state-of-the-art baselines on classification and regression tasks. The results show that it boosts the model performance by 44.23% and reduces the learning time by 86.35%.

Keywords: Federated Learning, Federated Meta-learning, Asynchronous Federated Meta-learning, Model Aggregation