Skip to main content
Article
One-Shot Federated Learning For LEO Constellations That Reduces Convergence Time From Days To 90 Minutes
Proceedings - IEEE International Conference on Mobile Data Management
  • Mohamed Elmahallawy
  • Tie (Tony) Tie Luo, Missouri University of Science and Technology
Abstract

A Low Earth orbit (LEO) satellite constellation consists of a large number of small satellites traveling in space with high mobility and collecting vast amounts of mobility data such as cloud movement for weather forecast, large herds of animals migrating across geo-regions, spreading of forest fires, and aircraft tracking. Machine learning can be utilized to analyze these mobility data to address global challenges, and Federated Learning (FL) is a promising approach because it eliminates the need for transmitting raw data and hence is both bandwidth and privacy friendly. However, FL requires many communication rounds between clients (satellites) and the parameter server (PS), leading to substantial delays of up to several days in LEO constellations. In this paper, we propose a novel one-shot FL approach for LEO satellites, called LEOShot, that needs only a single communication round to complete the entire learning process. LEOShot comprises three processes: (i) synthetic data generation, (ii) knowledge distillation, and (iii) virtual model retraining. We evaluate and benchmark LEOShot against the state of the art and the results show that it drastically expedites FL convergence by more than an order of magnitude. Also surprisingly, despite the one-shot nature, its model accuracy is on par with or even outperforms regular iterative FL schemes by a large margin.

Department(s)
Computer Science
Comments

National Science Foundation, Grant 2008878

Keywords and Phrases
  • ensemble model,
  • federated learning,
  • knowledge distillation,
  • low Earth orbit (LEO),
  • Satellite communications,
  • synthetic data generation,
  • teacher-student framework
Document Type
Article - Conference proceedings
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2023 Institute of Electrical and Electronics Engineers, All rights reserved.
Publication Date
1-1-2023
Publication Date
01 Jan 2023
Disciplines
Citation Information
Mohamed Elmahallawy and Tie (Tony) Tie Luo. "One-Shot Federated Learning For LEO Constellations That Reduces Convergence Time From Days To 90 Minutes" Proceedings - IEEE International Conference on Mobile Data Management (2023) p. 45 - 54 ISSN: 1551-6245
Available at: http://works.bepress.com/tony-luo/75/