dc.contributor.advisor | Werner, Stefan | |
dc.contributor.advisor | Rossi, Pierluigi Salvo | |
dc.contributor.author | Gauthier, François | |
dc.date.accessioned | 2024-03-18T13:13:25Z | |
dc.date.available | 2024-03-18T13:13:25Z | |
dc.date.issued | 2024 | |
dc.identifier.isbn | 978-82-326-7777-1 | |
dc.identifier.issn | 2703-8084 | |
dc.identifier.uri | https://hdl.handle.net/11250/3122917 | |
dc.description.abstract | This thesis investigates distributed machine learning for emerging Internet of Things (IoT) and Cyber-Physical Systems (CPS) applications. These applications involve large-scale data collection from distributed, often privately owned devices, which raises many logistical, moral, and legal issues if centralized processing is used. Therefore, this thesis explores how to take advantage of the local processing power of the devices and enable them to collaborate via inter-device communication to achieve a common learning goal without explicit disclosure of local data.
Federated learning is a framework for distributed machine learning that can address these issues. This thesis aims to develop and analyze new federated learning algorithms that overcome some of the practical challenges of distributed machine learning encountered in IoT and CPS settings. In particular, it tackles the following challenges.
• The scalability of the distributed machine learning architecture with respect to the increasing number of participating devices.
• The privacy preservation of the data owners from both external and internal adversaries.
• The robustness and efficiency of the distributed machine learning process under resource constraints and device failures.
• The personalization of the machine learning models for different devices and tasks within the same network.
The main contributions of this thesis are as follows. The first contribution of this thesis is to propose a peer-to-peer federated learning algorithm in which the par ticipating devices collaborate without the need for a coordinator while preserving their confidentiality. Secondly, we devise a robust online federated learning algorithm that can handle resource-constrained devices with sporadic participation and failures, as well as delays in a single-server architecture. Third, we develop a multi-server federated learning algorithm that supports personalized model training for device-specific tasks while preserving the data privacy of the participants. Finally, we advance peer-to-peer personalized federated learning with reinforcement learning techniques to enhance localized personalized learning. | en_US |
dc.language.iso | eng | en_US |
dc.publisher | NTNU | en_US |
dc.relation.ispartofseries | Doctoral theses at NTNU;2024:92 | |
dc.relation.haspart | Paper 1: Gauthier, Francois; Gratton, Cristiano; Dasanadoddi Venkategowda, Naveen Kumar; Werner, Stefan. Privacy-Preserving Distributed Learning with Nonsmooth Objective Functions. I: The Fifty-Fourth Asilomar Conference on Signals, Systems & Computers. IEEE conference proceedings 2021 https://doi.org/ 10.1109/IEEECONF51394.2020.9443287 | en_US |
dc.relation.haspart | Paper 2:
Gauthier, Francois; Gratton, Cristiano; Venkategowda,Naveen K.D.; Werner, Stefan.
Private Networked Federated Learning for Nonsmooth Objectives. arXiv:2306.14012 | en_US |
dc.relation.haspart | Paper 3: Gauthier, Francois; Gogineni, Vinay Chakravarthi; Werner, Stefan; Huang, Yih-Fang; Kuh, Anthony. Resource-Aware Asynchronous Online Federated Learning for Nonlinear Regression. I: ICC 2022 - IEEE International Conference on Communications. https://doi.org/10.1109/ICC45855.2022.9839079 | en_US |
dc.relation.haspart | Paper 4: Gauthier, Francois Jean Rene; Gogineni, Vinay Chakravarthi; Werner, Anders Stefan; Huang, Yih-Fang; Kuh, Anthony. Asynchronous online federated learning with reduced communication requirements. IEEE Internet of Things Journal 2023 ;Volum 10.(23) s. 20761-20775 https://doi.org/10.1109/JIOT.2023.3314923 | en_US |
dc.relation.haspart | Paper 5: Gauthier, Francois Jean Rene; Gogineni, Vinay Chakravarthi; Werner, Anders Stefan; Huang, Yih-Fang; Kuh, Anthony. Clustered Graph Federated Personalized Learning. I: 2022 56th Asilomar Conference on Signals, Systems, and Computers. IEEE conference proceedings 2022 https://doi.org/10.1109/IEEECONF56349.2022.10051979 | en_US |
dc.relation.haspart | Paper 6: Gauthier, Francois Jean Rene; Gogineni, Vinay Chakravarthi; Werner, Anders Stefan; Huang, Yih-Fang; Kuh, Anthony. Personalized Graph Federated Learning With Differential Privacy. IEEE Transactions on Signal and Information Processing over Networks 2023 ;Volum 9. s. 736-749 https://doi.org/ 10.1109/TSIPN.2023.3325963 | en_US |
dc.relation.haspart | Paper 7: Gauthier, Francois Jean Rene; Gogineni, Vinay Chakravarthi; Werner, Anders Stefan. Networked personalized federated learning using reinforcement learning. IEEE International Conference on Communications 2023 https://doi.org/10.1109/ICC45041.2023.10279781 | en_US |
dc.relation.haspart | Paper 8: Gogineni, Vinay Chakravarthi; Werner, Stefan; Gauthier, Francois; Huang, Yih-Fang; Kuh, Anthony. Personalized Online Federated Learning for IoT/CPS: Challenges and Future Directions. IEEE Internet of Things Magazine (IoTM) 2022 https://doi.org/10.1109/IOTM.001.2200178 | en_US |
dc.title | On Enabling Scalable, Personalized, and Private Federated Learning | en_US |
dc.type | Doctoral thesis | en_US |
dc.subject.nsi | VDP::Technology: 500::Electrotechnical disciplines: 540 | en_US |