Privacy Preserving Federated Learning: A Novel Approach for Combining Differential Privacy and Homomorphic Encryption - Cnam - Conservatoire national des arts et métiers
Conference Papers Year : 2024

Privacy Preserving Federated Learning: A Novel Approach for Combining Differential Privacy and Homomorphic Encryption

Rezak Aziz
Soumya Banerjee
Samia Bouzefrane

Abstract

Ensuring the data security and privacy stands as a prominent concern in the landscape of machine learning. The conventional approach of centralizing training data raises privacy concerns. Federated learning addresses this by avoiding the need to transfer local data when training a global model, opting to share only local model updates. Despite this, the challenge of information leakage persists. Various attempts tried to tackle this issue, but existing solutions lead to a tradeoff between accuracy, privacy and computation time. This is an unevitable challenge. In this paper, we address that challenge by combining differential privacy and homomorphic encryption. This approach allow to add less noise to the data by shuffling to anonymize the data, not only at the client level but also at the parameter level. Hence, it improves the accuracy of the output models while offering strong privacy guarantees. Importantly, our method avoids complex homomorphic operation, thereby mitigating the computational overhead of HE. In this manner, the data remains protected from all participants in the learning process. Our findings demonstrate that, for an equivalent level of privacy, our method introduces less noise compared to the local DP method, resulting in increased accuracy after aggregation. However, the privacy amplification requires a substantial number of clients, which make our approach more suitable for cross-device Federated learning. © IFIP International Federation for Information Processing 2024.
No file

Dates and versions

hal-04642061 , version 1 (09-07-2024)

Identifiers

Cite

Rezak Aziz, Soumya Banerjee, Samia Bouzefrane. Privacy Preserving Federated Learning: A Novel Approach for Combining Differential Privacy and Homomorphic Encryption. 14th IFIP WG 11.2 International Conference on Information Security Theory and Practices, WISTP 2024, Feb 2024, Paris, France. pp.162-177, ⟨10.1007/978-3-031-60391-4_11⟩. ⟨hal-04642061⟩
17 View
0 Download

Altmetric

Share

More