Byzantine-Robust Aggregation in Federated Learning Empowered Industrial IoT

Federated learning (FL) is a promising paradigm to empower on-device intelligence in Industrial Internet of Things (IIoT) due to its capability of training machine learning models across multiple IIoT devices while preserving the privacy of their local data. However, the distributed architecture of FL relies on aggregating the parameter list from the remote devices, which poses potential security risks caused by malicious devices. In this article, we propose a flexible and robust aggregation rule, called auto-weighted geometric median (
AutoGM
), and analyze the robustness against outliers in the inputs. To obtain the value of
AutoGM
, we design an algorithm based on the alternating optimization strategy. Using
AutoGM
as aggregation rule, we propose two robust FL solutions
AutoGM_FL
and
AutoGM_PFL
.
AutoGM_FL
learns a shared global model using the standard FL paradigm, and
AutoGM_PFL
learns a personalized model for each device. We conduct extensive experiments on the FEMNIST and Bosch IIoT datasets. The experimental results show that our solutions are robust against both model poisoning and data poisoning attacks. In particular, our solutions sustain high performance even when 30% of the nodes perform model or 50% of the nodes perform data poisoning attacks.