HSFL: Efficient and Privacy-Preserving Offloading for Split and Federated Learning in IoT Services

Distributed machine learning methods like Federated Learning (FL) and Split Learning (SL) meet the growing demands of processing large-scale datasets under privacy restrictions. Recently, FL and SL are combined in hybrid SLFL (SFL) frameworks to exploit both methods’ advantages to facilitate ubiquitous intelligence in the Internet of Things (IoT), for example, smart finance. Despite its significant impact on the performance and costs of SFL, model decomposition that splits an ML model into the client-server pair has not been sufficiently studied, especially for SFL in a large-scale dynamic IoT environment. In this paper, we propose a new SFL framework HSFL with a lightweight model decomposition method to offload a part of model training to the edge server. Specifically, we develop a method for estimating the training latency of HSFL and designed a metric for measuring privacy leakage in HSFL, based on which we formulate model decomposition in HSFL as an optimization problem with privacy protection as a constraint. Then, we transform the formulated problem into a contextual bandit problem and design an efficient algorithm to solve it. We have conducted thorough evaluations of the proposed HSFL framework through extensive experiments on a prototype testbed and a simulation platform. The experimental results validate the superiority of HSFL over the state-of-the-art benchmarks in terms of training latency, efficiency, scalability, and privacy protection.