SCOF: Security-Aware Computation Offloading Using Federated Reinforcement Learning in Industrial Internet of Things With Edge Computing

Industry 5.0 facilitates the intelligent upgrade of smart factories in Industrial Internet of Things (IIoT), and also introduces a plethora of data processing challenges. Mobile edge computing offloads data to edge servers for processing, easing the data processing pressure and reducing system cost. However, smart factories contain numerous sensitive information, and offloading them to edge servers directly may pose a risk of data leakage. To address these challenges, we investigate a localedge collaborative smart factory system. Specifically, we firstly model the tasks as a directed acyclic graph, and formulate the offloading problem as a Markov decision process, considering the optimization of latency, energy consumption and the number of overtime tasks. Then, we propose a security-aware computation offloading method using federated reinforcement learning in IIoT, named SCOF. SCOF employs federated learning, keeping data for local computation and uploading model parameters to edge servers for aggregation. The data transmission passes through an artificial noise channel to protect against eavesdropping. Meanwhile, SCOF utilizes differential privacy to protect data security and employs deep reinforcement learning for selecting near-optimal offloading decisions. Finally, abundant experiments are conducted under a real dataset. The results show that SCOF has better perfomance than the state-of-the-art baseline algorithms.