A Big Data Deep Reinforcement Learning Approach to Next Generation Green Wireless Networks

Recent advances in networking, caching and computing technologies can have great impacts on the developments of green heterogeneous wireless networks, where different sizes of cells co-exist. Nevertheless, these important enabling technologies have traditionally been studied separately in the existing works on wireless networks. In this paper, we propose an integrated framework that can enable dynamic orchestration of networking, caching and computing resources to improve the performance of green heterogeneous wireless networks. We use an energy-efficient caching strategy based on storing maximum-distance separable (MDS) encoded packets. The resource allocation strategy in this framework is formulated as a joint optimization problem. The decision on how to allocate the dynamic resources is very complicated when considering networking, caching and computing. Therefore, we propose a novel deep reinforcement learning approach, which can effectively handle systems with large complexity. In addition, we use Google TensorFlow to implement deep reinforcement learning. Simulation results with different system parameters are presented to show the effectiveness of the proposed scheme.