Slice-Aware and Computationally Efficient Resource Orchestration for Converged mmWave–PON O-RAN: A Reward-Shaped PPO Approach for Joint DBA and PRB Allocation

Converging millimetre-wave (mmWave) radio access with passive optical network (PON) fronthaul under the Open RAN (O-RAN) architecture promises unprecedented capacity for beyond-5G and 6G systems. Yet today, dynamic bandwidth allocation (DBA) in the PON and physical resource block (PRB) scheduling in the mmWave RAN operate independently, a critical design flaw that causes severe latency accumulation, resource fragmentation, and consistent failure to meet the divergent quality-of-service requirements of network slices. This paper breaks that deadlock by introducing the first slice-aware, computationally efficient orchestration framework that jointly optimises DBA and PRB allocation in a converged mmWave-PON O-RAN. We formulate the problem as a constrained Markov decision process (CMDP) with explicit latency, reliability, and throughput constraints for URLLC, eMBB, and mMTC slices. The core technical advance is a reward-shaped proximal policy optimisation (RS-PPO) algorithm whose potential-based shaping function directly penalises DBA–PRB misalignment and dense feedback on queue build-up, accelerating learning without compromising optimality. To make this work in near-real time on the O-RAN RIC, we embed three complementary efficiency engines: graph convolutional network (GCN) state abstraction, action masking, and prioritised N-step replay. Extensive 3GPP-compliant simulations show that RS-PPO slashes URLLC end-to-end latency by 37% (from 1.38 ms to 0.87 ms), boosts PRB utilisation by 28% (from 68% to 87%), and delivers 99.999% reliability, all while converging 45% faster and cutting inference time by 45% (to just 2.3 ms). The result is a sub-5 ms control cycle, compatible with O-RAN specifications and deployable as an xApp on the near-RT RIC. Our framework closes a long-standing coordination gap left unresolved by prior art, enabling true slice-aware convergence between the optical and wireless domains.