Reinforcement Learning-Based Policy for Haul-Truck Dispatch: A Framework for Earthmoving and Quarry Operations

Truck-to-excavator assignment is a time-critical control problem in open-pit earthmoving systems (mines, quarries, and large cut-and-fill construction sites) where stochastic travel and service times, changing queues, and equipment outages continually alter the best dispatch decision. A deep reinforcement learning (DRL) dispatch policy is developed and trained using a discrete-event simulation (DES) digital twin of the Sungun copper mine haulage system. The dispatch task is formulated as a Markov decision process using state features that represent fleet locations, excavator and dump queues, and short-term congestion conditions. The resulting deep artificial neural network (DANN) policy is tuned via systematic hyperparameter optimisation and evaluated against a priority-based rule-of-thumb dispatch baseline under long-horizon operating tracks. Results show that the final trained policy improves the average production rate per truck cycle by approximately 17% while reducing avoidable waiting and maintaining stable performance over extended operation, with inference fast enough for real-time dispatch use. Model fidelity is supported by close agreement between simulated and observed daily completed-cycle counts. Robustness is assessed through controlled truck load-capacity perturbations, and scalability is examined through fleet-size sensitivity, which reveals diminishing returns as additional trucks are added under a fixed excavation–haulage configuration. Practical deployment considerations and implications for construction earthmoving logistics are discussed.