Ray Tracing Simulators for 5G New Radio Systems: Comparative Analysis Through Urban Measurements at 27 GHz

The use of millimeter-wave spectrum in fifth-generation (5G) systems is increasing the need for accurate prediction of received power and coverage in real deployment scenarios. In this context, ray tracing (RT) is a promising approach for site-specific analysis, although its reliability depends on how accurately different tools reproduce measurements in complex urban environments. This work presents a comparative assessment at 27 GHz of three RT tools: in-house Exact tool based on Vertical Plane Launching (VPL), Matlab 5G and open-source Sionna RT based on Shooting and Bouncing Rays (SBR). The comparison relies on a large outdoor walk-test campaign, including about 14,725 measurement points collected in a real urban area around a 27 GHz mMIMO base station, using real operator-provided antenna radiation patterns. Measured and simulated power levels are compared using statistical metrics, including Mean Absolute Error (MAE), Root Mean Square Error (RMSE), and a planning-oriented coverage-rate metric. The results show a reasonable agreement between simulations and measurements, with RMSE and MAE values around 10–12 dB, highlighting tool-specific behaviors related to boundary effects, interaction modeling, and high-power overestimation. This work confirms that RT is a flexible support for 5G preliminary network design, reducing the need for extensive drive tests.