Simple and accurate SEP approximation of hexagonal‐QAM in AWGN channel and its application in parametric , , fading, and log‐normal shadowing

In this study, the authors propose a simple yet tighter approximations for the special two‐dimensional Gaussian Q functions using the Trapezoidal rule of numerical integration. This enables a simplified and accurate symbol error probability (SEP) approximation of the hexagonal‐quadrature amplitude modulation (HQAM) in additive white Gaussian noise channel. The proposed approximation further simplifies the SEP calculation of HQAM in parametric , , and fading distributions. Also, the SEP of HQAM over log‐normal shadowing is calculated in this study. The accuracy of the analytical framework is verified using computer simulations.