In this paper, the two-dimensional DOA estimation problem of coherent signals in an electromagnetic vector sensor (EMVS) array is studied. A new decorrelation method is proposed by extending the multiple-Toeplitz matrices reconstruction (MTOEP) method to a polarization sensitive array. After that, a closed-form solution is derived based on the ESPRIT algorithm for DOA and polarization parameter estimation. Pairing matching is based on the correspondence between eigenvectors obtained by independent eigen-decomposition. Simulation results verify the effectiveness of the proposed work and show the proposed algorithm has better performance than the traditional spatial smoothing (SS) method, especially in scenarios with low signal-to-noise ratios (SNRs) and small angular separations.
Zhang et al. (2026) studied this question.