A Novel DOA Estimation Approach for Unknown Coherent Source Groups with Coherent Signals

In this paper, a new combination of Minimum Description Length (MDL) or Eigenvalue Gradient Method (EGM), Joint Approximate Diagonalization of Eigenmatrices (JADE) and Modified Forward-Backward Linear Prediction (MFBLP) algorithms is proposed which determines the number of non-coherent source groups and estimates the Direction Of Arrivals (DOAs) of coherent signals in each group. First, the MDL/EGM algorithm determines the number of non-coherent signal groups, and then the JADE algorithm estimates the generalized steering vectors considering white/colored Gaussian noise. Finally, the MFBLP algorithm is applied to estimate DOAs of coherent signals in each group. A new Normalized Root Mean Square Error (NRMSE) is also proposed that introduces a more realistic metric to compare the performance of DOA estimation methods. Simulation results show that the proposed algorithm can resolve sources regardless of QAM modulation size. In addition, simulations in white/colored Gaussian noises show that the proposed algorithm outperforms the JADE-MUSIC algorithm in a wide range of Signal to Noise Ratios (SNRs)