BD-UCD-Based Nonlinear Hybrid Precoding for Millimeter Wave Massive Multiuser MIMO Systems

In this letter, we investigate the downlink hybrid precoding design for time-division duplexing (TDD) millimeter wave (mmWave) massive multiuser MIMO (MU-MIMO) systems, aiming to enhance both the sum spectral efficiency (SSE) and the bit error rate (BER) performance. First, we propose a joint analog precoding and combining design via Gram-Schmidt orthogonalization to maximize the beamforming gain while mitigating the inter-user interference. Then, by exploiting the uplink-downlink duality, we propose a block diagonal uniform channel decomposition (BD-UCD) based digital precoding and combining scheme to further improve the SSE and BER performance. Furthermore, Tomlinson-Harashima precoding (THP) is utilized to eliminate both the inter-user interference and the inter-stream interference. Simulation results demonstrate that the proposed BD-UCD-based nonlinear hybrid precoding scheme performs close to the fully-digital BD-UCD scheme and outperforms the other existing hybrid precoding schemes in terms of SSE and BER performance.