Collaborative optimization method of imaging consistency for near-eye display with dual focal planes and spatial multiplexing

The vergence-accommodation conflict (VAC) constitutes a core bottleneck limiting the immersion and comfort of near-eye displays. Although spatially multiplexed dual focal plane display technology offers a viable path to mitigate VAC, its development is constrained by image quality mismatch between the two focal planes caused by differences in virtual image distance, as well as harmful system parallax generated during binocular extension. This paper proposes an innovative co-design optimization framework for imaging consistency to systematically address these challenges. The framework first establishes a generalized virtual image normalization model based on data-driven affine transformations, accurately characterizing the complex mapping relationship between the two focal planes. Subsequently, it constructs comparison metrics centered on consistency in distortion (direction and magnitude) and field curvature shape. Finally, through a closed-loop optimization process incorporating a dynamic weight feedback adjustment mechanism, perceptual consistency objectives are directly embedded into the optical design. To verify the generality and effectiveness of the framework, it was successfully applied to two significantly different optical systems: a compact monocular augmented reality (AR) system based on freeform prisms and a large aperture biocular virtual reality (VR) system based on a Birdbath structure. Optimization results demonstrate that the framework not only significantly improves the distortion and field curvature consistency of the dual focal plane system but also suppresses harmful parallax in the biocular system below the fusional vergence amplitude from an optical design perspective. This work provides a rigorous, systematic, and scalable design methodology for spatially multiplexed multifocal near-eye displays, holding significant theoretical and engineering value for advancing the development of high-visual-comfort near-eye display devices.