End-to-End Deep Learning of Joint Geometric Probabilistic Shaping Using a Channel-Sensitive Autoencoder

In this paper, we propose an innovative channel-sensitive autoencoder (CSAE)-aided end-to-end deep learning (E2EDL) technique for joint geometric probabilistic shaping. The pretrained conditional generative adversarial network (CGAN) is introduced in the CSAE which performs differentiable substitution of the optical fiber channel model under variable input optical power (IOP) levels. This enables the CSAE-aided E2EDL to design optimal joint geometric probabilistic shaping schemes for optical fiber communication systems at varying IOPs. The results of the proposed CSAE-aided E2EDL technique show that for a dual-polarization 64-Gbaud signal with a transmission distance of 5 × 80 km, when the modulation format is a 64-quadrature amplitude modulation (QAM) or a 128-QAM, the maximum generalized mutual information (GMI) level learned via CSAE-aided E2EDL is 5.9826 or 6.8384 bits/symbol under varying IOPs, respectively. In addition, the pretrained CGAN, as a substitution for optical fiber transmission model, accurately characterizes the distortion of signals with different IOPs, with an average bit error ratio (BER) difference of only 1.83%, an average mean square error (MSE) of 0.0041 and an average K-L divergence of 0.0046. In summary, this paper delivers new insights into the application of E2EDL and demonstrates the feasibility of joint geometric probabilistic shaping-based E2EDL for fiber optic communication systems with varying IOPs.