Analysis and experimental demonstration of orthant-symmetric four-dimensional 7 bit/4D-sym modulation for optical fiber communication

We propose a new four-dimensional orthant-symmetric 128-ary modulation format (4D-OS128) with a spectral efficiency of 7 bit/4D-sym. The proposed format fills the gap between polarization-multiplexed 8-ary and 16-ary quadrature-amplitude modulation (PM-8QAM and PM-16QAM). Numerical simulations show that 4D-OS128 outperforms state-of-the-art geometrically-shaped modulation formats by up to 0.65 dB for bit-interleaved coded modulation at the same spectral efficiency. These gains are experimentally demonstrated in a 11$\times$233 Gbit/s wavelength division multiplexing (WDM) transmission system operating at 5.95 bit/4D-sym over 6000 km and 9000 km for both EDFA-only and hybrid amplification scenarios, respectively. A reach increase of 15% is achieved with respect to 128-ary set-partitioning 16QAM