Overhead-optimization of pilot-based digital signal processing for flexible high spectral efficiency transmission

We present a low-complexity fully pilot-based digital signal processing (DSP) chain designed for high spectral efficiency optical transmission systems. We study the performance of the individual pilot algorithms in simulations before demonstrating transmission of a 51 724 Gbaud PM-64QAM superchannel over distances reaching 1000 km. We present an overhead optimization technique using the system achievable information rate to find the optimal balance between increased performance and throughput reduction from adding additional DSP pilots. Using the optimal overhead of 2.4%, we report 9.3 (8.3) bits/s/Hz spectral efficiency, or equivalently 11.9 (10.6) Tb/s superchannel throughput, after 480 (960) km of transmission over 80 km spans with EDFA-only amplification. Moreover, we show that the optimum overhead depends only weakly on transmission distance, concluding that back-to-back optimization is sufficient for all studied distances. Our results show that pilot-based DSP combined with overhead optimization can increase the robustness and performance of systems using advanced modulation formats while still maintaining state-of-the-art spectral efficiency and multi-Tb/s throughput