Biologically inspired convolutional neural architectures for enhanced Chinese–English neural machine translation

Neural machine translation (NMT) has achieved remarkable progress by drawing inspiration from the information-processing principles of biological neural systems. In this work, we develop a convolutional-enhanced NMT model that replaces recurrent encoders with multi-layer one-dimensional CNNs, thereby more effectively capturing long-distance dependencies and hierarchical feature abstractions–akin to how the visual cortex hierarchically processes spatial patterns. We systematically explore two convolutional kernel shapes (2 × 1 and 3 × 1) across 3, 6, 10, and 12 layers, and evaluate on the high-quality LDC Chinese–English corpus (1.25 M training sentences) with the NIST02–08 test sets. Our best configuration–a 6-layer network with 3 × 1 kernels–yields an average BLEU score of 35.558, representing a +0.99 improvement over the recurrent-baseline. Analysis reveals that 6–10 layers strike the optimal balance between expressive power and over-parameterization, while kernel shape influences the model’s sensitivity to local versus broader context.