Jokes or Gibberish? Humor Retention in Translation with Neural Machine Translation vs. Large Language Model

Humor translation remains a significant challenge due to its reliance on wordplay, cultural context, and nuance. This study compares a Neural Machine Translation (NMT) system (hereafter referred to as MT) with a Large Language Model (GPT-based translation using three different prompts) for translating jokes from English to Thai. Results show that GPT-based models significantly outperform MT in humor retention, with the explanation-enhanced prompt (GPT-Ex) achieving the highest joke preservation rate (62.94%) compared to 50.12% in MT. Additionally, humor loss was more frequent in MT, while GPT-based models, particularly GPT-Ex, better retained jokes. A McNemar test confirmed significant differences in annotation distributions across models. Beyond evaluation, we propose using GPT-based models with optimized prompt engineering to enhance humor translation. Our refined prompts improved joke retention by guiding the model’s understanding of humor and cultural nuances.