Agreement-Constrained Efficient Probabilistic Minimum Bayes Risk Decoding with Knowledge Distillation Metrics

Key Points

• The aim is to improve translation quality while reducing computation costs in probabilistic minimum Bayes risk decoding.
• Introduced agreement-constrained PMBR decoding to enhance score matrix completion using knowledge distillation.
• Evaluated the performance in the WMT’23 English-German translation task.
• Compared the computational cost and translation quality to traditional probabilistic MBR decoding.
• Achieved up to three times improvement in approximation error in matrix completion.
• Maintained translation quality comparable to PMBR while matching its computational cost.