October 16, 2025

The Potential of Large Language Models in Solving Optimization Problems: An Empirical Study

Key Points

The findings show that large language models can generate effective solutions for optimization problems, enhancing decision-making.
Performance evaluations across three problem categories indicate that prompting strategies significantly impact model effectiveness.
This observational analysis utilizes multiple large language models to assess their capabilities in generating mathematical formulations.
These insights may enable more effective integration of large language models within operations research practices.

Abstract

Abstract This work investigates the potential of Large Language Models (LLMs) in automating the formulation and solution of mathematical programming problems. Specifically, we evaluate the effectiveness of two distinct prompting strategies: One-Stage prompting, where LLMs directly generate solver code, and Two-Stage prompting, where the formulation of a mathematical model precedes its implementation. Our empirical study examines the performance of multiple LLMs, both open-source and proprietary, across three optimization problem categories: resource allocation, blending, and vehicle routing. For each problem, we assess the LLMs' capabilities to generate accurate mathematical formulations and executable Python code. The results provide actionable guidelines for selecting prompting strategies when deploying LLMs as decision-support co-pilots in operations research.

Mark Helpful

Bookmark

Relay