Evaluates a new framework for benchmarking optimisation methods, suggesting enhanced analysis capabilities.
We present OptimSolution, an open-source, cross-platform framework for the systematic benchmarking and analysis of continuous optimisation methods, available for Windows, Linux and macOS and operable via both a command-line interface (CLI) and a Qt-based Graphical User Interface (GUI). The framework supports four execution modes: Single mode for single method–problem runs with convergence and distribution analysis; Batch mode for automated multi-method, multi-problem experimentation with aggregated statistical summaries; Method Sensitivity Analysis for quantifying the effect of algorithmic hyperparameters on solution quality; and Problem Sensitivity Analysis for assessing how problem-defining parameters influence instance difficulty and inter-method rankings. Complexity analysis is provided along two-axes method scalability across problem dimensionalities and problem difficulty profiles across method portfolios. Statistical validation is embedded natively through Wilcoxon signed-rank and Friedman tests with post-hoc pairwise analysis, complemented by rank tables and box-plot visualisations. All outputs are exportable as CSV files or publication-ready PNG figures. The framework is designed for extensibility: new methods and benchmark problems can be registered and activated through the GUI without modifications to the core codebase, supporting rapid experimental iteration.
No takes yet. Share an insight, caveat, or question.
Charilogis et al. (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: