• A prioritization dataset for ranking ML tasks in Spanish is proposed. • Three criteria that can be obtained automatically are evaluated. • An automatic multi-criteria prioritization process is proposed. • A controlled experiment using requirements based on GIS and SPL domain is conducted. • LambdaMART is effective for generating an initial top-k ranked list of requirements. Requirements prioritization is a complex process for determining the implementation order of requirements based on business value, cost, time, and other factors. Despite the growing use of AI to automate prioritization, full automation remains limited because common criteria, such as stakeholder ranking, cost, and dependencies, still require human input. To mitigate this, we focus on criteria that can be obtained automatically. We identified three such criteria: (1) Functional/Non-Functional (F/NF) classification, based on requirement purpose using pre-trained models; (2) MoSCoW categorization, which uses linguistic patterns and keywords to assess necessity; and (3) a Mandatory criterion derived from the similarity requirements process. In this study, we investigate the prioritization of requirements written in Spanish using automated criteria and automating the process with the LambdaMART algorithm. Additionally, we introduce PrioReSpa, a dataset of 401 requirements collected from a GIS project based on a software product line, each labeled with an importance score and the three prioritization criteria. Our findings demonstrate the effectiveness of using automated criteria for requirements prioritization. Results show that F/NF classification is the most influential criterion, followed by MoSCoW, while the Mandatory criterion had no impact. We trained LambdaMART models using XGBRanker and LGBMRanker implementations, performing hyperparameter optimization with Optuna. Both rankers obtained comparable NDCG performance, with LightGBM slightly outperforming in ranking metrics and XGBoost providing faster training. These findings demonstrate the viability of using LambdaMART algorithm to generate initial ranked lists of requirements, particularly for the top 10–20 priorities, reducing stakeholder involvement in early stages.
Limaylla-Lunarejo et al. (Thu,) studied this question.