Key points are not available for this paper at this time.
The complexity of smartphone applications presents challenges for developers, who must ensure flawless functionality despite limitations such as budget and time constraints. Manual testing is time-consuming, prompting a shift towards automated testing methods to ensure efficiency and reliability. In this context, researchers are evaluating the efficacy of three leading test automation frameworks—Robot Framework, Katalon Studio, and UI Path—against key performance parameters. Using the Distance to the Ideal Alternative (DIA) method on playstore apps. The main performance parameters used as a reference are automated testing progress and tools usability. Katalon Studio emerges as the top performer, securing the top rank with a remarkably close to the alternative ideal positive distance (Ri) value of 0.00001. UI Path occupies the second position with a Ri value of 0.00135, while Robot Framework trails behind with a Ri value of 0.00295. This research contributes to the understanding of the performance of different automation frameworks in the context of functional testing, providing valuable insights for developers and organizations seeking to optimize their testing processes. The findings underscore the significance of Katalon Studio's exceptional performance and highlight opportunities for improvement in UI Path and Robot Framework. Additionally, implementing a robust monitoring and evaluation framework is crucial for tracking the ongoing performance and optimizing the efficiency of these automation frameworks.
Riza et al. (Tue,) studied this question.