Exploring Technology Probe applications in software engineering practice

Background: The development of software systems relies on user feedback, which can be captured with Validation Sessions (VS); however, VS are often conducted in an ad hoc manner. Technology Probe (TP) offers a participatory design method for capturing user perception; however, its application in software engineering lacks structure. Aim: This study consolidates evidence on TP applications in software engineering and identifies practices that support the systematic use of TP. Methods: A Literature Study, inspired by Rapid Reviews, was conducted in Scopus using backward and forward snowballing, screening 530 studies and selecting 53 primary works across the trials that support the results. Thematic analysis was employed to extract motivations, outcomes, and challenges associated with the use of TP in software engineering. Results: Through thematic analysis and open coding, 11 evidence-based characteristics were identified describing the use of TP in software engineering. These characteristics formed the foundation of an evidence-based checklist developed to assess and guide the development of TP techniques. Conclusion: It was found that TP has been applied across a variety of domains, with diverse techniques being crafted. Therefore, the checklist developed in this research aims to assist future researchers in crafting their techniques and supporting their decisions.