Design, execution, and contextual factors shaping the benefits and drawbacks of focus groups in software engineering

• Focus group benefits and drawbacks are shaped by design and context in SE • Participant preparation and group configuration are key factors for FG outcomes • Cross-case analysis of four FG studies in academic and industrial SE contexts • Moderator impartiality and observational coverage influence methodological outcomes • FG is effective for exploratory SE research when deliberate design choices are made CONTEXT. Focus Group (FG) is a qualitative technique that collects data through moderated group discussion. Although widely used in fields where human behavior is central, their use in Software Engineering (SE) is comparatively less common. In SE, FG applications often need to accommodate technical domains, participants with specialized expertise, and research goals that differ from those typically addressed in traditional social science settings. OBJECTIVE. This study analyzes four FG experiences conducted to investigate distinct SE technologies and topics. The objective is to examine how design decisions, execution strategies, and contextual conditions support or hinder the identification of the benefits and drawbacks of using FGs in SE research. METHOD. We performed a reflective cross-case methodological analysis of four FGs conducted in both academic and industrial settings. The studies differed in goals, group configurations, participant expertise, and moderation strategies. Data sources included session transcripts, written artifacts, moderator observations, and participant feedback. RESULTS. The results indicate that data quality depended on participants’ prior knowledge, the moderator's impartiality, the execution context, and the use of multimodal data capture. Depth and generalizability were limited by time constraints, uneven engagement, and the diverse qualitative data that hindered comparison. CONCLUSIONS. FG is an effective complementary method in SE research, particularly for exploratory analysis and for understanding practitioner perspectives on SE technologies. However, its effectiveness depends on deliberate design choices, including participant selection and preparation, group configuration, and systematic documentation.