We introduce and study the concept of a “jagged technology frontier” to describe the uneven impact of artificial intelligence (AI) capabilities, where AI assistance improves performance for some tasks but worsens it for others, even within the same knowledge workflow and with a seemingly similar level of difficulty. In collaboration with the global management consulting firm Boston Consulting Group, we have developed realistic management consulting tasks and examined the human performance implications of using AI to perform complex and knowledge-intensive work. The preregistered experiment involved 758 knowledge workers. After establishing a performance baseline on similar tasks, subjects were randomly assigned to one of three conditions: no AI access, GPT-4 AI access, or GPT-4 AI access with a prompt engineering overview. For each one of a set of 18 realistic knowledge tasks within the frontier of AI capabilities ranging from creative to analytical tasks, subjects using AI outperformed those not using AI, completing 12.2% more tasks and completing them 25.1% more quickly on average while also delivering solutions of significantly improved quality. However, for a complex managerial task selected to be outside the frontier, subjects using AI were 19% less likely to produce correct solutions compared with those without AI, pointing to potential limitations of AI supporting knowledge workers. We discuss the positive and negative implications of AI-aided human performance in knowledge-intensive tasks. Funding: Financial support of the Harvard Business School Digital Data Design Institute and Division of Research and Faculty Development is acknowledged. Supplemental Material: The online appendix is available at https://doi.org/10.1287/orsc.2025.21838 .
Building similarity graph...
Analyzing shared references across papers
Loading...
Fabrizio Dell’Acqua
Baim Institute for Clinical Research
Edward McFowland
Baim Institute for Clinical Research
Ethan Mollick
University of Pennsylvania
Organization Science
Massachusetts Institute of Technology
University of Pennsylvania
Boston Biomedical Research Institute
Building similarity graph...
Analyzing shared references across papers
Loading...
Dell’Acqua et al. (Wed,) studied this question.
synapsesocial.com/papers/69b4fc44b39f7826a300d0d8 — DOI: https://doi.org/10.1287/orsc.2025.21838
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: