What is the role of product managers (PMs) in the responsible use of generative AI (genAI) in products and everyday work— and what enables or constrains their ability to take action? Past literature has examined the ways in which organizational policies can become decoupled from practices when incentives for responsible action are misaligned or impeded by profit motives. While the role of engineers and professional ethicists in the context of AI has been examined in detail, the role of product managers—who are frequently portrayed as “gatekeepers” or critical decision-makers in product teams—remains unclear, particularly regarding genAI. In this paper, we examine what organizational conditions promote responsible use of genAI by product managers by drawing on twenty-five interviews and a global survey of over three hundred respondents in product management-related roles. First, we find that uncertainty around responsible AI and a sense of diffused responsibility constrain ethical action, while leadership commitment and organizational principles enable ethical action—making some responsible practices up to fourteen times more likely. Further, our study finds two sets of actions product managers take to “recouple” ethical commitments and practices. The first set includes low-resource, individual actions product managers can implement without explicit organizational incentives (e.g., individual or team-wide reviews and safeguarding standards around data privacy). The second set includes high-resource, collective actions that require organizational incentives (e.g., conducting audits or delaying shipment of products). In contrast to existing findings in the literature, product managers view themselves as “guardrails” rather than “gatekeepers” when it comes to making ethics-related decisions for genAI use. Our research suggests that recoupling ethical policies and practices at the level of product teams requires institutional buy-in and higher level leadership commitment. Nevertheless, we show that individual actors are able to exhibit agency through some meaningful, low resource actions, even in the absence of organizational incentive structures even in the absence of organizational incentives, though this alone is insufficient to operationalize responsible AI at scale.
Smith et al. (Tue,) studied this question.