Key points are not available for this paper at this time.
Generative AI has captured the imagination of users across multiple industries, and we've only begun to tap the potential of this amazing technology. GenAI applications can synthesize text, computer code, protein sequences, images, video, rendered 3D graphics, music, with more generation types being constantly added. The combination of the immense and growing compute demands and real-time requirements of many GenAI-based applications requires that computers be designed at data center scale. This talk will cover the breadth of technology innovations – spanning circuits to software to the entire datacenter – needed to enable today's latest supercomputers for GenAI, and discuss NVIDIA's experiences applying GenAI in our business.
Jonah Alben (2024) studied this question.