Answers are grounded in this paper and cite their sources.
NVIDIA A100 Tensor Core GPU is NVIDIA's latest flagship GPU. It has been designed with many new innovative features to provide performance and capabilities for HPC, AI, and data analytics workloads. Feature enhancements include a Third-Generation Tensor Core, new asynchronous data movement and programming model, enhanced L2 cache, HBM2 DRAM, and third-generation NVIDIA NVLink I/O.
No takes yet. Share an insight, caveat, or question.
Choquette et al. (2021) studied this question.
Synapse has enriched 5 related papers. Consider them for comparative context: