Answers are grounded in this paper and cite their sources.
Deep neural networks (DNNs) have emerged as the prevalent approach for implementing learning tasks in many application domains. As DNN models become increasingly complex, the large amount of data generated during network computations exerts substantial pressure on the capacity and bandwidth of the memory subsystem. Consequently, memory hierarchy is quickly becoming a major bottleneck for DNN performance scaling.
No takes yet. Share an insight, caveat, or question.
Chishti et al. (2019) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: