Answers are grounded in this paper and cite their sources.
This article demonstrates improved energy efficiency and speed in deep learning by implementing novel input sparsity-aware computing techniques.
Input sparsity‐aware multiply‐accumulate computing is a promising solutionto reduce redundant operations and improve energy efficiency in deep neural network accelerators. However, analog computing‐in‐memory (CIM) architectures encounter challenges in exploiting sparsity due to the fixed resolution of analog‐to‐digital converters (ADCs), resulting in unnecessary latency and power consumption. This article presents an input sparsity‐aware CIM macro with novel bidirectional conversion‐skippable ADCs (BCS‐ADCs), which enables both input block‐ and element‐level conversion skipping. The proposed BCS‐ADC can skip conversion not only on the most significant bit side of multiply‐accumulate values based on input element‐level sparsity but also on the least significant bit side (equivalent to rounding down). Block‐level skipping is implemented using a population counter in the input activation driver. When designed in 45 nm CMOS at 100 MHz, the proposed CIM macro achieves up to 1.95 speedup and 2.44 energy efficiency compared to a nonskipping baseline. Compared to state‐of‐the‐art ADCs, the BCS‐ADC reduces power by up to 90.82 and improves conversion latency and energy efficiency by 14.82 and 21.02, respectively. The BCS‐ADC is designed based on the conventional successive approximation ADC with a few additional logic elements that occupy only 0.28 of the ADC area.
No takes yet. Share an insight, caveat, or question.
Song et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: