A Nonvolatile Al-Edge Processor with 4MB SLC-MLC Hybrid-Mode ReRAM Compute-in-Memory Macro and 51.4-251TOPS/W

Low-power Al edge devices should provide short-latency (Tₖ₊-ₑ₏) and low-energy (Eₖ₊-ₑ₏) wakeup responses from power-off mode to handle event-triggered computing tasks with high inference accuracy (IA), which requires high-capacity nonvolatile memory (NVM) to store high-precision weight data in power-off and high bit-precision multiply and accumulate (MAC) operations with high energy efficiency. SRAM computing-in-memory (CIM) and digital processors suffer large Eₖ₊-ₑ₏ and long Tₖ₊-ₑ₏ due to the movement of weight data from off-chip NVM to the on-chip buffer and processing unit after wakeup. Thus, on-chip nonvolatile CIM (nvCIM) is preferred for Al-edge processors by combining NVM storage and computing tasks on the same macro. Among nvCIM structures, in-memory compute (IMC) 1 provides short computing latency and high energy efficiency, but suffers from low computing yield. Near-memory compute (NMC) 2–4 provides high computing yield, but suffers long computing latency and low energy efficiency.