SK Hynix–TetraMem Memristor Edge AI SoC Reaches 21.3 TOPS/W on 65nm Process
SK Hynix, TetraMem, and researchers from USC have jointly demonstrated a memristor-based in-memory computing (IMC) system-on-chip (SoC) optimized for edge AI inference. Fabricated on a 65-nanometer process and featuring 10 neural processing units (NPUs) with analog vector-matrix multiplication directly inside crossbar arrays, the chip delivers peak energy efficiency of 21.3 TOPS/W at 100 MHz—exceeding NVIDIA A100 INT8 efficiency by an order of magnitude on legacy process geometry. The design includes a custom depthwise-convolution (DWC) optimized NPU with zig-zag crossbar topology to accelerate lightweight models like MobileNetV1 with minimal power overhead.
Tested on the Visual Wake Words benchmark using a customized MobileNetV1Small network (36,000 parameters), the SoC achieved 80.36% end-to-end accuracy using low-precision (roughly 4-bit effective) quantized weights, demonstrating memristor feasibility for quantized inference. However, proof-of-concept limits loom: theoretical peak throughput (2.54 TOPS full-chip) falls 16x short of Microsoft Copilot+ requirements, and the test used only 5 of 10 standard NPUs, leaving total multi-NPU saturation unvalidated.
For practitioners: memristor-based IMC trades speed for extreme power efficiency on old nodes, suitable for always-on edge sensors and mobile talkback—not cloud inference. The 65nm fab story signals a strategy shift away from advanced node density toward analog-in-silicon performance per milliwatt. Watch whether SK's manufacturing depth (memristor integration on CMOS) enables volume production; if so, edge AI acceleration beyond GPU/NPU SLAs becomes viable for IoT and remote monitoring.
Sources
- Primary source
- tomshardware.com
“SK hynix, TetraMem, and researchers from the University of Southern California have developed a memristor-based in-memory computing (IMC) system-on-chip (SoC) for AI edge devices.”
- tomshardware.com
“The SoC delivers a peak throughput of 0.254 TOPS per NPU and reaches an energy efficiency of 21.3 TOPS/W at 100 MHz and 11.9 TOPS/W at 400 MHz.”
- tomshardware.com
“The device is designed to accelerate neural network inference in lightweight AI models while consuming a fraction of the power that higher-end GPUs or NPUs would.”
- tomshardware.com
“its performance would peak at around 2.54 TOPS in a theoretical best-case scenario, which is 16X below Microsoft's Copilot+ requirements.”