Jones Seminar: Scale up Your In-Memory Computing—A Heterogenous Paradigm

Optional ZOOM LINK
Meeting ID: 933 9058 7164
Passcode: 210715

Contemporary microprocessor design is facing tremendous challenges in memory bandwidth and power consumption. In-memory computing (IMC) helps relieve some issues, achieving massively parallel computing with high storage density. On the other hand, its scaling trend is still lagging behind the ever-increasing demand of AI algorithms and high-definition sensors. More disruptive innovations, such as heterogeneous integration, will be critical to scaling up the system and speeding up the computation.

In this talk, we will first review the fundamental limitations of current IMC system: device variations, peripheral circuits, and interconnection. They interact with each other, limiting the accuracy, scalability, and energy efficiency of the system. Then we will present heterogeneous solutions crossing device/circuit/architecture, based on statistical data from a fully integrated 65nm CMOS/RRAM test chip. At the circuit level, we design a hybrid RRAM/SRAM macro to fully recover the accuracy loss, employing sparse training on silicon; at the architecture level, we propose big-little IMC chiplets to maximize the utilization and minimize energy consumption.

To efficiently explore the design space, we further develop a new benchmark simulator, SIAM, for the heterogenous IMC system, which models device/circuit/architecture, network-on-chip (NoC), network-on-package (NoP) and DRAM access to address the challenges in 2.5D/3D integration. We will conclude this talk with brainstorming on the potential and research need of such a design paradigm shift.

About the Speaker(s)

Yu Cao
Professor of Electrical Engineering, Arizona State

Yu Cao received his BS in physics from Peking University, and his MA in biophysics and PhD in electrical engineering from University of California, Berkeley.

He is now professor of electrical engineering at Arizona State University in Tempe. Cao has published numerous articles and two books on nano-CMOS modeling and physical design. His research interests include neural-inspired computing, hardware design for on-chip learning, and reliable integration of nanoelectronics.

Cao is a fellow of the IEEE, and a distinguished lecturer of the IEEE Circuits and Systems Society. He is a recipient of the 2020 Intel Outstanding Researcher Award, 2009 ACM SIGDA Outstanding New Faculty Award, 2006 NSF CAREER Award, 2006 and 2007 IBM Faculty Award, and five best paper awards.

Contact

For more information, contact Amos Johnson at amos.l.johnson@dartmouth.edu.