Title |
Accelerating Inference of Convolutional Neural Networks Using In-memory Computing
|
---|---|
Published in |
Frontiers in Computational Neuroscience, August 2021
|
DOI | 10.3389/fncom.2021.674154 |
Pubmed ID | |
Authors |
Martino Dazzi, Abu Sebastian, Luca Benini, Evangelos Eleftheriou |
Abstract |
In-memory computing (IMC) is a non-von Neumann paradigm that has recently established itself as a promising approach for energy-efficient, high throughput hardware for deep learning applications. One prominent application of IMC is that of performing matrix-vector multiplication in O ( 1 ) time complexity by mapping the synaptic weights of a neural-network layer to the devices of an IMC core. However, because of the significantly different pattern of execution compared to previous computational paradigms, IMC requires a rethinking of the architectural design choices made when designing deep-learning hardware. In this work, we focus on application-specific, IMC hardware for inference of Convolution Neural Networks (CNNs), and provide methodologies for implementing the various architectural components of the IMC core. Specifically, we present methods for mapping synaptic weights and activations on the memory structures and give evidence of the various trade-offs therein, such as the one between on-chip memory requirements and execution latency. Lastly, we show how to employ these methods to implement a pipelined dataflow that offers throughput and latency beyond state-of-the-art for image classification tasks. |
X Demographics
As of 1 July 2024, you may notice a temporary increase in the numbers of X profiles with Unknown location. Click here to learn more.
Geographical breakdown
Country | Count | As % |
---|---|---|
Serbia | 1 | 9% |
Pakistan | 1 | 9% |
United Kingdom | 1 | 9% |
Unknown | 8 | 73% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Members of the public | 8 | 73% |
Scientists | 2 | 18% |
Science communicators (journalists, bloggers, editors) | 1 | 9% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
Unknown | 22 | 100% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Student > Ph. D. Student | 4 | 18% |
Researcher | 3 | 14% |
Student > Bachelor | 1 | 5% |
Lecturer | 1 | 5% |
Student > Doctoral Student | 1 | 5% |
Other | 1 | 5% |
Unknown | 11 | 50% |
Readers by discipline | Count | As % |
---|---|---|
Engineering | 4 | 18% |
Biochemistry, Genetics and Molecular Biology | 1 | 5% |
Chemical Engineering | 1 | 5% |
Materials Science | 1 | 5% |
Computer Science | 1 | 5% |
Other | 0 | 0% |
Unknown | 14 | 64% |