Survey of convolutional neural network accelerators on field-programmable gate array platforms: architectures and optimization techniques

Hyeonseok Hong, Dahun Choi, Namjoon Kim, Haein Lee, Beomjin Kang, Huibeom Kang, Hyun Kim

Research output: Contribution to journalArticlepeer-review

17 Scopus citations

Abstract

With the recent advancements in high-performance computing, convolutional neural networks (CNNs) have achieved remarkable success in various vision tasks. However, along with improvements in model accuracy, the size and computational complexity of the models have significantly increased with the increasing number of parameters. Although graphics processing unit (GPU) platforms equipped with high-performance memory and specialized in parallel processing are commonly used for CNN processing, the significant power consumption presents challenges in their utilization on edge devices. To address these issues, research is underway to design CNN models using field-programmable gate arrays (FPGAs) as accelerators. FPGAs provide a high level of flexibility, allowing efficient optimization of convolution operations, which account for a significant portion of the CNN computations. Additionally, FPGAs are known for their low power consumption compared to GPUs, making them a promising energy-efficient platform. In this paper, we review and summarize various approaches and techniques related to the design of FPGA-based CNN accelerators. Specifically, to comprehensively study CNN accelerators, we investigate the advantages and disadvantages of various methods for optimizing CNN accelerators and previously designed efficient accelerator architectures. We expect this paper to serve as an important guideline for future hardware research in artificial intelligence.

Original languageEnglish
Article number64
JournalJournal of Real-Time Image Processing
Volume21
Issue number3
DOIs
StatePublished - May 2024

Keywords

  • Accelerator
  • Convolutional neural network
  • Data flow
  • Design optimization
  • Field-programmable gate array (FPGA)

Fingerprint

Dive into the research topics of 'Survey of convolutional neural network accelerators on field-programmable gate array platforms: architectures and optimization techniques'. Together they form a unique fingerprint.

Cite this