TY - JOUR
T1 - Effect of Program Error in Memristive Neural Network With Weight Quantization
AU - Kim, Tae Hyeon
AU - Kim, Sungjoon
AU - Hong, Kyungho
AU - Park, Jinwoo
AU - Youn, Sangwook
AU - Lee, Jong Ho
AU - Park, Byung Gook
AU - Kim, Hyungjin
N1 - Publisher Copyright:
© 1963-2012 IEEE.
PY - 2022/6/1
Y1 - 2022/6/1
N2 - Recently, various memory devices have been actively studied as suitable candidates for synaptic devices, which are important memory and computing units in neuromorphic systems. One of the ways to manage these devices is off-chip training, where it is essential to transfer the pretrained weights accurately. Previous studies, however, have a few limitations, such as a lack of consideration of program errors that occur during the transfer process. Although the smaller the program error, the higher the accuracy, the corresponding increase in the program time must be considered. To evaluate the practical applicability, we fabricated Al2O3/TiOx-based resistive random access memory (RRAM) and investigated the effect of program errors on program time and system degradation. It was confirmed that for smaller program errors, the program time was exponentially longer. Furthermore, we examined the effect of variation with respect to the number of quantized weight states ( ${N}_{state}$ ) through system-level simulation. We observed that the optimized ${N}_{state}$ varies depending on whether the program error is small or large. This result is meaningful as it experimentally shows the tradeoff between the program error, program time, and system performance. We expect it to be useful in the development of neuromorphic systems.
AB - Recently, various memory devices have been actively studied as suitable candidates for synaptic devices, which are important memory and computing units in neuromorphic systems. One of the ways to manage these devices is off-chip training, where it is essential to transfer the pretrained weights accurately. Previous studies, however, have a few limitations, such as a lack of consideration of program errors that occur during the transfer process. Although the smaller the program error, the higher the accuracy, the corresponding increase in the program time must be considered. To evaluate the practical applicability, we fabricated Al2O3/TiOx-based resistive random access memory (RRAM) and investigated the effect of program errors on program time and system degradation. It was confirmed that for smaller program errors, the program time was exponentially longer. Furthermore, we examined the effect of variation with respect to the number of quantized weight states ( ${N}_{state}$ ) through system-level simulation. We observed that the optimized ${N}_{state}$ varies depending on whether the program error is small or large. This result is meaningful as it experimentally shows the tradeoff between the program error, program time, and system performance. We expect it to be useful in the development of neuromorphic systems.
KW - Neuromorphic computing
KW - off-chip training
KW - program error
KW - program time
KW - quantization aware training (QAT)
KW - resistive random access memory (RRAM)
KW - synaptic device
KW - variation
KW - weight quantization
KW - weight transfer
UR - http://www.scopus.com/inward/record.url?scp=85129644510&partnerID=8YFLogxK
U2 - 10.1109/TED.2022.3169112
DO - 10.1109/TED.2022.3169112
M3 - Article
AN - SCOPUS:85129644510
SN - 0018-9383
VL - 69
SP - 3151
EP - 3157
JO - IEEE Transactions on Electron Devices
JF - IEEE Transactions on Electron Devices
IS - 6
ER -