Korean sign language recognition based on image and convolution neural network

Hyojoo Shin, Woo Je Kim, Kyoung Ae Jang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

20 Scopus citations

Abstract

The purpose of this paper is to develop a convolution neural network based model for Korean sign language recognition. For this purpose, sign language videos were collected for 10 selected words of Korean sign language and these videos were converted into images to have 9 frames. The images with 9 frames were used as input data for the convolution neural network based model developed in this study. In order to develop the model for Korean sign language recognition, experiments for determining the number of convolution layers was first performed. Second, experiments for the pooling which intentionally reduces the features of the feature map was performed. Third, we conducted an experiment to reduce over fitting in the model learning process. Based on the experiments, we have developed a convolution neural network based model for Korean sign language recognition. The accuracy of the developed model was about 84.5% for the 10 selected Korean sign words.

Original languageEnglish
Title of host publicationACM International Conference Proceeding Series
PublisherAssociation for Computing Machinery
Pages52-55
Number of pages4
ISBN (Print)9781450360920
DOIs
StatePublished - 2019
Event2nd International Conference on Image and Graphics Processing, ICIGP 2019 - Singapore, Singapore
Duration: 23 Feb 201925 Feb 2019

Publication series

NameACM International Conference Proceeding Series
VolumePart F147765

Conference

Conference2nd International Conference on Image and Graphics Processing, ICIGP 2019
Country/TerritorySingapore
CitySingapore
Period23/02/1925/02/19

Keywords

  • Convolution Neural Network
  • Image
  • Korean Sign Language
  • Recognition

Fingerprint

Dive into the research topics of 'Korean sign language recognition based on image and convolution neural network'. Together they form a unique fingerprint.

Cite this