Gesture Recognition Method Based on Sim-ConvNeXt Model

Yupeng Huo, Jie Shen, Li Wang, Yuxuan Wu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Gesture recognition has become an important subject for researchers dealing with the problem of human-computer interaction, with computer vision enabling significant advancements in this field. Existing gesture recognition methods based on vision typically rely on traditional pure convolutional neural networks. However, these models face challenges in terms of low feature extraction efficiency and poor representation ability when encountering complex backgrounds, leading to complex parameter optimization. To address this issue, we propose an improved ConvNeXt algorithm, which is called as Sim-ConvNeXt network. SimAM (A Simple, Parameter-Free Attention Module for Convolutional Neural Networks) was introduced to address the issue of complex gesture recognition environments and unbalanced feature coupling between gestures. Additionally, the optimal fusion mode of SimAM was analyzed to resolve the problem of feature information loss between channels after the Depthwise Convolution module in the ConvNeXt model. Finally, the experiment on the HaGRID dataset showed that our model improved the identification accuracy effectively with a very small increase in the number of parameters, and achieved better performance compared with other models.

Original languageEnglish
Title of host publicationImage and Graphics - 12th International Conference, ICIG 2023, Proceedings
EditorsHuchuan Lu, Risheng Liu, Wanli Ouyang, Hui Huang, Jiwen Lu, Jing Dong, Min Xu
PublisherSpringer Science and Business Media Deutschland GmbH
Pages401-412
Number of pages12
ISBN (Print)9783031463075
DOIs
StatePublished - 2023
Event12th International Conference on Image and Graphics, ICIG 2023 - Nanjing, China
Duration: 22 Sep 202324 Sep 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14356 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference12th International Conference on Image and Graphics, ICIG 2023
Country/TerritoryChina
CityNanjing
Period22/09/2324/09/23

Keywords

  • Convolutional
  • Feature Extraction
  • Gesture Recognition
  • Neural Network
  • Sim

Fingerprint

Dive into the research topics of 'Gesture Recognition Method Based on Sim-ConvNeXt Model'. Together they form a unique fingerprint.

Cite this