RECOGNITION OF BASIC HAND GESTURES ON A HORIZONTAL SURFACE USING A SINGLE CAMERA

No Thumbnail Available

Date

2022

Journal Title

Journal ISSN

Volume Title

Publisher

2022 International Young Scholars' Conference

Abstract

Abstract The horizontal hand gesture recognition is an innovative, cheaper way for human-computer interaction. Currently, most researchers work with sensors, devices for hand gesture recognition, which require more resources. Instead, the presented horizontal method for hand gesture signal recognition by frames. A key element of this work is the research of a recognition algorithm using only single camera. In the presented framework, the hand detection works as a converting BGR image to RGB before processing. Then, the palm and fingers are segmented so as to detect and recognize the fingers. There are handedness and hand landmarks on the image as a result of a hand detection. Each point of landmark has coordination x, y, z values. There is comparing algorithm of points to recognize hand gesture by fingers. The model has been implemented getting landmark values on a data set of hand images, which collected from video frames. In the presented framework, the hand detection works with computer vision (CV) algorithms, in general MediaPipe as a converting blue, green, red (BGR) image to red, green, blue (RGB) before processing. There are handedness and hand landmarks on the image as a result of a hand detection. Each point of the landmark has coordination x, y, z values. The performance of the method highly depends on the result of hand detection on horizontal surface and collected dataset.

Description

Keywords

CV, ML, MediaPipe, hand gesture, BGR, human-computer interaction, 2022 International Young Scholars' Conference, №11

Citation

O. Sarybay / RECOGNITION OF BASIC HAND GESTURES ON A HORIZONTAL SURFACE USING A SINGLE CAMERA / 2022 International Young Scholars' Conference