Hand Recognition and Gesture Control Using a Wi-Fi Application in Smart Toye’s

Pallavi R. Chahare; M. N. Thakare; G. D. Korde

doi:10.31149/ijot.v3i6.1980

Pallavi R. Chahare Department of Electronics & Telecommunication Engineering Bapurao Deshmukh College of Engineering, Sevagram Wardha – 442 102 (M.S.)
M. N. Thakare BDCOE, Sevagram Asso. Prof. & Head of Department of Electronics & Telecommunication Engg.
G. D. Korde Department of Electronics & Telecommunication Engg, India

DOI: https://doi.org/10.31149/ijot.v3i6.1980

Keywords: Hand detection, Gesture recognition, Deep Learning, Python, OpenCV

Abstract

Hand gesture recognition is one of the systems that can detect the gesture of hand in a real time video. The gesture of hand is classified within a certain area of interest. In this, designing of the hand gesture recognition is one of the complicated jobs that involves two major problems. Firstly, is the detection of hand. Another problem is to create the sign that is suitable to be used for one hand in a time. This project concentrates on how a system could detect, recognize and interpret the hand gesture recognition through computer vision with the challenging factors which variability in pose, orientation, location and scale. To perform well for developing this project, different types of gestures such as numbers and sign languages need to be created in this system. The image taken from the real-time video is analyzed via Haar-cascaded Classifier to detect the gesture of hand before the image processing is done or in the other word to detect the appearance of hand in a frame. In this project, the detection of hand will be done using the theories of Region of Interest (ROI) via Python programming. The explanation of the results will be focused on the simulation part since the different for the hardware implementation is the source code to read the real-time input video. The developing of hand gesture recognition using Python and OpenCV can be implemented by applying the theories of hand segmentation and the hand detection system which use the Haar-cascade classifier.

References

Tomas Bravenec, Tomas Fryza. Department of Radio Electronics Brno University of Technology Brno, Czech Republic, “Multiplatform System for Hand Gesture Recognition(IEEE 2019)”.

Nithin Kumar B1, Akshay Chalwadi2, Ananthraj Upadhye3 ,Dhanraj4 Department Of Computer Science And Engineering , Visveswaraya Technological University SDM College Of Engineering And Technology, Dharwad, India, “ facial and hand gesture based media player”,International Journal of Scientific & Engineering Research

Volume 10, Issue 3, March-2019.

Dinesh Kumar Vishwakarma1, Varun Grover 2 Department of Electronics and Communication Engineering Delhi Technological University Delhi, India, “ Hand Gesture Recognition in Low-Intensity Environment Using Depth Images”, (IEEE 2017).

J. Francis and A. B K, "Significance of Hand Gesture Recognition Systems in Vehicular Automation-A Survey",International Journal of Computer Applications, vol. 99, no.7, pp. 50-55, 2014.

Mitra and T. Acharya, "Gesture Recognition: A Survey",IEEE Trans. Syst., Man, Cybern.C, vol. 37, no. 3, pp. 311-324, 2007.

S.Ghotkar and G. K. Kharate, " Hand Segmentation Techniques to Hand Gesture Recognition for Natural Human Computer Interaction", International Journal of Human Computer Interaction, vol. 3, no. 1, pp. 15-25,2012.

MARIA ABASTILLAS DR. ANDRE L. C. BARCZAK DR. NAPOLEON H.REYES Maria Abastillas, “Real-Time Hand Gesture Detection and Recognition Using Simple Heuristic Rules” 17 June 2011.

S. Pancholi and A. M. Joshi, ”Portable EMG Data Acquisition Module for Upper Limb Prosthesis Application,” in IEEE Sensors Journal, vol.18, no. 8, pp. 3436-3443, 15 April 15, 2018.

Bhattacharya, A. Sarkar, and P. Basak, ”Time-domain multi-feature extraction and classification of human hand movements using surface EMG,” 2017 4th International Conference on Advanced Computing and Communication Systems (ICACCS), Coimbatore, pp. 1-5, 2017.

Sushmita Mitra, Senior Member, IEEE, and Tinku Acharya, Senior Member, “Gesture Recognition: A Survey” IEEE 2007.

Sajjad Ur Rahman*, Zeenat Afroze**, Mohammed Tareq*,”Hand Gesture Recognition Techniques For Human Computer Interaction Using OpenCv”, Dept. Of EEE, American International University-Bangladesh (AIUB), Banani, Dhake-1213. International Journal of Scientific and Research Publications, Volume 4, Issue 12, December 2014.

“OpenCV-Python Tutorials Documentation” by Alexander Mordvintsev & Abid K.

“Enhanced Look Based Media Player With Hand Gesture Recognition” by Harshada Naroliya,Tanvi Desai, Shreeya Acharya, Varsha Sakpal.

Viola and Jones, "Rapid object detection using a boosted cascade of simple features", Computer Vision and Pattern Recognition, 2001.

Siddharth Swarup Rautaray,Indian Institute of Information Technology,Allahabad,Anupam

Agrawal, “A Vision based Hand Gesture Interface for Controlling VLC Media Player”,Indian Institute of Information Technology,Allahabad International Journal of Scientific & Engineering Research Volume 10, Issue 3, March-2019.

Amal Kumar Das, Vijaya Laxmi, Sanjeev Kumar, “Hand Gesture Recognition and Classification Technique in Real-Time ” , International Conference on Vision Towards Emerging Trends in Communication and Networking, 2019.

Tong Zhang,Huifeng Lin, Zhaojie Ju & Chenguang Yang “ Hand Gesture Recognition in Complex Background Based on Convolutional Pose Machine and Fuzzy Gaussian Mixture Models ”, International (2020).