Masked Face Emotion Recognition Based on Facial Landmarks and Deep Learning Approaches for Visually Impaired Peopleopen access
- Authors
- Mukhiddinov, Mukhriddin; Djuraev, Oybek; AKHMEDOV FARKHOD ABDUVALI UGLI; NURALIEVICH, MUKHAMADIYEV ABDINABI; Cho, Jinsoo
- Issue Date
- Feb-2023
- Publisher
- MDPI
- Keywords
- emotion recognition; facial landmarks; computer vision; deep learning; convolutional neural network; facial expression recognition; visually impaired people
- Citation
- SENSORS, v.23, no.3
- Journal Title
- SENSORS
- Volume
- 23
- Number
- 3
- URI
- https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/87102
- DOI
- 10.3390/s23031080
- ISSN
- 1424-8220
1424-3210
- Abstract
- Current artificial intelligence systems for determining a person's emotions rely heavily on lip and mouth movement and other facial features such as eyebrows, eyes, and the forehead. Furthermore, low-light images are typically classified incorrectly because of the dark region around the eyes and eyebrows. In this work, we propose a facial emotion recognition method for masked facial images using low-light image enhancement and feature analysis of the upper features of the face with a convolutional neural network. The proposed approach employs the AffectNet image dataset, which includes eight types of facial expressions and 420,299 images. Initially, the facial input image's lower parts are covered behind a synthetic mask. Boundary and regional representation methods are used to indicate the head and upper features of the face. Secondly, we effectively adopt a facial landmark detection method-based feature extraction strategy using the partially covered masked face's features. Finally, the features, the coordinates of the landmarks that have been identified, and the histograms of the oriented gradients are then incorporated into the classification procedure using a convolutional neural network. An experimental evaluation shows that the proposed method surpasses others by achieving an accuracy of 69.3% on the AffectNet dataset.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - IT융합대학 > 컴퓨터공학과 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/87102)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.