Applying Deep learning techniques - masked facial recognition in smartphone security systems using transfer learning

No Thumbnail Available
Desai, Adarsh
Issue Date
MSc in Data Analytics
Dublin Business School
Items in eSource are protected by copyright. Previously published items are made available in accordance with the copyright policy of the publisher/copyright holder.
Face recognition is the most reliable security measure in smartphones. Face masks make face detection more challenging. In most countries the wearing of facial masks is mandatory on public transport and in public areas to prevent the spread of Covid-19. In smartphone security, facial detection and authorization is a recent measure implemented along with fingerprints, passwords, and pins. This research aims to identify the person while the face is covered with a facial mask with only eyes and forehead being exposed. Four transfer learning object detection models namely YOLOv3, YOLOv4, YOLOv3 tiny, and YOLOv4 tiny have been implemented in identifying the masked and unmasked faces. The YOLO V3 object detection model is the best performing model with a detection time of 0.015 seconds, F1 score of 0.85 and mAP score of 0.88. Further, fast, and accurate masked face detection suitable for deployment on a smartphone hardware architecture is demonstrated on a webcam.