Cross-Spectral Cross-Distance Face Recognition via CNN with Image Augmentation Techniques

Facial recognition is a critical biometric identification method in modern security systems, yet it faces significant challenges under varying lighting conditions, particularly when dealing with near-infrared (NIR) images, which exhibit reduced illumination compared to visible light (VIS) images. Th...

Full description

Saved in:
Bibliographic Details
Main Authors: Nisa Adilla Rahmatika, Fitri Arnia, Maulisa Oktiana
Format: Article
Language:English
Published: Ikatan Ahli Informatika Indonesia 2024-10-01
Series:Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
Subjects:
Online Access:https://jurnal.iaii.or.id/index.php/RESTI/article/view/5929
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841544031429984256
author Nisa Adilla Rahmatika
Fitri Arnia
Maulisa Oktiana
author_facet Nisa Adilla Rahmatika
Fitri Arnia
Maulisa Oktiana
author_sort Nisa Adilla Rahmatika
collection DOAJ
description Facial recognition is a critical biometric identification method in modern security systems, yet it faces significant challenges under varying lighting conditions, particularly when dealing with near-infrared (NIR) images, which exhibit reduced illumination compared to visible light (VIS) images. This study aims to evaluate the performance of Convolutional Neural Networks (CNNs) in addressing the Cross-Spectral Cross-Distance (CSCD) challenge, which involves face identification across different spectra (NIR and VIS) and varying distances. Three CNN models—VGG16, ResNet50, and EfficientNetB0—were assessed using a dataset comprising 800 facial images from 100 individuals, captured at four different distances (1m, 60m, 100m, and 150m) and across two wavelengths (NIR and VIS). The Multi-task Cascaded Convolutional Networks (MTCNN) algorithm was employed for face detection, followed by image preprocessing steps including resizing to 224x224 pixels, normalization, and homomorphic filtering. Two distinct data augmentation strategies were applied: one utilizing 10 different augmentation techniques and the other with 4 techniques, trained with a batch size of 32 over 100 epochs. Among the tested models, VGG16 demonstrated superior performance, achieving 100% accuracy in both training and validation phases, with a training loss of 0.55 and a validation loss of 0.612. These findings underscore the robustness of VGG16 in effectively adapting to the CSCD setting and managing variations in both lighting and distance.
format Article
id doaj-art-04d1c1c5db774f4f81ac1ff4d4b084a5
institution Kabale University
issn 2580-0760
language English
publishDate 2024-10-01
publisher Ikatan Ahli Informatika Indonesia
record_format Article
series Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
spelling doaj-art-04d1c1c5db774f4f81ac1ff4d4b084a52025-01-13T03:31:56ZengIkatan Ahli Informatika IndonesiaJurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)2580-07602024-10-018566567310.29207/resti.v8i5.59295929Cross-Spectral Cross-Distance Face Recognition via CNN with Image Augmentation TechniquesNisa Adilla Rahmatika0Fitri Arnia1Maulisa Oktiana2Universitas Syiah KualaUniversitas Syiah KualaUniversitas Syiah KualaFacial recognition is a critical biometric identification method in modern security systems, yet it faces significant challenges under varying lighting conditions, particularly when dealing with near-infrared (NIR) images, which exhibit reduced illumination compared to visible light (VIS) images. This study aims to evaluate the performance of Convolutional Neural Networks (CNNs) in addressing the Cross-Spectral Cross-Distance (CSCD) challenge, which involves face identification across different spectra (NIR and VIS) and varying distances. Three CNN models—VGG16, ResNet50, and EfficientNetB0—were assessed using a dataset comprising 800 facial images from 100 individuals, captured at four different distances (1m, 60m, 100m, and 150m) and across two wavelengths (NIR and VIS). The Multi-task Cascaded Convolutional Networks (MTCNN) algorithm was employed for face detection, followed by image preprocessing steps including resizing to 224x224 pixels, normalization, and homomorphic filtering. Two distinct data augmentation strategies were applied: one utilizing 10 different augmentation techniques and the other with 4 techniques, trained with a batch size of 32 over 100 epochs. Among the tested models, VGG16 demonstrated superior performance, achieving 100% accuracy in both training and validation phases, with a training loss of 0.55 and a validation loss of 0.612. These findings underscore the robustness of VGG16 in effectively adapting to the CSCD setting and managing variations in both lighting and distance.https://jurnal.iaii.or.id/index.php/RESTI/article/view/5929cross spectralcnn architectureface recognitiondata augmentation techniquedeep learning
spellingShingle Nisa Adilla Rahmatika
Fitri Arnia
Maulisa Oktiana
Cross-Spectral Cross-Distance Face Recognition via CNN with Image Augmentation Techniques
Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
cross spectral
cnn architecture
face recognition
data augmentation technique
deep learning
title Cross-Spectral Cross-Distance Face Recognition via CNN with Image Augmentation Techniques
title_full Cross-Spectral Cross-Distance Face Recognition via CNN with Image Augmentation Techniques
title_fullStr Cross-Spectral Cross-Distance Face Recognition via CNN with Image Augmentation Techniques
title_full_unstemmed Cross-Spectral Cross-Distance Face Recognition via CNN with Image Augmentation Techniques
title_short Cross-Spectral Cross-Distance Face Recognition via CNN with Image Augmentation Techniques
title_sort cross spectral cross distance face recognition via cnn with image augmentation techniques
topic cross spectral
cnn architecture
face recognition
data augmentation technique
deep learning
url https://jurnal.iaii.or.id/index.php/RESTI/article/view/5929
work_keys_str_mv AT nisaadillarahmatika crossspectralcrossdistancefacerecognitionviacnnwithimageaugmentationtechniques
AT fitriarnia crossspectralcrossdistancefacerecognitionviacnnwithimageaugmentationtechniques
AT maulisaoktiana crossspectralcrossdistancefacerecognitionviacnnwithimageaugmentationtechniques