Impact of facial tattoos and paintings on face recognition systems

Abstract In recent years, face recognition technologies have shown impressive recognition performance, mainly due to recent developments in deep convolutional neural networks. Notwithstanding those improvements, several challenges which affect the performance of face recognition systems remain. The...

Full description

Saved in:
Bibliographic Details
Main Authors: Mathias Ibsen, Christian Rathgeb, Thomas Fink, Pawel Drozdowski, Christoph Busch
Format: Article
Language:English
Published: Wiley 2021-11-01
Series:IET Biometrics
Subjects:
Online Access:https://doi.org/10.1049/bme2.12032
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832559621250744320
author Mathias Ibsen
Christian Rathgeb
Thomas Fink
Pawel Drozdowski
Christoph Busch
author_facet Mathias Ibsen
Christian Rathgeb
Thomas Fink
Pawel Drozdowski
Christoph Busch
author_sort Mathias Ibsen
collection DOAJ
description Abstract In recent years, face recognition technologies have shown impressive recognition performance, mainly due to recent developments in deep convolutional neural networks. Notwithstanding those improvements, several challenges which affect the performance of face recognition systems remain. The authors investigate the impact that facial tattoos and paintings have on current face recognition systems. To this end, they first collected an appropriate database containing image‐pairs of individuals with and without facial tattoos or paintings. The assembled database was used to evaluate how facial tattoos and paintings affect the detection, quality estimation, as well as the feature extraction and comparison modules of a face recognition system. The impact on these modules was evaluated using state‐of‐the‐art open‐source and commercial systems. The obtained results show that facial tattoos and paintings affect all the tested modules, especially for images where a large area of the face is covered with tattoos or paintings. The authors’ work is an initial case study and indicates a need to design algorithms which are robust to the visual changes caused by facial tattoos and paintings.
format Article
id doaj-art-56cefad58d704b2c933c597905a15ed8
institution Kabale University
issn 2047-4938
2047-4946
language English
publishDate 2021-11-01
publisher Wiley
record_format Article
series IET Biometrics
spelling doaj-art-56cefad58d704b2c933c597905a15ed82025-02-03T01:29:37ZengWileyIET Biometrics2047-49382047-49462021-11-0110670671910.1049/bme2.12032Impact of facial tattoos and paintings on face recognition systemsMathias Ibsen0Christian Rathgeb1Thomas Fink2Pawel Drozdowski3Christoph Busch4Department of Computer Science Biometrics and Internet Security Research Group Hochschule Darmstadt Darmstadt GermanyDepartment of Computer Science Biometrics and Internet Security Research Group Hochschule Darmstadt Darmstadt GermanyDepartment of Computer Science Biometrics and Internet Security Research Group Hochschule Darmstadt Darmstadt GermanyDepartment of Computer Science Biometrics and Internet Security Research Group Hochschule Darmstadt Darmstadt GermanyDepartment of Computer Science Biometrics and Internet Security Research Group Hochschule Darmstadt Darmstadt GermanyAbstract In recent years, face recognition technologies have shown impressive recognition performance, mainly due to recent developments in deep convolutional neural networks. Notwithstanding those improvements, several challenges which affect the performance of face recognition systems remain. The authors investigate the impact that facial tattoos and paintings have on current face recognition systems. To this end, they first collected an appropriate database containing image‐pairs of individuals with and without facial tattoos or paintings. The assembled database was used to evaluate how facial tattoos and paintings affect the detection, quality estimation, as well as the feature extraction and comparison modules of a face recognition system. The impact on these modules was evaluated using state‐of‐the‐art open‐source and commercial systems. The obtained results show that facial tattoos and paintings affect all the tested modules, especially for images where a large area of the face is covered with tattoos or paintings. The authors’ work is an initial case study and indicates a need to design algorithms which are robust to the visual changes caused by facial tattoos and paintings.https://doi.org/10.1049/bme2.12032feature extractionimage classificationface recognitionconvolutional neural netsdeep learning (artificial intelligence)art
spellingShingle Mathias Ibsen
Christian Rathgeb
Thomas Fink
Pawel Drozdowski
Christoph Busch
Impact of facial tattoos and paintings on face recognition systems
IET Biometrics
feature extraction
image classification
face recognition
convolutional neural nets
deep learning (artificial intelligence)
art
title Impact of facial tattoos and paintings on face recognition systems
title_full Impact of facial tattoos and paintings on face recognition systems
title_fullStr Impact of facial tattoos and paintings on face recognition systems
title_full_unstemmed Impact of facial tattoos and paintings on face recognition systems
title_short Impact of facial tattoos and paintings on face recognition systems
title_sort impact of facial tattoos and paintings on face recognition systems
topic feature extraction
image classification
face recognition
convolutional neural nets
deep learning (artificial intelligence)
art
url https://doi.org/10.1049/bme2.12032
work_keys_str_mv AT mathiasibsen impactoffacialtattoosandpaintingsonfacerecognitionsystems
AT christianrathgeb impactoffacialtattoosandpaintingsonfacerecognitionsystems
AT thomasfink impactoffacialtattoosandpaintingsonfacerecognitionsystems
AT paweldrozdowski impactoffacialtattoosandpaintingsonfacerecognitionsystems
AT christophbusch impactoffacialtattoosandpaintingsonfacerecognitionsystems