Neural Colour Correction for Indoor 3D Reconstruction Using RGB-D Data
With the rise in popularity of different human-centred applications using 3D reconstruction data, the problem of generating photo-realistic models has become an important task. In a multiview acquisition system, particularly for large indoor scenes, the acquisition conditions will differ along the e...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-06-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/24/13/4141 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850104026570424320 |
|---|---|
| author | Tiago Madeira Miguel Oliveira Paulo Dias |
| author_facet | Tiago Madeira Miguel Oliveira Paulo Dias |
| author_sort | Tiago Madeira |
| collection | DOAJ |
| description | With the rise in popularity of different human-centred applications using 3D reconstruction data, the problem of generating photo-realistic models has become an important task. In a multiview acquisition system, particularly for large indoor scenes, the acquisition conditions will differ along the environment, causing colour differences between captures and unappealing visual artefacts in the produced models. We propose a novel neural-based approach to colour correction for indoor 3D reconstruction. It is a lightweight and efficient approach that can be used to harmonize colour from sparse captures over complex indoor scenes. Our approach uses a fully connected deep neural network to learn an implicit representation of the colour in 3D space, while capturing camera-dependent effects. We then leverage this continuous function as reference data to estimate the required transformations to regenerate pixels in each capture. Experiments to evaluate the proposed method on several scenes of the MP3D dataset show that it outperforms other relevant state-of-the-art approaches. |
| format | Article |
| id | doaj-art-04ae4bc146a64954a7eb28a2eea20d3a |
| institution | DOAJ |
| issn | 1424-8220 |
| language | English |
| publishDate | 2024-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj-art-04ae4bc146a64954a7eb28a2eea20d3a2025-08-20T02:39:25ZengMDPI AGSensors1424-82202024-06-012413414110.3390/s24134141Neural Colour Correction for Indoor 3D Reconstruction Using RGB-D DataTiago Madeira0Miguel Oliveira1Paulo Dias2Institute of Electronics and Informatics Engineering of Aveiro (IEETA), Intelligent System Associate Laboratory (LASI), University of Aveiro, 3810-193 Aveiro, PortugalInstitute of Electronics and Informatics Engineering of Aveiro (IEETA), Intelligent System Associate Laboratory (LASI), University of Aveiro, 3810-193 Aveiro, PortugalInstitute of Electronics and Informatics Engineering of Aveiro (IEETA), Intelligent System Associate Laboratory (LASI), University of Aveiro, 3810-193 Aveiro, PortugalWith the rise in popularity of different human-centred applications using 3D reconstruction data, the problem of generating photo-realistic models has become an important task. In a multiview acquisition system, particularly for large indoor scenes, the acquisition conditions will differ along the environment, causing colour differences between captures and unappealing visual artefacts in the produced models. We propose a novel neural-based approach to colour correction for indoor 3D reconstruction. It is a lightweight and efficient approach that can be used to harmonize colour from sparse captures over complex indoor scenes. Our approach uses a fully connected deep neural network to learn an implicit representation of the colour in 3D space, while capturing camera-dependent effects. We then leverage this continuous function as reference data to estimate the required transformations to regenerate pixels in each capture. Experiments to evaluate the proposed method on several scenes of the MP3D dataset show that it outperforms other relevant state-of-the-art approaches.https://www.mdpi.com/1424-8220/24/13/4141neural networkcolour correction3D reconstruction |
| spellingShingle | Tiago Madeira Miguel Oliveira Paulo Dias Neural Colour Correction for Indoor 3D Reconstruction Using RGB-D Data Sensors neural network colour correction 3D reconstruction |
| title | Neural Colour Correction for Indoor 3D Reconstruction Using RGB-D Data |
| title_full | Neural Colour Correction for Indoor 3D Reconstruction Using RGB-D Data |
| title_fullStr | Neural Colour Correction for Indoor 3D Reconstruction Using RGB-D Data |
| title_full_unstemmed | Neural Colour Correction for Indoor 3D Reconstruction Using RGB-D Data |
| title_short | Neural Colour Correction for Indoor 3D Reconstruction Using RGB-D Data |
| title_sort | neural colour correction for indoor 3d reconstruction using rgb d data |
| topic | neural network colour correction 3D reconstruction |
| url | https://www.mdpi.com/1424-8220/24/13/4141 |
| work_keys_str_mv | AT tiagomadeira neuralcolourcorrectionforindoor3dreconstructionusingrgbddata AT migueloliveira neuralcolourcorrectionforindoor3dreconstructionusingrgbddata AT paulodias neuralcolourcorrectionforindoor3dreconstructionusingrgbddata |