DASNeRF: depth consistency optimization, adaptive sampling, and hierarchical structural fusion for sparse view neural radiance fields.
To address the challenges of significant detail loss in Neural Radiance Fields (NeRF) under sparse-view input conditions, this paper proposes the DASNeRF framework. DASNeRF aims to generate high-detail novel views from a limited number of input viewpoints. To address the limitations of few-shot NeRF...
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2025-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0321878 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849328764700327936 |
|---|---|
| author | Yongshuo Zhang Guangyuan Zhang Kefeng Li Zhenfang Zhu Peng Wang Zhenfei Wang Chen Fu Xiaotong Li Zhiming Fan Yongpeng Zhao |
| author_facet | Yongshuo Zhang Guangyuan Zhang Kefeng Li Zhenfang Zhu Peng Wang Zhenfei Wang Chen Fu Xiaotong Li Zhiming Fan Yongpeng Zhao |
| author_sort | Yongshuo Zhang |
| collection | DOAJ |
| description | To address the challenges of significant detail loss in Neural Radiance Fields (NeRF) under sparse-view input conditions, this paper proposes the DASNeRF framework. DASNeRF aims to generate high-detail novel views from a limited number of input viewpoints. To address the limitations of few-shot NeRF, including insufficient depth information and detail loss, DASNeRF introduces accurate depth priors and employs a depth constraint strategy combining relative depth ordering fidelity regularization and depth structural consistency regularization. These methods ensure reconstruction accuracy even with sparse input views. The depth priors provide high-quality depth data through a more accurate monocular depth estimation model, enhancing the reconstruction capability and stability of the model. The depth ordering fidelity regularization guides the network to learn relative relationships using local depth ranking priors, reducing blurring caused by inaccurate depth estimation. Depth structural consistency regularization maintains global depth consistency by enforcing continuity across neighboring depth pixels. These depth constraint strategies enhance DASNeRF's performance in complex scenes, making 3D reconstruction under sparse views more accurate and natural. In addition, we utilize a three-layer optimal sampling strategy, consisting of coarse sampling, optimized sampling, and fine sampling during the three-layer sampling process to better capture details in key regions. In the optimized sampling phase, the sampling point density in key regions is adaptively increased while reducing sampling in low-priority regions, enhancing detail capture accuracy. To alleviate overfitting, we proposed an MLP structure with per-layer input fusion. This design preserves the model's detail perception ability while effectively avoids overfitting. Specifically, each layer's input includes the output features from the previous layer and incorporates processed five-dimensional information, further enhancing fine detail reconstruction. Experimental results show that DASNeRF outperforms state-of-the-art methods on the LLFF and DTU dataset, achieving better performance in metrics such as PSNR, SSIM, and LPIPS. The reconstructed details and visual quality are significantly improved, demonstrating DASNeRF's potential in 3D reconstruction under sparse-view conditions. |
| format | Article |
| id | doaj-art-ebf461c6faca4e07b7e9edbf67bc3922 |
| institution | Kabale University |
| issn | 1932-6203 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-ebf461c6faca4e07b7e9edbf67bc39222025-08-20T03:47:28ZengPublic Library of Science (PLoS)PLoS ONE1932-62032025-01-01205e032187810.1371/journal.pone.0321878DASNeRF: depth consistency optimization, adaptive sampling, and hierarchical structural fusion for sparse view neural radiance fields.Yongshuo ZhangGuangyuan ZhangKefeng LiZhenfang ZhuPeng WangZhenfei WangChen FuXiaotong LiZhiming FanYongpeng ZhaoTo address the challenges of significant detail loss in Neural Radiance Fields (NeRF) under sparse-view input conditions, this paper proposes the DASNeRF framework. DASNeRF aims to generate high-detail novel views from a limited number of input viewpoints. To address the limitations of few-shot NeRF, including insufficient depth information and detail loss, DASNeRF introduces accurate depth priors and employs a depth constraint strategy combining relative depth ordering fidelity regularization and depth structural consistency regularization. These methods ensure reconstruction accuracy even with sparse input views. The depth priors provide high-quality depth data through a more accurate monocular depth estimation model, enhancing the reconstruction capability and stability of the model. The depth ordering fidelity regularization guides the network to learn relative relationships using local depth ranking priors, reducing blurring caused by inaccurate depth estimation. Depth structural consistency regularization maintains global depth consistency by enforcing continuity across neighboring depth pixels. These depth constraint strategies enhance DASNeRF's performance in complex scenes, making 3D reconstruction under sparse views more accurate and natural. In addition, we utilize a three-layer optimal sampling strategy, consisting of coarse sampling, optimized sampling, and fine sampling during the three-layer sampling process to better capture details in key regions. In the optimized sampling phase, the sampling point density in key regions is adaptively increased while reducing sampling in low-priority regions, enhancing detail capture accuracy. To alleviate overfitting, we proposed an MLP structure with per-layer input fusion. This design preserves the model's detail perception ability while effectively avoids overfitting. Specifically, each layer's input includes the output features from the previous layer and incorporates processed five-dimensional information, further enhancing fine detail reconstruction. Experimental results show that DASNeRF outperforms state-of-the-art methods on the LLFF and DTU dataset, achieving better performance in metrics such as PSNR, SSIM, and LPIPS. The reconstructed details and visual quality are significantly improved, demonstrating DASNeRF's potential in 3D reconstruction under sparse-view conditions.https://doi.org/10.1371/journal.pone.0321878 |
| spellingShingle | Yongshuo Zhang Guangyuan Zhang Kefeng Li Zhenfang Zhu Peng Wang Zhenfei Wang Chen Fu Xiaotong Li Zhiming Fan Yongpeng Zhao DASNeRF: depth consistency optimization, adaptive sampling, and hierarchical structural fusion for sparse view neural radiance fields. PLoS ONE |
| title | DASNeRF: depth consistency optimization, adaptive sampling, and hierarchical structural fusion for sparse view neural radiance fields. |
| title_full | DASNeRF: depth consistency optimization, adaptive sampling, and hierarchical structural fusion for sparse view neural radiance fields. |
| title_fullStr | DASNeRF: depth consistency optimization, adaptive sampling, and hierarchical structural fusion for sparse view neural radiance fields. |
| title_full_unstemmed | DASNeRF: depth consistency optimization, adaptive sampling, and hierarchical structural fusion for sparse view neural radiance fields. |
| title_short | DASNeRF: depth consistency optimization, adaptive sampling, and hierarchical structural fusion for sparse view neural radiance fields. |
| title_sort | dasnerf depth consistency optimization adaptive sampling and hierarchical structural fusion for sparse view neural radiance fields |
| url | https://doi.org/10.1371/journal.pone.0321878 |
| work_keys_str_mv | AT yongshuozhang dasnerfdepthconsistencyoptimizationadaptivesamplingandhierarchicalstructuralfusionforsparseviewneuralradiancefields AT guangyuanzhang dasnerfdepthconsistencyoptimizationadaptivesamplingandhierarchicalstructuralfusionforsparseviewneuralradiancefields AT kefengli dasnerfdepthconsistencyoptimizationadaptivesamplingandhierarchicalstructuralfusionforsparseviewneuralradiancefields AT zhenfangzhu dasnerfdepthconsistencyoptimizationadaptivesamplingandhierarchicalstructuralfusionforsparseviewneuralradiancefields AT pengwang dasnerfdepthconsistencyoptimizationadaptivesamplingandhierarchicalstructuralfusionforsparseviewneuralradiancefields AT zhenfeiwang dasnerfdepthconsistencyoptimizationadaptivesamplingandhierarchicalstructuralfusionforsparseviewneuralradiancefields AT chenfu dasnerfdepthconsistencyoptimizationadaptivesamplingandhierarchicalstructuralfusionforsparseviewneuralradiancefields AT xiaotongli dasnerfdepthconsistencyoptimizationadaptivesamplingandhierarchicalstructuralfusionforsparseviewneuralradiancefields AT zhimingfan dasnerfdepthconsistencyoptimizationadaptivesamplingandhierarchicalstructuralfusionforsparseviewneuralradiancefields AT yongpengzhao dasnerfdepthconsistencyoptimizationadaptivesamplingandhierarchicalstructuralfusionforsparseviewneuralradiancefields |