Segment Anything Model Combined with Multi-Scale Segmentation for Extracting Complex Cultivated Land Parcels in High-Resolution Remote Sensing Images
Accurate cultivated land parcel data are an essential analytical unit for further agricultural monitoring, yield estimation, and precision agriculture management. However, the high degree of landscape fragmentation and the irregular shapes of cultivated land parcels, influenced by topography and hum...
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-09-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/16/18/3489 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850259674873462784 |
|---|---|
| author | Zhongxin Huang Haitao Jing Yueming Liu Xiaomei Yang Zhihua Wang Xiaoliang Liu Ku Gao Haofeng Luo |
| author_facet | Zhongxin Huang Haitao Jing Yueming Liu Xiaomei Yang Zhihua Wang Xiaoliang Liu Ku Gao Haofeng Luo |
| author_sort | Zhongxin Huang |
| collection | DOAJ |
| description | Accurate cultivated land parcel data are an essential analytical unit for further agricultural monitoring, yield estimation, and precision agriculture management. However, the high degree of landscape fragmentation and the irregular shapes of cultivated land parcels, influenced by topography and human activities, limit the effectiveness of parcel extraction. The visual semantic segmentation model based on the Segment Anything Model (SAM) provides opportunities for extracting multi-form cultivated land parcels from high-resolution images; however, the performance of the SAM in extracting cultivated land parcels requires further exploration. To address the difficulty in obtaining parcel extraction that closely matches the true boundaries of complex large-area cultivated land parcels, this study used segmentation patches with cultivated land boundary information obtained from SAM unsupervised segmentation as constraints, which were then incorporated into the subsequent multi-scale segmentation. A combined method of SAM unsupervised segmentation and multi-scale segmentation was proposed, and it was evaluated in different cultivated land scenarios. In plain areas, the precision, recall, and IoU for cultivated land parcel extraction improved by 6.57%, 10.28%, and 9.82%, respectively, compared to basic SAM extraction, confirming the effectiveness of the proposed method. In comparison to basic SAM unsupervised segmentation and point-prompt SAM conditional segmentation, the SAM unsupervised segmentation combined with multi-scale segmentation achieved considerable improvements in extracting complex cultivated land parcels. This study confirms that, under zero-shot and unsupervised conditions, the SAM unsupervised segmentation combined with the multi-scale segmentation method demonstrates strong cross-region and cross-data source transferability and effectiveness for extracting complex cultivated land parcels across large areas. |
| format | Article |
| id | doaj-art-215209defffa4721ba88ce3be5c4dfd4 |
| institution | OA Journals |
| issn | 2072-4292 |
| language | English |
| publishDate | 2024-09-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj-art-215209defffa4721ba88ce3be5c4dfd42025-08-20T01:55:49ZengMDPI AGRemote Sensing2072-42922024-09-011618348910.3390/rs16183489Segment Anything Model Combined with Multi-Scale Segmentation for Extracting Complex Cultivated Land Parcels in High-Resolution Remote Sensing ImagesZhongxin Huang0Haitao Jing1Yueming Liu2Xiaomei Yang3Zhihua Wang4Xiaoliang Liu5Ku Gao6Haofeng Luo7School of Surveying and Land Information Engineering, Henan Polytechnic University, Jiaozuo 454000, ChinaSchool of Surveying and Land Information Engineering, Henan Polytechnic University, Jiaozuo 454000, ChinaState Key Laboratory of Resources and Environmental Information System, Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, Beijing 100101, ChinaState Key Laboratory of Resources and Environmental Information System, Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, Beijing 100101, ChinaState Key Laboratory of Resources and Environmental Information System, Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, Beijing 100101, ChinaState Key Laboratory of Resources and Environmental Information System, Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, Beijing 100101, ChinaState Key Laboratory of Resources and Environmental Information System, Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, Beijing 100101, ChinaSchool of Surveying and Land Information Engineering, Henan Polytechnic University, Jiaozuo 454000, ChinaAccurate cultivated land parcel data are an essential analytical unit for further agricultural monitoring, yield estimation, and precision agriculture management. However, the high degree of landscape fragmentation and the irregular shapes of cultivated land parcels, influenced by topography and human activities, limit the effectiveness of parcel extraction. The visual semantic segmentation model based on the Segment Anything Model (SAM) provides opportunities for extracting multi-form cultivated land parcels from high-resolution images; however, the performance of the SAM in extracting cultivated land parcels requires further exploration. To address the difficulty in obtaining parcel extraction that closely matches the true boundaries of complex large-area cultivated land parcels, this study used segmentation patches with cultivated land boundary information obtained from SAM unsupervised segmentation as constraints, which were then incorporated into the subsequent multi-scale segmentation. A combined method of SAM unsupervised segmentation and multi-scale segmentation was proposed, and it was evaluated in different cultivated land scenarios. In plain areas, the precision, recall, and IoU for cultivated land parcel extraction improved by 6.57%, 10.28%, and 9.82%, respectively, compared to basic SAM extraction, confirming the effectiveness of the proposed method. In comparison to basic SAM unsupervised segmentation and point-prompt SAM conditional segmentation, the SAM unsupervised segmentation combined with multi-scale segmentation achieved considerable improvements in extracting complex cultivated land parcels. This study confirms that, under zero-shot and unsupervised conditions, the SAM unsupervised segmentation combined with the multi-scale segmentation method demonstrates strong cross-region and cross-data source transferability and effectiveness for extracting complex cultivated land parcels across large areas.https://www.mdpi.com/2072-4292/16/18/3489Segment Anything Model (SAM)multi-scale segmentationprecise parcel extractioncomplex cultivated land |
| spellingShingle | Zhongxin Huang Haitao Jing Yueming Liu Xiaomei Yang Zhihua Wang Xiaoliang Liu Ku Gao Haofeng Luo Segment Anything Model Combined with Multi-Scale Segmentation for Extracting Complex Cultivated Land Parcels in High-Resolution Remote Sensing Images Remote Sensing Segment Anything Model (SAM) multi-scale segmentation precise parcel extraction complex cultivated land |
| title | Segment Anything Model Combined with Multi-Scale Segmentation for Extracting Complex Cultivated Land Parcels in High-Resolution Remote Sensing Images |
| title_full | Segment Anything Model Combined with Multi-Scale Segmentation for Extracting Complex Cultivated Land Parcels in High-Resolution Remote Sensing Images |
| title_fullStr | Segment Anything Model Combined with Multi-Scale Segmentation for Extracting Complex Cultivated Land Parcels in High-Resolution Remote Sensing Images |
| title_full_unstemmed | Segment Anything Model Combined with Multi-Scale Segmentation for Extracting Complex Cultivated Land Parcels in High-Resolution Remote Sensing Images |
| title_short | Segment Anything Model Combined with Multi-Scale Segmentation for Extracting Complex Cultivated Land Parcels in High-Resolution Remote Sensing Images |
| title_sort | segment anything model combined with multi scale segmentation for extracting complex cultivated land parcels in high resolution remote sensing images |
| topic | Segment Anything Model (SAM) multi-scale segmentation precise parcel extraction complex cultivated land |
| url | https://www.mdpi.com/2072-4292/16/18/3489 |
| work_keys_str_mv | AT zhongxinhuang segmentanythingmodelcombinedwithmultiscalesegmentationforextractingcomplexcultivatedlandparcelsinhighresolutionremotesensingimages AT haitaojing segmentanythingmodelcombinedwithmultiscalesegmentationforextractingcomplexcultivatedlandparcelsinhighresolutionremotesensingimages AT yuemingliu segmentanythingmodelcombinedwithmultiscalesegmentationforextractingcomplexcultivatedlandparcelsinhighresolutionremotesensingimages AT xiaomeiyang segmentanythingmodelcombinedwithmultiscalesegmentationforextractingcomplexcultivatedlandparcelsinhighresolutionremotesensingimages AT zhihuawang segmentanythingmodelcombinedwithmultiscalesegmentationforextractingcomplexcultivatedlandparcelsinhighresolutionremotesensingimages AT xiaoliangliu segmentanythingmodelcombinedwithmultiscalesegmentationforextractingcomplexcultivatedlandparcelsinhighresolutionremotesensingimages AT kugao segmentanythingmodelcombinedwithmultiscalesegmentationforextractingcomplexcultivatedlandparcelsinhighresolutionremotesensingimages AT haofengluo segmentanythingmodelcombinedwithmultiscalesegmentationforextractingcomplexcultivatedlandparcelsinhighresolutionremotesensingimages |