Automated dynamic phenotyping of whole oilseed rape (Brassica napus) plants from images collected under controlled conditions
IntroductionRecent advancements in sensor technologies have enabled collection of many large, high-resolution plant images datasets that could be used to non-destructively explore the relationships between genetics, environment and management factors on phenotype or the physical traits exhibited by...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-05-01
|
| Series: | Frontiers in Plant Science |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpls.2025.1443882/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849716101140709376 |
|---|---|
| author | Evangeline Corcoran Kasra Hosseini Kasra Hosseini Laura Siles Smita Kurup Sebastian Ahnert Sebastian Ahnert |
| author_facet | Evangeline Corcoran Kasra Hosseini Kasra Hosseini Laura Siles Smita Kurup Sebastian Ahnert Sebastian Ahnert |
| author_sort | Evangeline Corcoran |
| collection | DOAJ |
| description | IntroductionRecent advancements in sensor technologies have enabled collection of many large, high-resolution plant images datasets that could be used to non-destructively explore the relationships between genetics, environment and management factors on phenotype or the physical traits exhibited by plants. The phenotype data captured in these datasets could then be integrated into models of plant development and crop yield to more accurately predict how plants may grow as a result of changing management practices and climate conditions, better ensuring future food security. However, automated methods capable of reliably and efficiently extracting meaningful measurements of individual plant components (e.g. leaves, flowers, pods) from imagery of whole plants are currently lacking. In this study, we explore interdisciplinary application of MapReader, a computer vision pipeline for annotating and classifying patches of larger images that was originally developed for semantic exploration of historical maps, to time-series images of whole oilseed rape (Brassica napus) plants.MethodsModels were trained to classify five plant structures in patches derived from whole plant images (branches, leaves, pods, flower buds and flowers), as well as background patches. Three modelling methods are compared: (i) 6-label multi-class classification, (ii) a chain of binary classifiers approach, and (iii) an approach combining binary classification of plant and background patches, followed by 5-label multi-class classification of plant structures.ResultsA combined plant/background binarization and 5-label multi-class modelling approach using a ‘resnext50d_4s2x40d’ model architecture for both the binary classification and multi-class classification components was found to produce the most accurate patch classification for whole B. napus plant images (macro-averaged F1-score = 88.50, weighted average F1-score = 97.71). This combined binary and 5-label multi-class classification approach demonstrate similar performance to the top-performing MapReader ‘railspace’ classification model.DiscussionThis highlights the potential applicability of the MapReader model framework to images data from across scientific and humanities domains, and the flexibility it provides in creating pipelines with different modelling approaches. The pipeline for dynamic plant phenotyping from whole plant images developed in this study could potentially be applied to imagery from varied laboratory conditions, and to images datasets of other plants of both agricultural and conservation concern. |
| format | Article |
| id | doaj-art-6f41634db8e04b06a937263f9dff23cf |
| institution | DOAJ |
| issn | 1664-462X |
| language | English |
| publishDate | 2025-05-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Plant Science |
| spelling | doaj-art-6f41634db8e04b06a937263f9dff23cf2025-08-20T03:13:08ZengFrontiers Media S.A.Frontiers in Plant Science1664-462X2025-05-011610.3389/fpls.2025.14438821443882Automated dynamic phenotyping of whole oilseed rape (Brassica napus) plants from images collected under controlled conditionsEvangeline Corcoran0Kasra Hosseini1Kasra Hosseini2Laura Siles3Smita Kurup4Sebastian Ahnert5Sebastian Ahnert6The Alan Turing Institute, London, United KingdomThe Alan Turing Institute, London, United KingdomZalando Societas Europaea (SE), Berlin, GermanyDepartment of Plant Science and the Bioeconomy, Rothamsted Research, Harpenden, United KingdomDepartment of Plant Science and the Bioeconomy, Rothamsted Research, Harpenden, United KingdomThe Alan Turing Institute, London, United KingdomDepartment of Chemical Engineering and Biotechnology, University of Cambridge, Cambridge, United KingdomIntroductionRecent advancements in sensor technologies have enabled collection of many large, high-resolution plant images datasets that could be used to non-destructively explore the relationships between genetics, environment and management factors on phenotype or the physical traits exhibited by plants. The phenotype data captured in these datasets could then be integrated into models of plant development and crop yield to more accurately predict how plants may grow as a result of changing management practices and climate conditions, better ensuring future food security. However, automated methods capable of reliably and efficiently extracting meaningful measurements of individual plant components (e.g. leaves, flowers, pods) from imagery of whole plants are currently lacking. In this study, we explore interdisciplinary application of MapReader, a computer vision pipeline for annotating and classifying patches of larger images that was originally developed for semantic exploration of historical maps, to time-series images of whole oilseed rape (Brassica napus) plants.MethodsModels were trained to classify five plant structures in patches derived from whole plant images (branches, leaves, pods, flower buds and flowers), as well as background patches. Three modelling methods are compared: (i) 6-label multi-class classification, (ii) a chain of binary classifiers approach, and (iii) an approach combining binary classification of plant and background patches, followed by 5-label multi-class classification of plant structures.ResultsA combined plant/background binarization and 5-label multi-class modelling approach using a ‘resnext50d_4s2x40d’ model architecture for both the binary classification and multi-class classification components was found to produce the most accurate patch classification for whole B. napus plant images (macro-averaged F1-score = 88.50, weighted average F1-score = 97.71). This combined binary and 5-label multi-class classification approach demonstrate similar performance to the top-performing MapReader ‘railspace’ classification model.DiscussionThis highlights the potential applicability of the MapReader model framework to images data from across scientific and humanities domains, and the flexibility it provides in creating pipelines with different modelling approaches. The pipeline for dynamic plant phenotyping from whole plant images developed in this study could potentially be applied to imagery from varied laboratory conditions, and to images datasets of other plants of both agricultural and conservation concern.https://www.frontiersin.org/articles/10.3389/fpls.2025.1443882/fullplant phenotypingcomputer visionmachine learningimage analysisplant development |
| spellingShingle | Evangeline Corcoran Kasra Hosseini Kasra Hosseini Laura Siles Smita Kurup Sebastian Ahnert Sebastian Ahnert Automated dynamic phenotyping of whole oilseed rape (Brassica napus) plants from images collected under controlled conditions Frontiers in Plant Science plant phenotyping computer vision machine learning image analysis plant development |
| title | Automated dynamic phenotyping of whole oilseed rape (Brassica napus) plants from images collected under controlled conditions |
| title_full | Automated dynamic phenotyping of whole oilseed rape (Brassica napus) plants from images collected under controlled conditions |
| title_fullStr | Automated dynamic phenotyping of whole oilseed rape (Brassica napus) plants from images collected under controlled conditions |
| title_full_unstemmed | Automated dynamic phenotyping of whole oilseed rape (Brassica napus) plants from images collected under controlled conditions |
| title_short | Automated dynamic phenotyping of whole oilseed rape (Brassica napus) plants from images collected under controlled conditions |
| title_sort | automated dynamic phenotyping of whole oilseed rape brassica napus plants from images collected under controlled conditions |
| topic | plant phenotyping computer vision machine learning image analysis plant development |
| url | https://www.frontiersin.org/articles/10.3389/fpls.2025.1443882/full |
| work_keys_str_mv | AT evangelinecorcoran automateddynamicphenotypingofwholeoilseedrapebrassicanapusplantsfromimagescollectedundercontrolledconditions AT kasrahosseini automateddynamicphenotypingofwholeoilseedrapebrassicanapusplantsfromimagescollectedundercontrolledconditions AT kasrahosseini automateddynamicphenotypingofwholeoilseedrapebrassicanapusplantsfromimagescollectedundercontrolledconditions AT laurasiles automateddynamicphenotypingofwholeoilseedrapebrassicanapusplantsfromimagescollectedundercontrolledconditions AT smitakurup automateddynamicphenotypingofwholeoilseedrapebrassicanapusplantsfromimagescollectedundercontrolledconditions AT sebastianahnert automateddynamicphenotypingofwholeoilseedrapebrassicanapusplantsfromimagescollectedundercontrolledconditions AT sebastianahnert automateddynamicphenotypingofwholeoilseedrapebrassicanapusplantsfromimagescollectedundercontrolledconditions |