Developing an Algorithm for Robotic Precision Application of Crop Protection Products
The existing range of plant identification methods and tools is considered limited in real agrotechnical tasks. The image parameters tend to differ significantly in applied solutions. (Research purpose) To develop an algorithm for crop plant recognition by a robotic device using a state-of-the-art c...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | Russian |
| Published: |
Federal Scientific Agroengineering Centre VIM
2022-10-01
|
| Series: | Сельскохозяйственные машины и технологии |
| Subjects: | |
| Online Access: | https://www.vimsmit.com/jour/article/view/486 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850041704470544384 |
|---|---|
| author | M. A. Mirzaev |
| author_facet | M. A. Mirzaev |
| author_sort | M. A. Mirzaev |
| collection | DOAJ |
| description | The existing range of plant identification methods and tools is considered limited in real agrotechnical tasks. The image parameters tend to differ significantly in applied solutions. (Research purpose) To develop an algorithm for crop plant recognition by a robotic device using a state-of-the-art convolutional neural network (R-CNN) and deep learning technology. (Materials and methods) A robotic device has been developed for variable rate application of plant protection products able to recognize both useful crops and weeds, determine the area of processing, namely the coordinates of the processing center and the processing radius. Mask R-CNN and Deeplabv3 plus segmenting neural networks were chosen for crop (white head cabbage) detection. The network-based algorithm detects, segments, and positions plants based on a dataset collected in the image-mask and COCO dataset formats. The data set was formed by aerial photography using an unmanned aircraft. The original images are taken by Xiaovv HD Web USB 150 degree Full HD 1080P webcam and Logitech C270 HD 720p webcam. The trained neural network for the robotic device was installed on the Nvidia Jetson AGX Xavier platform. (Results and discussion) As a result of assessing the accuracy of the model on the test data, the following values were obtained: the number of plants detected is 98 percent, the accuracy of contour detection is 94 percent. (Conclusions) It is proved that the trained neural network can be applied to any cultivated crops, taking into account the heterogeneity of their location in the field, soil types, and the percentage of weeds. As a result, the model is trained to extract the bounding box coordinates and the object (cabbage) location by pixels with the required accuracy for both synthetic and real data. |
| format | Article |
| id | doaj-art-e3b5ae49d6b44c5b8a267b93e1610551 |
| institution | DOAJ |
| issn | 2073-7599 |
| language | Russian |
| publishDate | 2022-10-01 |
| publisher | Federal Scientific Agroengineering Centre VIM |
| record_format | Article |
| series | Сельскохозяйственные машины и технологии |
| spelling | doaj-art-e3b5ae49d6b44c5b8a267b93e16105512025-08-20T02:55:42ZrusFederal Scientific Agroengineering Centre VIMСельскохозяйственные машины и технологии2073-75992022-10-01163748010.22314/2073-7599-2022-16-3-74-80443Developing an Algorithm for Robotic Precision Application of Crop Protection ProductsM. A. Mirzaev0Federal Scientific Agroengineering Center VIMThe existing range of plant identification methods and tools is considered limited in real agrotechnical tasks. The image parameters tend to differ significantly in applied solutions. (Research purpose) To develop an algorithm for crop plant recognition by a robotic device using a state-of-the-art convolutional neural network (R-CNN) and deep learning technology. (Materials and methods) A robotic device has been developed for variable rate application of plant protection products able to recognize both useful crops and weeds, determine the area of processing, namely the coordinates of the processing center and the processing radius. Mask R-CNN and Deeplabv3 plus segmenting neural networks were chosen for crop (white head cabbage) detection. The network-based algorithm detects, segments, and positions plants based on a dataset collected in the image-mask and COCO dataset formats. The data set was formed by aerial photography using an unmanned aircraft. The original images are taken by Xiaovv HD Web USB 150 degree Full HD 1080P webcam and Logitech C270 HD 720p webcam. The trained neural network for the robotic device was installed on the Nvidia Jetson AGX Xavier platform. (Results and discussion) As a result of assessing the accuracy of the model on the test data, the following values were obtained: the number of plants detected is 98 percent, the accuracy of contour detection is 94 percent. (Conclusions) It is proved that the trained neural network can be applied to any cultivated crops, taking into account the heterogeneity of their location in the field, soil types, and the percentage of weeds. As a result, the model is trained to extract the bounding box coordinates and the object (cabbage) location by pixels with the required accuracy for both synthetic and real data.https://www.vimsmit.com/jour/article/view/486variable rate application of plant protection productsneural network trainingmask r-cnndeeplabv3 plusprecision farmingplant recognition. |
| spellingShingle | M. A. Mirzaev Developing an Algorithm for Robotic Precision Application of Crop Protection Products Сельскохозяйственные машины и технологии variable rate application of plant protection products neural network training mask r-cnn deeplabv3 plus precision farming plant recognition. |
| title | Developing an Algorithm for Robotic Precision Application of Crop Protection Products |
| title_full | Developing an Algorithm for Robotic Precision Application of Crop Protection Products |
| title_fullStr | Developing an Algorithm for Robotic Precision Application of Crop Protection Products |
| title_full_unstemmed | Developing an Algorithm for Robotic Precision Application of Crop Protection Products |
| title_short | Developing an Algorithm for Robotic Precision Application of Crop Protection Products |
| title_sort | developing an algorithm for robotic precision application of crop protection products |
| topic | variable rate application of plant protection products neural network training mask r-cnn deeplabv3 plus precision farming plant recognition. |
| url | https://www.vimsmit.com/jour/article/view/486 |
| work_keys_str_mv | AT mamirzaev developinganalgorithmforroboticprecisionapplicationofcropprotectionproducts |