Automatic Broccoli Detection in RGB-D Images

Authors

  • Luis Talavera Ramirez Universidad Autónoma del Estado de México, México
  • Luis Antonio Quiroz Mercado Universidad Autónoma del Estado de México, México
  • Héctor Alejandro Montes Venegas Universidad Autónoma del Estado de México, México
  • Rosa María Valdovinos Rosas Universidad Autónoma del Estado de México, México https://orcid.org/0000-0001-9954-0653
  • José Raymundo Marcial Romero Universidad Autónoma del Estado de México, México https://orcid.org/0000-0002-5808-5727

DOI:

https://doi.org/10.32870/recibe.v12i2.301

Keywords:

Segmentación, filtrado de imágenes, Circle fit

Abstract

Broccoli is a vegetable crop considered to have high economic value worldwide. However, in many countries, its production is continuously affected by labor shortages and instability, caused by a wide range of economic fluctuations, political factors, and migration-related phenomena. As a result, autonomous and semi-autonomous harvesting alternatives have been explored to facilitate harvesting operations, increase productivity, and reduce costs. This article reviews several proposed strategies for the automatic detection of broccoli during the harvesting process, based on 3D image segmentation and filtering techniques. In addition, it evaluates the effectiveness of each strategy by comparing the results obtained across the different approaches.      

References

Duckett, T., Pearson, S., Blackmore, S., Grieve, B., Wen-Hua, C., Cielniak, G., Cleaversmith, J., Dai, J., Davis, S., Fox, C., From, P. J., Georgilas, I., Gill, H. S., Gould, I., Hanheide, M., Hunter, A. K., Iida, F., Mihalyova, L., Nefti-Meziani, S., . . . Yang, G. (2018). Agricultural Robotics: The Future of Robotic agriculture. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1806.06762

Ramirez, R. A. (2006). Computer vision based analysis of broccoli for application in a selective autonomous harvester. ResearchGate. https://www.researchgate.net/publication/279691048_Computer_Vision_Based_Analysis_of_Broccoli_for_Application_in_a_Selective_Autonomous_Harvester

Blok, P. M., Barth, R., & Van Den Berg, W. (2016). Machine vision for a selective broccoli harvesting robot. IFAC-PapersOnLine, 49(16), 66-71. https://doi.org/10.1016/j.ifacol.2016.10.013.

Kusumam, K., Krajník, T., Pearson, S., Duckett, T., & Cielniak, G. (2017). 3D-Vision based detection, localization, and sizing of broccoli heads in the field. Journal of Field Robotics, 34(8), 1505-1518. https://doi.org/10.1002/rob.21726.

Montes, H. A., Louëdec, J. L., Cielniak, G., & Duckett, T. (2020) Montes, H. A., Le Louedec, J., Cielniak, G., and Duckett, T. Real-time detection of broccoli crops in 3D point clouds for autonomous robotic harvesting. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 10483–10488. https://doi.org/10.1109/iros45743.2020.9341381.

Montes, H. A. and Cielniak, G. (2022). Multiple broccoli head detection and tracking in 3D point clouds for autonomous harvesting. In Proceedings of the 36th AAAI Conference on Artificial Intelligence, workshop on AI for Agriculture and Food Systems, 2022.

Kamilaris, A., & Prenafeta-Boldú, F. X. (2018). Deep learning in Agriculture: A survey. Computers and Electronics in Agriculture, 147, 70-90. https://doi.org/10.1016/j.compag.2018.02.016

Bender, A., Whelan, B., & Sukkarieh, S. (2019b). A high‐resolution, multimodal data set for agricultural robotics: a Ladybird ’s‐eye view of Brassica. Journal of Field Robotics, 37(1), 73-96. https://doi.org/10.1002/rob.21877

Blok, P. M., van Evert, F. K., Tielen, A. P. M., van Henten, E. J., & Kootstra, G. (2021). The effect of data augmentation and network simplification on the image-based detection of broccoli heads with Mask R-CNN. Journal of Field Robotics, 38(1), 85-104. Advance online publication. https://doi.org/10.1002/rob.21975

Blok, P. M., Van Henten, E., Van Evert, F., & Kootstra, G. (2021b). Image-based size estimation of broccoli heads under varying degrees of occlusion. Biosystems Engineering, 208, 213-233. https://doi.org/10.1016/j.biosystemseng.2021.06.001

Louedec, J. L., Montes, H. A. (2020). et al., Segmentation and detection from organised 3D point clouds: A case study in broccoli head detection. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 285–293, https://doi.org/10.1109/cvprw50498.2020.00040.

Janeshewski, E. (s. f.). Calculations for circle fitting in CMM software. http://www.mbccmm.com/cmmq/index.php/training/general/236-calculations-for-circle-fitting-in-cmm-software#:~:text=Calculations%20for%20Circle%20Fitting%20in%20CMM%20Software%201,is%20minimized%2C%20with%20no%20other%20constraints.%20M%C3%A1s%20elementos

Published

2023-11-30 — Updated on 2026-06-21

Versions

How to Cite

Talavera Ramirez, L., Quiroz Mercado , L. A. ., Montes Venegas, H. A. ., Valdovinos Rosas, R. M. ., & Marcial Romero, J. R. . (2026). Automatic Broccoli Detection in RGB-D Images. ReCIBE, Electronic Journal of Computing, Informatics, Biomedical and Electronics, 12(2), C4–9. https://doi.org/10.32870/recibe.v12i2.301 (Original work published November 30, 2023)

Issue

Section

Computer Science & IT