DeepFruits: A Fruit Detection System Using Deep Neural Networks

Prior works

Origin paper

DeepFruits: A Fruit Detection System Using Deep Neural Networks

Inkyu Sa, ZongYuan Ge, Feras Dayoub, B. Upcroft, Tristan Perez, C. McCool
2016

Automated Bell Pepper Harvesting using Robotic Vision System

Silpa Ajith Kumar, J. S. Kumar
2019

Automatic Fruits Classification System Based on Deep Neural Network

Khadija Munir, A. I. Umar, Waqas Yousaf
2020

Convolutional Neural Networks (CNN) for Detecting Fruit Information Using Machine Learning Techniques

Fouzia Risdin, P. Mondal, Kazi Mahmudul Hassan
2020

Deep fruit detection in orchards

Suchet Bargoti, J. Underwood
2016

DetSSeg: A Selective On-Field Pomegranate Segmentation Approach

Shubham S. Mane, Prashant Bartakke, Tulshidas Bastewad
2023

Visual detection of occluded crop: For automated harvesting

C. McCool, Inkyu Sa, Feras Dayoub, Christopher F. Lehnert, Tristan Perez, B. Upcroft
2016

Fruit Quantity and Ripeness Estimation Using a Robotic Vision System

Michael Halstead, C. McCool, Simon Denman, Tristan Perez, C. Fookes
2018

Image Segmentation for Fruit Detection and Yield Estimation in Apple Orchards

Suchet Bargoti, J. Underwood
2016

Deep Count: Fruit Counting Based on Deep Simulated Learning

Maryam Rahnemoonfar, Clay Sheppard
2017

Building Efficient Fruit Detection Model

Pavan N. Kunchur, V. Pandurangi, Madhu Hollikeri
2019

Image Based Mango Fruit Detection, Localisation and Yield Estimation Using Multiple View Geometry

Madeleine Stein, Suchet Bargoti, J. Underwood
2016

Multiple Pedestrian Detection Depending on Faster Region-based Convolutional Neural Network (RCNN)

Ghalia Shariha, M. Elmogy, Eman M. El-Daydamony, A. Atwan
2019

Fruit Quantity and Quality Estimation using a Robotic Vision System

Michael Halstead, C. McCool, Simon Denman, Tristan Perez, C. Fookes
2018

Sensors and systems for fruit detection and localization: A review

Aleana Gongal, Suraj Amatya, M. Karkee, Qin Zhang, Karen Lewis
2015

A deep-level region-based visual representation architecture for detecting strawberry flowers in an outdoor field

P. Lin, W. S. Lee, Y. M. Chen, N. Peres, C. Fraisse
2019

Deep learning for real-time fruit detection and orchard fruit load estimation: benchmarking of ‘MangoYOLO’

A. Koirala, K. Walsh, Zhenglin Wang, C. McCarthy
2019

On Visual Detection of Highly-occluded Objects for Harvesting Automation in Horticulture

Inkyu Sa, C. McCool, Christopher F. Lehnert, Tristan Perez
2015

Deployment of Deep Learning Models on Resource-Deficient Devices for Object Detection

Ameema Zainab, Dabeeruddin Syed
2020

Counting Apples and Oranges With Deep Learning: A Data-Driven Approach

Steven W. Chen, Shreyas S. Shivakumar, Sandeep Dcunha, J. Das, Edidiong Okon, Chao Qu, C. J. Taylor, Vijay R. Kumar
2017

A review of object detection based on convolutional neural network

Zhiqiang Wang, Liu Jun
2017

MangoNet: A deep semantic segmentation architecture for a method to detect and count mangoes in an open orchard

Ramesh Kestur, Avadesh Meduri, Omkar Narasipura
2019

Towards Real-Time Object Detection on Embedded Systems

Huizi Mao, Song Yao, Tianqi Tang, Boxun Li, Jun Yao, Yu Wang
2018

Faster R-CNN for multi-class fruit detection using a robotic vision system

Shaohua Wan, Sotirios K Goudos
2020

A Simple and Efficient Deep Learning-Based Framework for Automatic Fruit Recognition

Dostdar Hussain, I. Hussain, Muhammad Ismail, Amerah A. Alabrah, Syed Sajid Ullah, Hayat Mansoor Alaghbari
2022

Disease Recognition in Sugarcane Crop Using Deep Learning

H. Malik, M. Dwivedi, S. N. Omkar, Tahir Javed, Abdul Bakey, Mohammad Raqib Pala, A. Chakravarthy
2020

CAPTCHA Recognition Based on Faster R-CNN

Feng-Lin Du, Jiaxing Li, Zhi Yang, Peng Chen, Bing Wang, Jun Zhang
2017

Scalable, High-Quality Object Detection

Christian Szegedy, Scott E. Reed, D. Erhan, Dragomir Anguelov
2014

RON: Reverse Connection with Objectness Prior Networks for Object Detection

Tao Kong, F. Sun, Anbang Yao, Huaping Liu, Ming Lu, Yurong Chen
2017

Identification of Tomato Disease Types and Detection of Infected Areas Based on Deep Convolutional Neural Networks and Object Detection Techniques

Qimei Wang, Feng Qi, Minghe Sun, Jianhua Qu, Jie Xue
2019

Relief Impression Image Detection : Unsupervised Extracting Objects Directly From Feature Arrangements of Deep CNN

Guiying Li, Junlong Liu, Chunhui Jiang, Ke Tang
2016

Refining Bounding-Box Regression for Object Localization

Naomi Lynn Dickerson
2017

A Fast Detection Method via Region‐Based Fully Convolutional Neural Networks for Shield Tunnel Lining Defects

Ya-dong Xue, Yicheng Li
2018

Understanding Image Representations by Measuring Their Equivariance and Equivalence

Karel Lenc, A. Vedaldi
2014

Scale Pyramid Attention for Single Shot MultiBox Detector

Jie Hao, Feng Jiang, Rufei Zhang, Xipeng Lin, B. Leng, Guanglu Song
2019

You Only Look Once: Unified, Real-Time Object Detection

J. Redmon, S. Divvala, Ross B. Girshick, Ali Farhadi
2015

Deep learning - Method overview and review of use for fruit detection and yield estimation

A. Koirala, K. Walsh, Zhenglin Wang, C. McCarthy
2019

R-FCN: Object Detection via Region-based Fully Convolutional Networks

Jifeng Dai, Yi Li, Kaiming He, Jian Sun
2016

Traffic-Sign Detection and Classification in the Wild

Zhe Zhu, Dun Liang, Song-Hai Zhang, Xiaolei Huang, Baoli Li, Shimin Hu
2016

A Strawberry Detection System Using Convolutional Neural Networks

N. Lamb, Mooi Choo Choo Chuah
2018

Apple detection during different growth stages in orchards using the improved YOLO-V3 model

Yunong Tian, Guodong Yang, Zhe Wang, Hao Wang, E. Li, Zi-ze Liang
2019

How to read the graph

Each node is an academic paper related to the origin paper.

• Papers are arranged according to their similarity (this is not a citation tree)
• Node size is the number of citations
• Node color is the publishing year
• Similar papers have strong connecting lines and cluster together

Paper Details

DeepFruits: A Fruit Detection System Using Deep Neural Networks

Inkyu Sa + 4 authors C. McCool

2016, Italian National Conference on Sensors

This paper presents a novel approach to fruit detection using deep convolutional neural networks. The aim is to build an accurate, fast and reliable fruit detection system, which is a vital element of an autonomous agricultural robotic platform; it is a key element for fruit yield estimation and automated harvesting. Recent work in deep neural networks has led to the development of a state-of-the-art object detector termed Faster Region-based CNN (Faster R-CNN). We adapt this model, through transfer learning, for the task of fruit detection using imagery obtained from two modalities: colour (RGB) and Near-Infrared (NIR). Early and late fusion methods are explored for combining the multi-modal (RGB and NIR) information. This leads to a novel multi-modal Faster R-CNN model, which achieves state-of-the-art results compared to prior work with the F1 score, which takes into account both precision and recall performances improving from 0.807 to 0.838 for the detection of sweet pepper. In addition to improved accuracy, this approach is also much quicker to deploy for new fruits, as it requires bounding box annotation rather than pixel-level annotation (annotating bounding boxes is approximately an order of magnitude quicker to perform). The model is retrained to perform the detection of seven fruits, with the entire process taking four hours to annotate and train the new model per fruit.