Determination of tomato leafminer: Tuta absoluta (Meyrick) (Lepidoptera: Gelechiidae) damage on tomato using deep learning instance segmentation method

Abstract Pests significantly negatively affect product yield and quality in agricultural production. Agricultural producers may not accurately identify pests and signs of pest damage. Thus, incorrect or excessive insecticides may be used. Excessive use of insecticides not only causes human health and environmental pollution, but also increases input costs. Therefore, early detection and diagnosis of pests is extremely important. In this study, the effectiveness of the instance segmentation method, a deep learning-based method, was investigated for the early detection of the damage caused by the T. absoluta pest in the leaf part of the tomato plant under greenhouse conditions. An original dataset was created by acquiring 800 healthy and damaged images under greenhouse conditions. The acquired images were labelled as bounding box and automatically converted to a mask label with the Segment Anything Model (SAM) model. The created dataset was trained with YOLOv8(n/s/m/l/x)-Seg models. As a result of the training, the box performance of the proposed YOLOv8l-Seg model was measured as 0.924 in the mAP 0.5 metric. The YOLOv8l-Seg model mask values are, respectively: mAP 0.5 , mAP 0.5–0.95 , Precision, Recall showed the best performance with values of 0.935, 0.806, 0.956 and 0.859. Then, the YOLOv8l-Seg model, trained with different data input sizes, showed the best performance at 640 × 640 size and the lowest performance with a value of 0.699 in the mAP 0.5 metric in the 80 × 80 size. The same dataset was trained with YOLOv7, YOLOv5l, YOLACT and Mask R-CNN instance segmentation models and performance comparisons were made with the YOLOv8l-Seg model. As a result, it was determined that the model that best detected T. absoluta damage in tomato plants was the YOLOv8l-Seg model. The Mask R-CNN model showed the lowest performance with a metric of 0.806 mAP 0.5 . The results obtained from this study revealed that the proposed model and method can be used effectively in detecting the damage caused by the T. absoluta pest.