Browse Articles

Article|10 Jan 2024|OPEN
EasyDAM_V4: Guided-GAN-based cross-species data labeling for fruit detection with significant shape difference 
Wenli Zhang1 , , Yuxin Liu1 , Chenhuizi Wang1 , Chao Zheng1 , Guoqiang Cui1 and Wei Guo,2 ,
1Information Department, Beijing University of Technology, Beijing 100022, China
2Graduate School of Agricultural and Life Sciences, The University of Tokyo, Tokyo 188-0002, Japan
*Corresponding author. E-mail: zhangwenli@bjut.edu.cn,guowei@g.ecc.u-tokyo.ac.jp

Horticulture Research 11,
Article number: uhae007 (2024)
doi: https://doi.org/10.1093/hr/uhae007
Views: 27

Received: 08 Jun 2023
Accepted: 01 Jan 2024
Published online: 10 Jan 2024

Abstract

Traditional agriculture is gradually being combined with artificial intelligence technology. High-performance fruit detection technology is an important basic technology in the practical application of modern smart orchards and has great application value. At this stage, fruit detection models need to rely on a large number of labeled datasets to support the training and learning of detection models, resulting in higher manual labeling costs. Our previous work uses a generative adversarial network to translate the source domain to the target fruit images. Thus, automatic labeling is performed on the actual dataset in the target domain. However, the method still does not achieve satisfactory results for translating fruits with significant shape variance. Therefore, this study proposes an improved fruit automatic labeling method, EasyDAM_V4, which introduces the Across-CycleGAN fruit translation model to achieve spanning translation between phenotypic features such as fruit shape, texture, and color to reduce domain differences effectively. We validated the proposed method using pear fruit as the source domain and three fruits with large phenotypic differences, namely pitaya, eggplant, and cucumber, as the target domain. The results show that the EasyDAM_V4 method achieves substantial cross-fruit shape translation, and the average accuracy of labeling reached 87.8, 87.0, and 80.7% for the three types of target domain datasets, respectively. Therefore, this research method can improve the applicability of the automatic labeling process even if significant shape variance exists between the source and target domain.