3D Reconstruction of Fruit Shape based on Vision and Edge Sections

Updata:01-01-1970

Source:
By:Author(s)

DOI: https://doi.org/10.30564/jeisr.v4i1.4585

Abstract:

The fruit industry has been known as one of the largest businesses in Malaysia, where most of the fruits pass through the peeling process well in advance before the final product as juice in a bottle or slices in a can. The current industrial fruit peeling techniques are passive and inefficient by cutting parts of the pulp of the fruit with peels leading to losses. To avoid this issue, a multi-axis CNC fruit peeler can be used to precisely peel the outer layer with the guidance of a 3D virtual model of fruit. In this work, a new cost-effective method of 3D image reconstruction was developed to convert 36 fruit images captured by a normal RGB camera to a 3D model by capturing a single image every 10 degrees of fruit rotation along a fixed axis. The point cloud data extracted with edge detection were passed to Blender 3D software for meshing in different approaches. The vertical link frame meshing method developed in this research proved a qualitative similarity between the output result and the scanned fruit in a processing time of less than 50 seconds.

References:

[1]Kamarubahrin, A.F., Haris, A., Mohd Daud, S.N., et al., 2020. Indigenous alternate fruit for dates: Critical review on the selection criteria for local prophetic fruits in Malaysia. Journal of Tropical Agriculture and Food Science. 48(2), 43-58. [2]Wong, S.S., Aini, M.S., 2017. Factors influencing purchase intention of organic meat among consumers in Klang Valley, Malaysia. International Food Research Journal. 24(2), 767-778. [3]Kohli, D., Champawat, P.S., Mudgal, V.D., et al., 2021. Advances in peeling techniques for fresh produce. Journal of Food Process Engineering. 44(10), e13826.DOI: https://doi.org/10.1111/JFPE.13826 [4]Ham, H., Wesley, J., Hendra, H., 2019. Computer vision based 3D reconstruction: A review. International Journal of Electrical and Computer Engineering. 9(4), 2394-2402. DOI: https://doi.org/10.11591/ijece.v9i4 [5]Wijayanto, I., Hadiyoso, S., Gunawan, T.M., 2018. Video Processing for Dual Laser 3D Scanner Prototype based on Cloud to Cloud Method. In 2018 International Conference on Control, Electronics, Renewable Energy and Communications (ICCEREC). pp. 149-153. IEEE. DOI: https://doi.org/10.1109/ICCEREC.2018.8712107 [6]Zhang, S., 2018. High-speed 3D shape measurement with structured light methods: A review. Optics and Lasers in Engineering. 106, 119-131. DOI: https://doi.org/10.1016/j.optlaseng.2018.02.017 [7]Xie, Z., Lang, Y., Chen, L., 2021. Geometric Modeling of Rosa roxburghii Fruit Based on Three-Dimensional Point Cloud Reconstruction. Journal of Food Quality. DOI: https://doi.org/10.1155/2021/9990499 [8]Zabatani, A., Surazhsky, V., Sperling, E., et al., 2019. Intel® realsense™ sr300 coded light depth camera. IEEE transactions on pattern analysis and machine intelligence. 42(10), 2333-2345. DOI: https://doi.org/10.1109/TPAMI.2019.2915841 [9]Fu, Y., Yan, Q., Yang, L., et al., 2018. Texture mapping for 3d reconstruction with rgb-d sensor. In Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 4645-4653. DOI: https://doi.org/10.1109/CVPR.2018.00488 [10]Yamamoto, S., Karkee, M., Kobayashi, Y., et al., 2018. 3D reconstruction of apple fruits using consumer-grade RGB-depth sensor. Engineering in Agriculture, Environment and Food. 11(4), 159-168. DOI: https://doi.org/10.1016/J.EAEF.2018.02.005 [11]O’Riordan, A., Newe, T., Dooly, G., et al., 2018. Stereo vision sensing: Review of existing systems. In 2018 12th International Conference on Sensing Technology (ICST). pp. 178-184. IEEE. DOI: https://doi.org/10.1109/ICSensT.2018.8603605 [12]Feldmann, M.J., Tabb, A., 2021. Cost-effective, high-throughput phenotyping system for 3D reconstruction of fruit form. The Plant Phenome Journal. DOI: https://doi.org/10.1002/ppj2.20029 [13]Reljić, I., Dunđer, I., Seljan, S., 2019. Photogrammetric 3D scanning of physical objects: tools and workflow. TEM Journal. 8(2), 383. DOI: https://doi.org/10.18421/TEM82-09 [14]Dostal, C., Yamafune, K., 2018. Photogrammetric texture mapping: A method for increasing the Fidelity of 3D models of cultural heritage materials. Journal of Archaeological Science: Reports. 18, 430-436. DOI: https://doi.org/10.1016/j.jasrep.2018.01.024 [15]Li, J., Berglund, J., Auris, F., et al., 2018. Evaluation of Photogrammetry for Use in Industrial Production Systems. In 2018 IEEE 14th International Conference on Automation Science and Engineering (CASE). pp. 414-420. IEEE. DOI: https://doi.org/10.1109/COASE.2018.8560496 [16]Kochi, N., Tanabata, T., Hayashi, A., et al., 2018. A 3D shape-measuring system for assessing strawberry fruits. International Journal of Automation Technology. 12(3), 395-404. DOI: https://doi.org/10.20965/ijat.2018.p0395 [17] Oinosho, T., Kameyama, M., Taguchi, A., 2021. Color Conversion Formulae between RGB Color Space and HSI Color Space for Color Image Processing. In 2021 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS). pp. 1-2. IEEE. DOI: https://doi.org/10.1109/ISPACS51563.2021.9651118

Tags: