Eliminate the hardware: Mobile terminals-oriented food recognition and weight estimation system
Qinqiu Zhang,Chengyuan He,Wen Qin,Decai Liu,Jun Yin,Zhiwen Long,Huimin He,Ho Ching Sun,Huilin Xu
DOI: https://doi.org/10.3389/fnut.2022.965801
IF: 5
2022-11-21
Frontiers in Nutrition
Abstract:Food recognition and weight estimation based on image method have always been hotspots in the field of computer vision and medical nutrition, and have good application prospects in digital nutrition therapy and health detection. With the development of deep learning technology, image-based recognition technology has also rapidly extended to various fields, such as agricultural pests, disease identification, tumor marker recognition, wound severity judgment, road wear recognition, and food safety detection. This paper proposes a non-wearable food recognition and weight estimation system (nWFWS) to identify food type and food weight in the target recognition area via smartphones, so to assist clinical patients and physicians in monitoring diet-related health conditions. In addition, the system is mainly designed for mobile terminals, it can be installed on a mobile phone with an Android system or an iOS system. Which can reduce the cost and burden of additional wearable health monitoring equipment, and greatly simplify the automatic estimation of food intake through mobile phone photography and image collection. Based on the ability to accurately identify 1455 food pictures in the system, and the accuracy rate reached 89.60%; we further use a deep convolutional neural network and visual-inertial system to collect image pixels, and 612 high-resolution food images with different traits After systematic training, a preliminary relationship model between the area of food pixels and the measured weight was obtained, and the weight of untested food images was successfully determined. There was a high correlation between the predicted and actual values, R2 = 0.936. In a word, this system is feasible and relatively accurate for one of automated dietary monitoring and nutritional assessment.
nutrition & dietetics