Abstract:Worldwide, in 2014, more than 1.9 billion adults, 18 years and older, were overweight. Of these, over 600 million were obese. Accurately documenting dietary caloric intake is crucial to manage weight loss, but also presents challenges because most of the current methods for dietary assessment must rely on memory to recall foods eaten. The ultimate goal of our research is to develop computer-aided technical solutions to enhance and improve the accuracy of current measurements of dietary intake. Our proposed system in this paper aims to improve the accuracy of dietary assessment by analyzing the food images captured by mobile devices (e.g., smartphone). The key technique innovation in this paper is the deep learning-based food image recognition algorithms. Substantial research has demonstrated that digital imaging accurately estimates dietary intake in many environments and it has many advantages over other methods. However, how to derive the food information (e.g., food type and portion size) from food image effectively and efficiently remains a challenging and open research problem. We propose a new Convolutional Neural Network (CNN)-based food image recognition algorithm to address this problem. We applied our proposed approach to two real-world food image data sets (UEC-256 and Food-101) and achieved impressive results. To the best of our knowledge, these results outperformed all other reported work using these two data sets. Our experiments have demonstrated that the proposed approach is a promising solution for addressing the food image recognition problem. Our future work includes further improving the performance of the algorithms and integrating our system into a real-world mobile and cloud computing-based system to enhance the accuracy of current measurements of dietary intake.

Food Photo Recognition for Dietary Tracking: System and Experiment

DeepFood: Deep Learning-Based Food Image Recognition for Computer-Aided Dietary Assessment

Smart Diet Diary: Real-Time Mobile Application for Food Recognition

Visual Food Recognition for Dietary Logging and Health Monitoring

FoodAI: Food Image Recognition via Deep Learning for Smart Food Logging

A Comprehensive Survey of Image-Based Food Recognition and Volume Estimation Methods for Dietary Assessment

Eliminate the hardware: Mobile terminals-oriented food recognition and weight estimation system

MyFood: A Food Segmentation and Classification System to Aid Nutritional Monitoring

Food Recognition and Dietary Assessment for Healthcare System at Mobile Device End Using Mask R-CNN

A New Deep Learning-Based Food Recognition System for Dietary Assessment on an Edge Computing Service Infrastructure

I Ate This: A Photo-based Food Journaling System with Expert Feedback

Mobile Computer Vision-Based Applications for Food Recognition and Volume and Calorific Estimation: A Systematic Review

Study for Food Recognition System Using Deep Learning

An Intelligent Passive Food Intake Assessment System with Egocentric Cameras

The Deep Features and Attention Mechanism-Based Method to Dish Healthcare Under Social IoT Systems: An Empirical Study With a Hand-Deep Local–Global Net

The Nutritional Content of Meal Images in Free-Living Conditions-Automatic Assessment with goFOODTM

Mobile Multi-Food Recognition Using Deep Learning

goFOODTM: An Artificial Intelligence System for Dietary Assessment

Improving Food Detection For Images From a Wearable Egocentric Camera

MyDietCam: Development and usability study of a food recognition integrated dietary monitoring smartphone application

Food Detection and Calorie Estimation using Deep Learning