Abstract:Malnutrition, including both undernutrition and obesity, is a significant problem in low- and middle-income countries (LMICs). In order to study malnutrition and develop effective intervention strategies, it is crucial to evaluate nutritional status in LMICs at the individual, household, and community levels. In a multinational research project supported by the Bill & Melinda Gates Foundation, we have been using a wearable technology to conduct objective dietary assessment in sub-Saharan Africa. Our assessment includes multiple diet-related activities in urban and rural families, including food sources (e.g., shopping, harvesting, and gathering), preservation/storage, preparation, cooking, and consumption (e.g., portion size and nutrition analysis). Our wearable device ("eButton" worn on the chest) acquires real-life images automatically during wake hours at preset time intervals. The recorded images, in amounts of tens of thousands per day, are post-processed to obtain the information of interest. Although we expect future Artificial Intelligence (AI) technology to extract the information automatically, at present we utilize AI to separate the acquired images into two binary classes: images with (Class 1) and without (Class 0) edible items. As a result, researchers need only to study Class-1 images, reducing their workload significantly. In this paper, we present a composite machine learning method to perform this classification, meeting the specific challenges of high complexity and diversity in the real-world LMIC data. Our method consists of a deep neural network (DNN) and a shallow learning network (SLN) connected by a novel probabilistic network interface layer. After presenting the details of our method, an image dataset acquired from Ghana is utilized to train and evaluate the machine learning system. Our comparative experiment indicates that the new composite method performs better than the conventional deep learning method assessed by integrated measures of sensitivity, specificity, and burden index, as indicated by the Receiver Operating Characteristic (ROC) curve.

DLMDish: Using Applied Deep Learning and Computer Vision to Automatically Classify Mauritian Dishes

Deep-Learning-Assisted Multi-Dish Food Recognition Application for Dietary Intake Reporting

Study for Food Recognition System Using Deep Learning

DeepFood: Deep Learning-Based Food Image Recognition for Computer-Aided Dietary Assessment

Dish detection in food platters: A framework for automated diet logging and nutrition management

Food Image Classification and Calorie Prediction for Dietary Analysis

Application of Deep Learning in Automated Meal Recognition

Food Detection and Calorie Estimation using Deep Learning

Hybrid Deep Learning Algorithm-Based Food Recognition and Calorie Estimation

Eating Smart: Advancing Health Informatics with the Grounding DINO based Dietary Assistant App

An Optimized Recurrent Neural Network for re-modernize food dining bowls and estimating food capacity from images

Smart Diet Diary: Real-Time Mobile Application for Food Recognition

Visual Food Recognition for Dietary Logging and Health Monitoring

Bio-Inspired Spotted Hyena Optimizer with Deep Convolutional Neural Network-Based Automated Food Image Classification

A Model for Automated Food Logging Through Food Recognition and Attribute Estimation Using Deep Learning

DeepFood: Food Image Analysis and Dietary Assessment Via Deep Model.

Food/Non-Food Classification of Real-Life Egocentric Images in Low- and Middle-Income Countries Based on Image Tagging Features

Fine-grained food image classification and recipe extraction using a customized deep neural network and NLP

Application of Deep Learning for Image-Based Chinese Market Food Nutrients Estimation.

MWSMO: Multi-objective Whale Slime Mold Optimization based Food Recommendation system for Diabetes patient using GAN model

Food Recipe Recommendation Based on Ingredients Detection Using Deep Learning