Delighting Palates with AI: Reinforcement Learning's Triumph in Crafting Personalized Meal Plans with High User Acceptance

Maryam Amiri,Fatemeh Sarani Rad,Juan Li

DOI: https://doi.org/10.3390/nu16030346

IF: 5.9

2024-01-25

Nutrients

Abstract:Eating, central to human existence, is influenced by a myriad of factors, including nutrition, health, personal taste, cultural background, and flavor preferences. The challenge of devising personalized meal plans that effectively encompass these dimensions is formidable. A crucial shortfall in many existing meal-planning systems is poor user adherence, often stemming from a disconnect between the plan and the user's lifestyle, preferences, or unseen eating patterns. Our study introduces a pioneering algorithm, CFRL, which melds reinforcement learning (RL) with collaborative filtering (CF) in a unique synergy. This algorithm not only addresses nutritional and health considerations but also dynamically adapts to and uncovers latent user eating habits, thereby significantly enhancing user acceptance and adherence. CFRL utilizes Markov decision processes (MDPs) for interactive meal recommendations and incorporates a CF-based MDP framework to align with broader user preferences, translated into a shared latent vector space. Central to CFRL is its innovative reward-shaping mechanism, rooted in multi-criteria decision-making that includes user ratings, preferences, and nutritional data. This results in versatile, user-specific meal plans. Our comparative analysis with four baseline methods showcases CFRL's superior performance in key metrics like user satisfaction and nutritional adequacy. This research underscores the effectiveness of combining RL and CF in personalized meal planning, marking a substantial advancement over traditional approaches.

nutrition & dietetics

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper aims to address several key issues in personalized meal planning:

1. **Poor User Compliance**: Many existing meal planning systems fail to adequately consider users' personal lifestyles, preferences, or potential dietary habits during design, leading to poor user compliance. This not only affects the effectiveness of the system but also reduces user satisfaction.

2. **Balance of Nutritional and Health Needs**: Traditional meal planning systems typically focus on meeting basic nutritional and health needs but often overlook users' personal tastes and cultural backgrounds, making the recommended meal plans less appealing.

3. **Lack of Dynamic Adaptability**: Most existing systems generate meal plans based on predefined rules and standards, lacking flexibility and dynamic adaptability, and are unable to make real-time adjustments according to user changes.

4. **Limitations of Data-Driven Methods**: Although some systems use data-driven methods such as collaborative filtering to generate meal plans, these methods rely on the quality and quantity of user data, are prone to cold start problems, and lack transparency, affecting user trust.

### Solution

To address the above issues, the authors propose an innovative algorithm—CFRL (Collaborative Filtering and Reinforcement Learning), which combines reinforcement learning (RL) and collaborative filtering (CF) technologies, specifically including the following aspects:

1. **Dynamic Adaptability**: Through reinforcement learning, the system can continuously optimize the recommended meal plans based on user feedback, making them more in line with users' personal tastes and dietary habits.

2. **Multi-Criteria Decision Mechanism**: CFRL adopts a multi-criteria decision mechanism that comprehensively considers user ratings, preferences, and nutritional data, ensuring that the recommended meals are both nutritionally balanced and in line with users' personal preferences.

3. **Combination of Collaborative Filtering and Reinforcement Learning**: By utilizing collaborative filtering technology, the system can capture users' potential preferences and convert them into low-dimensional embedding vectors, further enhancing the personalization of recommendations. Meanwhile, the reinforcement learning algorithm optimizes the recommended meal plans through the Q-learning method, improving user acceptance and satisfaction.

4. **Real-Time Feedback Mechanism**: The system introduces the concept of "human-in-the-loop," allowing users to provide real-time feedback, thereby continuously improving and adjusting the recommended meal plans, achieving dynamic interaction.

Through these innovations, the CFRL algorithm demonstrates significant advantages in user satisfaction, nutritional balance, and user acceptance, marking a major advancement in the field of personalized meal planning.