CookingSense: A Culinary Knowledgebase with Multidisciplinary Assertions

Donghee Choi,Mogan Gim,Donghyeon Park,Mujeen Sung,Hyunjae Kim,Jaewoo Kang,Jihun Choi
2024-05-01
Abstract:This paper introduces CookingSense, a descriptive collection of knowledge assertions in the culinary domain extracted from various sources, including web data, scientific papers, and recipes, from which knowledge covering a broad range of aspects is acquired. CookingSense is constructed through a series of dictionary-based filtering and language model-based semantic filtering techniques, which results in a rich knowledgebase of multidisciplinary food-related assertions. Additionally, we present FoodBench, a novel benchmark to evaluate culinary decision support systems. From evaluations with FoodBench, we empirically prove that CookingSense improves the performance of retrieval augmented language models. We also validate the quality and variety of assertions in CookingSense through qualitative analysis.
Artificial Intelligence,Computation and Language
What problem does this paper attempt to address?
### Problems the paper attempts to solve This paper aims to construct a comprehensive and multidisciplinary cooking knowledge base, **CookingSense**, to solve the problems of limited coverage, single data source and insufficient semantic expression in existing cooking knowledge resources. Specifically: 1. **Multidisciplinary knowledge coverage**: Existing cooking knowledge resources often focus only on specific aspects, such as recipes, nutrition or health care, and fail to cover a wide range of topics in the cooking field. **CookingSense** extracts knowledge from multiple sources (including network data, scientific papers and recipes), covering food common sense, cooking art, health and nutrition, diet culture, food management and food safety, etc. 2. **High - quality knowledge extraction**: To ensure the quality of the knowledge base, the paper adopts dictionary - based filtering and language - model - based semantic filtering techniques to extract high - quality knowledge assertions. 3. **Evaluation tool**: To evaluate the performance of **CookingSense**, the paper also proposes a new benchmark framework, **FoodBench**, for evaluating the knowledge capture ability of cooking decision - support systems. **FoodBench** includes multiple evaluation tasks, such as flavor prediction, ingredient classification and cooking Q&A, etc. 4. **Improve model performance**: Through experimental verification, **CookingSense** can significantly improve the performance of retrieval - enhanced language models (such as Flan - T5) in cooking - related tasks. ### Main contributions 1. **Construct the **CookingSense** knowledge base**: A large - scale, multidisciplinary cooking knowledge base containing rich food - related information. 2. **Develop the **FoodBench** benchmark framework**: For evaluating the capabilities of cooking decision - support systems, covering multiple evaluation tasks. 3. **Performance comparison**: By comparing with existing general and cooking - domain knowledge bases, prove the effectiveness of **CookingSense** in improving language model performance. ### Experimental results The experimental results show that the retrieval - enhanced language model using **CookingSense** as a knowledge source performs better than other knowledge bases on multiple tasks. The specific results are shown in the following table: | Dataset | CSQA | ASCENT++ | TGSC | CKQ | FORK | Average | | ------- | ---- | -------- | ---- | ---- | ---- | ------ | | No context | 16.08 | 24.52 | 13.60 | 14.38 | 28.80 | 19.48 | | ConceptNet | 47.79 | 22.90 | 47.60 | 54.25 | 46.20 | 43.75 | | FooDB | 48.25 | 20.97 | 45.80 | 52.29 | 58.70 | 45.20 | | CANDLE | 48.48 | 41.29 | 51.40 | 54.58 | 39.67 | 47.08 | | Quasimodo | 50.35 | 40.65 | 63.40 | 53.59 | 53.80 | 52.36 | | CookingSense (Web) | 70.63 | 59.35 | 65.80 | 66.99 | 51.09 | 62.77 | | CookingSense (Recipe) | 56.88 | 54.84 | 68.60 | 51.63 | 50.00 | 56.41 | | CookingSense (Paper) | 51.52 | 20.32 | 52.00 | 52.29 | 57.07 | 46.64 | | CookingSense (All) | 68.30 | 56.77 | 65.40 | 64.38 | 50.00 | 60.97 |