Abstract:The integration of new technology with cultural studies enhances our understanding of cultural heritage but often struggles to connect with diverse audiences. It is challenging to align personal interpretations with the intended meanings across different cultures. Our study investigates the important factors in appreciating art from a cross-cultural perspective. We explore the application of Large Language Models (LLMs) to bridge the cultural and language barriers in understanding Traditional Chinese Paintings (TCPs). We present CultiVerse, a visual analytics system that utilizes LLMs within a mixed-initiative framework, enhancing interpretative appreciation of TCP in a cross-cultural dialogue. CultiVerse addresses the challenge of translating the nuanced symbolism in art, which involves interpreting complex cultural contexts, aligning cross-cultural symbols, and validating cultural acceptance. CultiVerse integrates an interactive interface with the analytical capability of LLMs to explore a curated TCP dataset, facilitating the analysis of multifaceted symbolic meanings and the exploration of cross-cultural serendipitous discoveries. Empirical evaluations affirm that CultiVerse significantly improves cross-cultural understanding, offering deeper insights and engaging art appreciation.

What problem does this paper attempt to address?

### The Problem the Paper Attempts to Solve This paper aims to address key issues in cross-cultural understanding, particularly the cultural and linguistic barriers related to Traditional Chinese Painting (TCP). Specifically, the researchers hope to enhance the understanding of TCP by leveraging large language models (LLMs), thereby promoting cultural exchange and mutual understanding among people from different cultural backgrounds. #### Main Issues 1. **Inconsistency between Personal Interpretation and Cultural Intent**: - People from different cultural backgrounds may misinterpret or misunderstand the intent of artworks due to a lack of necessary historical and cultural background knowledge. - This inconsistency not only affects the depth of art appreciation but may also lead to cultural misunderstandings and biases. 2. **Polysemy of Cultural Symbols and Cross-Cultural Differences**: - For example, the lotus flower symbolizes purity and spiritual enlightenment in Traditional Chinese Painting, while in Hindu art, it symbolizes divinity and creation. This polysemy of symbols complicates cross-cultural understanding. - The same symbol may have entirely different meanings in different cultures, such as the dragon symbolizing power and prosperity in Chinese culture but often seen as a threat and evil in Christian culture. 3. **Limitations of Existing Tools**: - Current technologies and tools are often designed for experts and lack user-friendliness and accessibility for the general public. - There is a lack of effective tools to help users understand and verify the meanings of cross-cultural symbols, especially without a deep cultural background. #### Solution To address these challenges, the researchers developed a visual analysis system called CultiVerse. This system utilizes large language models (LLMs) and a hybrid active framework, aiming to: - **Improve the Accuracy of Cross-Cultural Understanding**: By providing accurate cultural background information and symbol interpretations, it reduces cultural misunderstandings. - **Enhance User Experience**: Design an interactive interface that allows users to easily explore and understand the polysemous symbols and cultural phenomena in TCP. - **Promote Cultural Inclusivity**: By generating content that adheres to cultural norms, it ensures the appropriateness and sensitivity of cross-cultural communication. ### Summary Through the CultiVerse system, this paper aims to solve key issues in cross-cultural understanding, particularly the cultural and linguistic barriers related to Traditional Chinese Painting. By leveraging large language models and a hybrid active framework, the CultiVerse system improves the accuracy of cross-cultural understanding and user experience, promoting effective communication and mutual understanding among people from different cultural backgrounds.

CultiVerse: Towards Cross-Cultural Understanding for Paintings with Large Language Model

ColorNetVis: an Interactive Color Network Analysis System for Exploring the Color Composition of Traditional Chinese Painting

Crossroads of Continents: Automated Artifact Extraction for Cultural Adaptation with Large Multimodal Models

Toward Cultural Interpretability: A Linguistic Anthropological Framework for Describing and Evaluating Large Language Models (LLMs)

Computational Approaches for Traditional Chinese Painting: From the "Six Principles of Painting" Perspective

CoVis: A Collaborative Framework for Fine-grained Graphic Visual Understanding

CulturePark: Boosting Cross-cultural Understanding in Large Language Models

The Application of Large Language Models Reducing Cultural Barriers in International Trade: A Perspective from Cultural Conflicts, Potential and Obstacles

CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies

CDEval: A Benchmark for Measuring the Cultural Dimensions of Large Language Models

TongGu: Mastering Classical Chinese Understanding with Knowledge-Grounded Large Language Models

Exploring Visual Culture Awareness in GPT-4V: A Comprehensive Probing

How Well Do LLMs Identify Cultural Unity in Diversity?

A novel automatic image segmentation method for Chinese literati paintings using multi-view fuzzy clustering technology

Beyond Text: Frozen Large Language Models in Visual Signal Comprehension

Beyond Sight: Towards Cognitive Alignment in LVLM via Enriched Visual Knowledge

Exploring the Potential of Large Language Models in Artistic Creation: Collaboration and Reflection on Creative Programming

AC-EVAL: Evaluating Ancient Chinese Language Understanding in Large Language Models

Is Translation All You Need? A Study on Solving Multilingual Tasks with Large Language Models

Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Research