Abstract:In this work, we research user preferences to see a chart, table, or text given a question asked by the user. This enables us to understand when it is best to show a chart, table, or text to the user for the specific question. For this, we conduct a user study where users are shown a question and asked what they would prefer to see and used the data to establish that a user's personal traits does influence the data outputs that they prefer. Understanding how user characteristics impact a user's preferences is critical to creating data tools with a better user experience. Additionally, we investigate to what degree an LLM can be used to replicate a user's preference with and without user preference data. Overall, these findings have significant implications pertaining to the development of data tools and the replication of human preferences using LLMs. Furthermore, this work demonstrates the potential use of LLMs to replicate user preference data which has major implications for future user modeling and personalization research.

What problem does this paper attempt to address?

The problems that this paper attempts to solve are: How to optimize the data presentation methods (charts, tables or texts) according to users' preferences, so as to improve users' understanding and utilization efficiency of data. Specifically, the research aims to answer the following questions: 1. **Which data presentation method do users generally prefer?** - The paper investigates through surveys which form of presentation - tables, texts or charts - users prefer to see when faced with a data problem. 2. **Do users' personal characteristics affect their preferences for data presentation methods?** - The research explores how users' personal characteristics (such as data visualization experience, data analysis experience, age, etc.) affect their preferences for different data presentation methods. 3. **Do users' job roles and industries affect their preferences for data presentation methods?** - The research analyzes whether users' job roles and the industries they are in will affect their preferences for charts, tables or texts. 4. **Can large - language models (LLM) predict users' preferences for data presentation methods?** - The research tests whether LLM can accurately predict users' preferences for different data presentation methods with or without users' preference data. Through the research on these questions, the paper hopes to provide theoretical support for the development of more personalized and more intuitive data tools, and explore how to use LLM to better simulate and meet users' preferences. ### Key Contributions - **Comprehensive user surveys and method design**: It describes in detail the key components of the Amazon Mechanical Turk survey, including the surveyed population, survey settings, specific questions and guidance instructions. - **Analysis of general data output preferences**: It explores the preferences of the general population for different data presentation methods without considering user characteristics. - **Analysis of data output preferences based on personal characteristics**: It studies how users' personal characteristics (such as data analysis and visualization experience, age) affect their data presentation preferences. - **Analysis of data output preferences based on work experience**: It explores the impact of users' job roles and industries on their data presentation preferences. - **Comparison of human and GPT preferences**: It uses the GPT model to predict user preferences and evaluates its accuracy. These research results are of great significance for the development of more personalized and more efficient data tools, and provide new ideas for future user modeling and personalization research.

Optimizing Data Delivery: Insights from User Preferences on Visuals, Tables, and Text

User Preference Quantity Versus Recommendation Performance: A Preliminary Study

Comparison of Perceptual Differences Between Users and Designers in Mobile Shopping App Interface Design: Implications for Evaluation Practice

A Probabilistic Approach for Extracting Design Preferences from Design Team Discussion

Optimizing New User Experience in Online Services.

PersonalLLM: Tailoring LLMs to Individual Preferences

Optimizing LLMs with Direct Preferences: A Data Efficiency Perspective

Analyzing LLMs' Capabilities to Establish Implicit User Sentiment of Software Desirability

Enhancing Data Literacy On-demand: LLMs as Guides for Novices in Chart Interpretation

Intuitive Data Visualization for Enhanced Patient Comprehension

Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Data

Dissecting Human and LLM Preferences

How Aligned are Human Chart Takeaways and LLM Predictions? A Case Study on Bar Charts with Varying Layouts

"It Explains What I am Currently Going Through Perfectly to a Tee": Understanding User Perceptions on LLM-Enhanced Narrative Interventions

Using LLMs to Model the Beliefs and Preferences of Targeted Populations

Data-Centric Human Preference Optimization with Rationales

Learning Preferences and User Engagement Using Choice and Time Data

Uncovering Factor Level Preferences to Improve Human-Model Alignment

Unveiling User Preferences: A Knowledge Graph and LLM-Driven Approach for Conversational Recommendation

Towards Data-Centric RLHF: Simple Metrics for Preference Dataset Comparison

BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Data