Knowledge Graphs in Practice: Characterizing their Users, Challenges, and Visualization Opportunities

Harry Li,Gabriel Appleby,Camelia Daniela Brumar,Remco Chang,Ashley Suh

DOI: https://doi.org/10.1109/TVCG.2023.3326904

2024-06-19

Abstract:This study presents insights from interviews with nineteen Knowledge Graph (KG) practitioners who work in both enterprise and academic settings on a wide variety of use cases. Through this study, we identify critical challenges experienced by KG practitioners when creating, exploring, and analyzing KGs that could be alleviated through visualization design. Our findings reveal three major personas among KG practitioners - KG Builders, Analysts, and Consumers - each of whom have their own distinct expertise and needs. We discover that KG Builders would benefit from schema enforcers, while KG Analysts need customizable query builders that provide interim query results. For KG Consumers, we identify a lack of efficacy for node-link diagrams, and the need for tailored domain-specific visualizations to promote KG adoption and comprehension. Lastly, we find that implementing KGs effectively in practice requires both technical and social solutions that are not addressed with current tools, technologies, and collaborative workflows. From the analysis of our interviews, we distill several visualization research directions to improve KG usability, including knowledge cards that balance digestibility and discoverability, timeline views to track temporal changes, interfaces that support organic discovery, and semantic explanations for AI and machine learning predictions.

Human-Computer Interaction,Databases,Machine Learning

What problem does this paper attempt to address?

The paper attempts to address the user needs, challenges, and visualization opportunities of Knowledge Graphs (KGs) in practical applications. Specifically, the study explores the following points through interviews with 19 knowledge graph practitioners from different organizations:

1. **User Roles**: Identifies three main user roles of knowledge graphs—Builders, Analysts, and Consumers. Each role has its unique expertise and needs.
- **Builders**: Responsible for creating and maintaining knowledge graphs, typically possessing expertise in database systems, data management, and data modeling.
- **Analysts**: Responsible for extracting insights from knowledge graphs, usually with expertise in data science or machine learning.
- **Consumers**: Typically domain experts who rely on analysts or automated reporting systems to generate insights.

2. **Common Challenges**:
- **Query Difficulties**: Builders need better schema enforcement tools, and analysts need customizable query builders to provide intermediate query results.
- **Data Quality Issues**: Including poor management of data sources, schema inconsistencies, etc.
- **Insufficient Visualization**: Node-link diagrams are ineffective for generating and conveying insights for large knowledge graphs, necessitating domain-specific visualization methods.

3. **Visualization Needs**:
- **Improving Usability**: Proposes new visualization research directions, such as knowledge cards (balancing digestibility and discoverability), timeline views (tracking temporal changes), interfaces supporting organic exploration, and semantic explanations.
- **Meeting Different User Needs**: Different user roles require different visualization solutions, especially those that facilitate communication with various audiences through higher levels of abstraction.

4. **Socio-Technical Challenges**:
- **Understanding Goals**: When users' expectations of the knowledge graph are unclear, builders may overcomplicate the construction of the knowledge graph, analysts may struggle to provide relevant insights, and consumers may perceive the knowledge graph as having no practical value for their tasks.

Overall, the paper aims to reveal the user needs, challenges, and potential visualization improvements of knowledge graphs in practical applications through in-depth interviews and analysis, thereby promoting the broader application of knowledge graphs across various fields.