Survey on artificial intelligence approaches for visualization data

Aoyu Wu, Yun Wang, Xinhuan Shu, Dominik Moritz, Weiwei Cui, Haidong Zhang, Dongmei Zhang, Huamin Qu

2021-01-01

Abstract:

What problem does this paper attempt to address?

AI4VIS: Survey on Artificial Intelligence Approaches for Data Visualization

Aoyu Wu,Yun Wang,Xinhuan Shu,Dominik Moritz,Weiwei Cui,Haidong Zhang,Dongmei Zhang,Huamin Qu

DOI: https://doi.org/10.1109/tvcg.2021.3099002

IF: 5.2

2021-01-01

IEEE Transactions on Visualization and Computer Graphics

Abstract:Visualizations themselves have become a data format. Akin to other data formats such as text and images, visualizations are increasingly created, stored, shared, and (re-)used with artificial intelligence (AI) techniques. In this survey, we probe the underlying vision of formalizing visualizations as an emerging data format and review the recent advance in applying AI techniques to visualization data (AI4VIS). We define visualization data as the digital representations of visualizations in computers and focus on data visualization (e.g., charts and infographics). We build our survey upon a corpus spanning ten different fields in computer science with an eye toward identifying important common interests. Our resulting taxonomy is organized around WHAT is visualization data and its representation, WHY and HOW to apply AI to visualization data. We highlight a set of common tasks that researchers apply to the visualization data and present a detailed discussion of AI approaches developed to accomplish those tasks. Drawing upon our literature review, we discuss several important research questions surrounding the management and exploitation of visualization data, as well as the role of AI in support of those processes. We make the list of surveyed papers and related material available online at.

computer science, software engineering
An overview of visual intelligent tools based on artificial intelligence

Yan Shu

DOI: https://doi.org/10.61173/yyy6af60

2024-06-06

Abstract:In recent years, data visualization technology has received widespread attention, offering users a way to gain an in-depth understanding and effective exploration of various datasets by visualizing their composition and characteristics. Simultaneously, with the continuous development of hardware and algorithms, artificial intelligence (AI) has permeated every aspect of contemporary social life. Some studies have proposed the use of intelligent visualization tools that leverage AI to achieve significant results in data analysis, decision support, and automated reporting. However, there is a lack of systematic work to summarize and analyze these literature. In this paper, we conduct a comprehensive review of AI-based intelligent visualization tools and their applications in various domains. Firstly, we introduced the foundational concepts of AI and data visualization and explored the relationship between these two. we provided an overview of prevalent AI-based intelligent visualization tools along with their diverse applications. Our discussion encompassed renowned tools like Tableau, Power BI, QlikView, D3.js, IBM Watson Analytics, and FusionCharts, delving into their distinctive features, functionalities, and practical implementations. Furthermore, we have explored the advantages and challenges of AI-integrated visualization. The advantages include enhanced data understanding and insights, as well as automation of analysis and visualization generation. Some challenges coexist in the meantime, including data quality and accuracy, privacy and security concerns, and user experience and usability issues. Based on our findings, we have added a great deal to the corpus of knowledge by giving a thorough rundown of visualization tools with AI integration and their possible uses. We have also identified existing issues and limitations that need to be addressed for further advancements in this field. Lastly, we have proposed future research directions and development trends to guide researchers and practitioners in fully harnessing the potential of AI and visualization.
A Survey on Interdisciplinary Research of Visualization and Artificial Intelligence

Jiazhi XIA,Jie LI,Siming CHEN,Hongxing QIN,Shixia LIU

DOI: https://doi.org/10.1360/ssi-2021-0062

2021-01-01

Scientia Sinica Informationis

Abstract:With the breakthroughs in artificial intelligence (AI) technology, interdisciplinary research across AI and visualization (AI+VIS) has become one of the current research hotspots, providing inspiring theories, methods, and techniques for several core challenges in AI and big data analytics. On one hand, the innovative application of artificial intelligence technology has improved the efficiency of visualization, expanded the analysis capabilities, and provided powerful tools for big data visualization and analysis. On the other hand, visualization techniques enhance the explainability and interactivity of AI represented by deep learning, providing a reliable technical foundation for explainable AI. This paper introduces six important topics, including data quality improvement, explainable machine learning, intelligent feature extraction, automatic visualization layout and generation, intelligent interaction, and intelligent storytelling from two directions of “VIS for AI” and “AI for VIS”, respectively. The research progress in the recent three years is analyzed. We also highlight the research trends of AI+VIS.
Generative AI for Visualization: State of the Art and Future Directions

Yilin Ye,Jianing Hao,Yihan Hou,Zhan Wang,Shishi Xiao,Yuyu Luo,Wei Zeng

2024-04-28

Abstract:Generative AI (GenAI) has witnessed remarkable progress in recent years and demonstrated impressive performance in various generation tasks in different domains such as computer vision and computational design. Many researchers have attempted to integrate GenAI into visualization framework, leveraging the superior generative capacity for different operations. Concurrently, recent major breakthroughs in GenAI like diffusion model and large language model have also drastically increase the potential of GenAI4VIS. From a technical perspective, this paper looks back on previous visualization studies leveraging GenAI and discusses the challenges and opportunities for future research. Specifically, we cover the applications of different types of GenAI methods including sequence, tabular, spatial and graph generation techniques for different tasks of visualization which we summarize into four major stages: data enhancement, visual mapping generation, stylization and interaction. For each specific visualization sub-task, we illustrate the typical data and concrete GenAI algorithms, aiming to provide in-depth understanding of the state-of-the-art GenAI4VIS techniques and their limitations. Furthermore, based on the survey, we discuss three major aspects of challenges and research opportunities including evaluation, dataset, and the gap between end-to-end GenAI and generative algorithms. By summarizing different generation algorithms, their current applications and limitations, this paper endeavors to provide useful insights for future GenAI4VIS research.

Machine Learning,Artificial Intelligence,Human-Computer Interaction
A Survey on Information Visualization: Recent Advances and Challenges

Shixia Liu,Weiwei Cui,Yingcai Wu,Mengchen Liu

DOI: https://doi.org/10.1007/s00371-013-0892-3

IF: 2.835

2014-01-01

The Visual Computer

Abstract:Information visualization (InfoVis), the study of transforming data, information, and knowledge into interactive visual representations, is very important to users because it provides mental models of information. The boom in big data analytics has triggered broad use of InfoVis in a variety of domains, ranging from finance to sports to politics. In this paper, we present a comprehensive survey and key insights into this fast-rising area. The research on InfoVis is organized into a taxonomy that contains four main categories, namely empirical methodologies, user interactions, visualization frameworks, and applications, which are each described in terms of their major goals, fundamental principles, recent trends, and state-of-the-art approaches. At the conclusion of this survey, we identify existing technical challenges and propose directions for future research.
Visualization and Visual Analytics Approaches for Image and Video Datasets: A Survey

Shehzad Afzal,Sohaib Ghani,Mohamad Mazen Hittawe,Sheikh Faisal Rashid,Omar M. Knio,Markus Hadwiger,Ibrahim Hoteit

DOI: https://doi.org/10.1145/3576935

IF: 3.4

2023-03-09

ACM Transactions on Interactive Intelligent Systems

Abstract:Image and video data analysis has become an increasingly important research area with applications in different domains such as security surveillance, healthcare, augmented and virtual reality, video and image editing, activity analysis and recognition, synthetic content generation, distance education, telepresence, remote sensing, sports analytics, art, non-photorealistic rendering, search engines, and social media. Recent advances in Artificial Intelligence (AI) and particularly deep learning have sparked new research challenges and led to significant advancements, especially in image and video analysis. These advancements have also resulted in significant research and development in other areas such as visualization and visual analytics, and have created new opportunities for future lines of research. In this survey article, we present the current state of the art at the intersection of visualization and visual analytics, and image and video data analysis. We categorize the visualization articles included in our survey based on different taxonomies used in visualization and visual analytics research. We review these articles in terms of task requirements, tools, datasets, and application areas. We also discuss insights based on our survey results, trends and patterns, the current focus of visualization research, and opportunities for future research.

computer science, artificial intelligence
VIS+AI: integrating visualization with artificial intelligence for efficient data analysis

DOI: https://doi.org/10.1007/s11704-023-2691-y

IF: 2.6688

2023-06-08

Frontiers of Computer Science

Abstract:Visualization and artificial intelligence (AI) are well-applied approaches to data analysis. On one hand, visualization can facilitate humans in data understanding through intuitive visual representation and interactive exploration. On the other hand, AI is able to learn from data and implement bulky tasks for humans. In complex data analysis scenarios, like epidemic traceability and city planning, humans need to understand large-scale data and make decisions, which requires complementing the strengths of both visualization and AI. Existing studies have introduced AI-assisted visualization as AI4VIS and visualization-assisted AI as VIS4AI. However, how can AI and visualization complement each other and be integrated into data analysis processes are still missing. In this paper, we define three integration levels of visualization and AI. The highest integration level is described as the framework of VIS+AI, which allows AI to learn human intelligence from interactions and communicate with humans through visual interfaces. We also summarize future directions of VIS+AI to inspire related studies.

computer science, information systems, theory & methods, software engineering
Visual Analytics for Machine Learning: A Data Perspective Survey

Junpeng Wang,Shixia Liu,Wei Zhang

DOI: https://doi.org/10.1109/tvcg.2024.3357065

IF: 5.2

2024-01-01

IEEE Transactions on Visualization and Computer Graphics

Abstract:The past decade has witnessed a plethora of works that leverage the power of visualization (VIS) to interpret machine learning (ML) models. The corresponding research topic, VIS4ML, keeps growing at a fast pace. To better organize the enormous works and shed light on the developing trend of VIS4ML, we provide a systematic review of these works through this survey. Since data quality greatly impacts the performance of ML models, our survey focuses specifically on summarizing VIS4ML works from the data perspective. First, we categorize the common data handled by ML models into five types, explain the unique features of each type, and highlight the corresponding ML models that are good at learning from them. Second, from the large number of VIS4ML works, we tease out six tasks that operate on these types of data (i.e., data-centric tasks) at different stages of the ML pipeline to understand, diagnose, and refine ML models. Lastly, by studying the distribution of 143 surveyed papers across the five data types, six data-centric tasks, and their intersections, we analyze the prospective research directions and envision future research trends.

computer science, software engineering
Visualization Research Frontier and Prospect

Yuan Xiaoru,Zhang Xin,Xiao He,Guo Hanqi

2011-01-01

Abstract:In this article we survey the basic concepts of visualization and its historical development. More details are given on the introduction of each sub-domain of visualization research: scientific visualization, information visualization and visual analytics respectively. Examples are given to illustrate the new development in this area. The case studies include the visualization and visual analytics on atmosphere simulation data, earthquake catalog data, and traffic trajectory data. Through exploration on these cases, we illustrated new approaches of analyzing and interoperating the massive amount of high dimensional data produced by measurement or computation. General strategies of visualizing such kind of data are discussed.
A Survey on Immersive Visualization

Ye Shuainan,Chu Xiangtong,Wu Yingcai

DOI: https://doi.org/10.3724/sp.j.1089.2021.18809

2021-01-01

Abstract:: Immersive visualization is an emerging research field. It aims to make full use of human perception and operation capabilities through the immersion and engagement offered by the immersive interface to support data analysis, reasoning, and decision-making. The latest research on immersive visualization is re-viewed. Firstly, the design and evaluation of the visual and non-visual perception in information visualization are introduced. Secondly, the newest interaction methods from the aspects of touch, gesture, gaze, and navigation are summarized. Afterward, the visualization authoring toolkit in terms of desktop, mobile, and mix terminals is overviewed. Finally, the industry trends, applications, and challenges of immersive visualization are discussed.
Visualization Assessment - A Machine Learning Approach.

Xin Fu,Yun Wang,Haoyu Dong,Weiwei Cui,Haidong Zhang

DOI: https://doi.org/10.1109/VISUAL.2019.8933570

2019-01-01

Abstract:Researchers assess visualizations from multiple aspects, such as aesthetics, memorability, engagement, and efficiency. However, these assessments are mostly carried out through user studies. There is a lack of automatic visualization assessment approaches, which hinders further applications like visualization recommendation, indexing, and generation. In this paper, we propose automating the visualization assessment process with modern machine learning approaches. We utilize a semi-supervised learning method, which first employs Variational Autoencoder (VAE) to learn effective features from visualizations, subsequently training machine learning models for different assessment tasks. Then, we can automatically assess new visualization images by predicting their scores or rankings with the trained model. To evaluate our method, we run two different assessment tasks, namely, aesthetics and memorability, on different visualization datasets. Experiments show that our method can learn effective visual features and achieves good performance on these assessment tasks.
A Tour of Visualization Techniques for Computer Vision Datasets

Bilal Alsallakh,Pamela Bhattacharya,Vanessa Feng,Narine Kokhlikyan,Orion Reblitz-Richardson,Rahul Rajan,David Yan

2022-04-19

Abstract:We survey a number of data visualization techniques for analyzing Computer Vision (CV) datasets. These techniques help us understand properties and latent patterns in such data, by applying dataset-level analysis. We present various examples of how such analysis helps predict the potential impact of the dataset properties on CV models and informs appropriate mitigation of their shortcomings. Finally, we explore avenues for further visualization techniques of different modalities of CV datasets as well as ones that are tailored to support specific CV tasks and analysis needs.

Computer Vision and Pattern Recognition,Graphics
Designing Data Visualization Using Artificial Intelligence for Urban Intelligent Transportation Scenarios

Xuan Yang,Zhiyan Pu,Lei Zhang

DOI: https://doi.org/10.1155/2022/3967267

2022-08-28

Mobile Information Systems

Abstract:Artificial intelligence refers to a simulation extension and expansion technology that has found its presence in various applications and research domains. Artificial intelligence allows the related theories to portray similar to human intelligence. It combines developments in several fields, including computer science, statistics, and linguistics. The research objects of data visualization can be divided into three aspects: data, visualization technology, and visualization performance. This paper aims to study the data visualization design of artificial intelligence in urban intelligent transportation scenarios. It predicts the traffic flow via the traffic control method using neural network. It provides an effective way for timely dredging and alleviating problems, such as traffic jams and establishing alternative routes. This paper firstly analyzes the methods of artificial intelligence, traffic control methods, and data visualization and then designs the visualization based on artificial intelligence in traffic scenarios. By comparing the accuracy analysis of different models, the experimental results show that the error of the peak traffic flow is less than 10% and the lowest error value is 2.2%.

computer science, information systems,telecommunications
Multivariate Spatial Data Visualization: A Survey

Xiangyang He,Yubo Tao,Qirui Wang,Hai Lin

DOI: https://doi.org/10.1007/s12650-019-00584-3

2019-08-18

Abstract:Multivariate spatial data plays an important role in computational science and engineering simulations. The potential features and hidden relationships in multivariate data can assist scientists to gain an in-depth understanding of a scientific process, verify a hypothesis and further discover a new physical or chemical law. In this paper, we present a comprehensive survey of the state-of-the-art techniques for multivariate spatial data visualization. We first introduce the basic concept and characteristics of multivariate spatial data, and describe three main tasks in multivariate data visualization: feature classification, fusion visualization, and correlation analysis. Finally, we prospect potential research topics for multivariate data visualization according to the current research.

Human-Computer Interaction,Computer Vision and Pattern Recognition
A Survey of Multivariate Spatial Data Visualization

Zhiyu Ding,Haidong Chen,Feiran Wu,Yubo Tao,Wuheng Zuo,Wei Chen

2013-01-01

Abstract:Multivariate spatial data visualization plays an important role in the fields of computing fluid dynamics, combustion simulation, medical imaging and meteorological simulation. It seeks to express and represent the multiple attributes as well as the relationships among them, and help users understand the characteristics and evolving patterns hidden in the datasets in an intuitive way. This paper introduces the concepts of multivariate data and differences from conventional spatial data first, and then clarifies the visualization pipeline of multivariate spatial datasets with a summary of existing works on two aspects: the representation and analysis of multivariate data fields, the visualization and interaction of multivariate data fields. Potential research topics are also discussed.
Visualization in Digital Humanities

LUO Yuchu,WU Hao,GUO Yuhan,TAN Shaocong,LIU Can,JIANG Ruike,YUAN Xiaoru

DOI: https://doi.org/10.11959/j.issn.2096-0271.2022085

2022-01-01

Abstract:The development of information technology has promoted the generation of a new scientific research paradigm.Social sciences and humanities have gradually developed a data-driven research method in recent years.From the perspective of visualization, the current status of visualization applications in digital humanities was summarized from three levels, task, data, and application, through the analysis of papers at the digital humantites conference organized by alliance of digital humanities organizations.By analyzing different projects setup by different experts with different backgrounds, i.e., humanities, visualization, and art.The great potential of multidisciplinary cooperation to improve the quality of digital humanities plus visualization projects was revealed.The practice of Peking University in exploring this new paradigm of multidisciplinary cooperation in digital humanities plus visualization was shared, which included education in multidisciplinary, practice experience on promotion, and research experience in intelligent visualization.Finally, two ways for the future development of the interdiscipline between digital humanity and visualization were revealed, the cooperation between experts and the collaboration between humans and computers.
A Survey of Text Visualization

Jiayu Tang,Zhiyuan Liu,Maosong Sun

DOI: https://doi.org/10.3969/j.issn.1003-9775.2013.03.001

2013-01-01

Abstract:With the emergence of massive texts, information overload and data redundancy raise great challenges for information processing. To address these issues, text visualization has been proposed for understanding the content, structure and patterns hidden behind complicated textual information. Text visualization integrates several techniques including text analysis, data mining, data visualization, computer graphics, human computer interaction, cognitive science and so on. In this paper, we first introduce the concepts of text visualization. Afterwards, we present the research achievements according to different visualization objects, and introduce typical visualization methods and schemes. As a conclusion, we give an outlook to future research directions of text visualization.

Survey on artificial intelligence approaches for visualization data

AI4VIS: Survey on Artificial Intelligence Approaches for Data Visualization

An overview of visual intelligent tools based on artificial intelligence

A Survey on Interdisciplinary Research of Visualization and Artificial Intelligence

Generative AI for Visualization: State of the Art and Future Directions

A Survey on Information Visualization: Recent Advances and Challenges

Visualization and Visual Analytics Approaches for Image and Video Datasets: A Survey

VIS+AI: integrating visualization with artificial intelligence for efficient data analysis

Visual Analytics for Machine Learning: A Data Perspective Survey

Visualization Research Frontier and Prospect

A Survey on Immersive Visualization

Visualization Assessment - A Machine Learning Approach.

A Tour of Visualization Techniques for Computer Vision Datasets

Designing Data Visualization Using Artificial Intelligence for Urban Intelligent Transportation Scenarios

Multivariate Spatial Data Visualization: A Survey

A Survey of Multivariate Spatial Data Visualization

Visualization in Digital Humanities

A Survey of Text Visualization