Large-Scale Artificial Intelligence Models

Hsiao-Ying Lin

DOI: https://doi.org/10.1109/mc.2022.3151419

2022-05-11

IEEE Computer

Abstract:As artificial intelligence models rapidly grow in size, their potential is stimulated.

What problem does this paper attempt to address?

Scaling Graph Neural Networks for Large-Scale Power Systems Analysis: Empirical Laws for Emergent Abilities

Yuhong Zhu,Yongzhi Zhou,Lei Yan,Zuyi Li,Huanhai Xin,Wei

DOI: https://doi.org/10.1109/tpwrs.2024.3437651

IF: 7.326

2024-01-01

IEEE Transactions on Power Systems

Abstract:The scale-up of AI models for analyzing largescale power systems necessitates a thorough understanding of their scaling properties. Existing studies on these properties provide only partial insights, showing that loss function decreases predictably with increased model scales; yet no scaling law for power system AI models has been established, and model performance remains unpredictable due to “emergent abilities”. This study pioneers the discussion on the emergent abilities of graph neural network (GNN) for analyzing large-scale power systems, revealing that model performance improves dramatically once model scale exceeds a threshold. Furthermore, we introduce an empirical power-law formula to quantify the relationship between this threshold and the power system size. Our theory accurately predicts the threshold for the appearance of emergent ability in large-scale power systems, including a synthetic 10,000- bus and a real-world 19,402-bus systems.
Large AI Models in Health Informatics: Applications, Challenges, and the Future

Jianing Qiu,Lin Li,Jiankai Sun,Jiachuan Peng,Peilun Shi,Ruiyang Zhang,Yinzhao Dong,Kyle Lam,Frank P.-W. Lo,Bo Xiao,Wu Yuan,Ningli Wang,Dong Xu,Benny Lo

DOI: https://doi.org/10.1109/jbhi.2023.3316750

IF: 7.7

2023-01-01

IEEE Journal of Biomedical and Health Informatics

Abstract:Large AI models, or foundation models, are models recently emerging with massive scales both parameter-wise and data-wise, the magnitudes of which can reach beyond billions. Once pretrained, large AI models demonstrate impressive performance in various downstream tasks. A prime example is ChatGPT, whose capability has compelled people's imagination about the far-reaching influence that large AI models can have and their potential to transform different domains of our lives. In health informatics, the advent of large AI models has brought new paradigms for the design of methodologies. The scale of multi-modal data in the biomedical and health domain has been ever-expanding especially since the community embraced the era of deep learning, which provides the ground to develop, validate, and advance large AI models for breakthroughs in health-related areas. This article presents a comprehensive review of large AI models, from background to their applications. We identify seven key sectors in which large AI models are applicable and might have substantial influence, including 1) bioinformatics; 2) medical diagnosis; 3) medical imaging; 4) medical informatics; 5) medical education; 6) public health; and 7) medical robotics. We examine their challenges, followed by a critical discussion about potential future directions and pitfalls of large AI models in transforming the field of health informatics.

computer science, interdisciplinary applications,mathematical & computational biology,medical informatics, information systems
Security Challenges and Reflections on Large Models

Xuan Huang,Linyi Huang,Guowei Tong,Xundao Zhou,Jianheng Luo

DOI: https://doi.org/10.54097/xy2amt05

2024-08-27

Abstract:The rapid development of large-scale AI models has revolutionized the technology industry, offering unprecedented opportunities for innovation across various sectors. This paper discusses the emergence of the "Hundred Model War" and the significant growth in large models, highlighting the potential for transformative applications in vertical fields such as automotive, medical, and finance. However, we also identify significant challenges, including safety ethics, governance systems, and the vulnerability of models to malicious attacks. The paper concludes with a call for the establishment of a comprehensive ethical governance system, improved safety supervision mechanisms, and the development of a public technology resource support platform to ensure the sustainable and healthy development of AI technologies.
Opportunities and challenges in the application of large artificial intelligence models in radiology

Liangrui Pan,Zhenyu Zhao,Ying Lu,Kewei Tang,Liyong Fu,Qingchun Liang,Shaoliang Peng

2024-03-24

Abstract:Influenced by ChatGPT, artificial intelligence (AI) large models have witnessed a global upsurge in large model research and development. As people enjoy the convenience by this AI large model, more and more large models in subdivided fields are gradually being proposed, especially large models in radiology imaging field. This article first introduces the development history of large models, technical details, workflow, working principles of multimodal large models and working principles of video generation large models. Secondly, we summarize the latest research progress of AI large models in radiology education, radiology report generation, applications of unimodal and multimodal radiology. Finally, this paper also summarizes some of the challenges of large AI models in radiology, with the aim of better promoting the rapid revolution in the field of radiography.

Machine Learning,Artificial Intelligence
Large Graph Models: A Perspective

Ziwei Zhang,Haoyang Li,Zeyang Zhang,Yijian Qin,Xin Wang,Wenwu Zhu

2023-01-01

Abstract: Large models have emerged as the most recent groundbreaking achievements in artificial intelligence, and particularly machine learning. However, when it comes to graphs, large models have not achieved the same level of success as in other fields, such as natural language processing and computer vision. In order to promote applying large models for graphs forward, we present a perspective paper to discuss the challenges and opportunities associated with developing large graph models. First, we discuss the desired characteristics of large graph models. Then, we present detailed discussions from three key perspectives: representation basis, graph data, and graph models. In each category, we provide a brief overview of recent advances and highlight the remaining challenges together with our visions. Finally, we discuss valuable applications of large graph models. We believe this perspective paper is able to encourage further investigations into large graph models, ultimately pushing us one step closer towards artificial general intelligence (AGI).
Network model with internal complexity bridges artificial intelligence and neuroscience

Linxuan He,Yunhui Xu,Weihua He,Yihan Lin,Yang Tian,Yujie Wu,Wenhui Wang,Ziyang Zhang,Junwei Han,Yonghong Tian,Bo Xu,Guoqi Li

DOI: https://doi.org/10.1038/s43588-024-00674-9

2024-08-16

Abstract:Artificial intelligence (AI) researchers currently believe that the main approach to building more general model problems is the big AI model, where existing neural networks are becoming deeper, larger and wider. We term this the big model with external complexity approach. In this work we argue that there is another approach called small model with internal complexity, which can be used to find a suitable path of incorporating rich properties into neurons to construct larger and more efficient AI models. We uncover that one has to increase the scale of the network externally to stimulate the same dynamical properties. To illustrate this, we build a Hodgkin-Huxley (HH) network with rich internal complexity, where each neuron is an HH model, and prove that the dynamical properties and performance of the HH network can be equivalent to a bigger leaky integrate-and-fire (LIF) network, where each neuron is a LIF neuron with simple internal complexity.
Large Language Models for Scientific Synthesis, Inference and Explanation

Yizhen Zheng,Huan Yee Koh,Jiaxin Ju,Anh T. N. Nguyen,Lauren T. May,Geoffrey I. Webb,Shirui Pan,Anh T.N. Nguyen

DOI: https://doi.org/10.48550/arXiv.2310.07984

IF: 14.4

2023-10-12

Artificial Intelligence

Abstract:Large language models are a form of artificial intelligence systems whose primary knowledge consists of the statistical patterns, semantic relationships, and syntactical structures of language1. Despite their limited forms of "knowledge", these systems are adept at numerous complex tasks including creative writing, storytelling, translation, question-answering, summarization, and computer code generation. However, they have yet to demonstrate advanced applications in natural science. Here we show how large language models can perform scientific synthesis, inference, and explanation. We present a method for using general-purpose large language models to make inferences from scientific datasets of the form usually associated with special-purpose machine learning algorithms. We show that the large language model can augment this "knowledge" by synthesizing from the scientific literature. When a conventional machine learning system is augmented with this synthesized and inferred knowledge it can outperform the current state of the art across a range of benchmark tasks for predicting molecular properties. This approach has the further advantage that the large language model can explain the machine learning system's predictions. We anticipate that our framework will open new avenues for AI to accelerate the pace of scientific discovery.
Research on a Massively Large Artificial Intelligence Model and Its Application in Medicine

GUO HuaYuan,LIU Pan,LU RuoGu,YANG FeiFei,XU HongLi,ZHUANG Yan,HUANG Gao,SONG ShiJi,HE KunLun

DOI: https://doi.org/10.1360/ssv-2022-0298

2023-01-01

Scientia Sinica Vitae

Abstract:Recent years have witnessed rapid advancements in massively large artificial intelligence(AI)models based on natural language processing and video image analysis.In order to meet the requirements of relevant application fields,the universal pretraining model is developed by the efficient collaboration and deep integration of big data,large-scale computing power,and complex algorithms.The model demonstrates adaptability to a wide range of downstream tasks.In addition,the massively large model presents considerable opportunities for advancing the quality of medical AI development.Therefore,this paper comprehensively analyzes the progress of massively large models within domestic and international contexts in recent years,with an emphasis on their key technologies and algorithmic framework.Meanwhile,the developmental characteristics of a series of standard datasets and pretraining models in the biomedical field have been presented in detail.Incorporating our team's practical experience in medical AI research and development,we undertake a comprehensive analysis of the application requirements,our solutions and experiences related to the construction of massively large models in the medical field and persistently promote innovation and development within the realm of large-scale medical models.
Large scale models in radiology: revolutionizing the future of medical imaging

Yilin Li,Jiaojiao Liu,Yanyan Zhang,Jingwei Wei,Yang Luo,Xue Yang,Yanbin Shi,Lingling Zhao,Wanshui Yang,Hongjun Li,Jie Tian

DOI: https://doi.org/10.15212/radsci-2023-0018

2024-01-01

Abstract:In the domain of medical image analysis, there is a burgeoning recognition and adoption of large models distinguished by their extensive parameter count and intricate neural network architecture that is predominantly due to their outstanding performance. This review article seeks to concisely explore the historical evolution, specific applications, and training methodologies associated with these large models considering their current prominence in medical image analysis. Moreover, we delve into the prevailing challenges and prospective opportunities related to the utilization of large models in the context of medical image analysis. Through a comprehensive analysis of these substantial models, this study aspires to provide valuable insights and guidance to researchers in the field of radiology, fostering further advances and optimizations in their incorporation into medical image analysis practices, in accordance with the submission requirements.
Graph Meets LLMs: Towards Large Graph Models

Ziwei Zhang,Haoyang Li,Zeyang Zhang,Yijian Qin,Xin Wang,Wenwu Zhu

DOI: https://doi.org/10.48550/arXiv.2308.14522

2023-11-11

Abstract:Large models have emerged as the most recent groundbreaking achievements in artificial intelligence, and particularly machine learning. However, when it comes to graphs, large models have not achieved the same level of success as in other fields, such as natural language processing and computer vision. In order to promote applying large models for graphs forward, we present a perspective paper to discuss the challenges and opportunities associated with developing large graph models. First, we discuss the desired characteristics of large graph models. Then, we present detailed discussions from three key perspectives: representation basis, graph data, and graph models. In each category, we provide a brief overview of recent advances and highlight the remaining challenges together with our visions. Finally, we discuss valuable applications of large graph models. We believe this perspective can encourage further investigations into large graph models, ultimately pushing us one step closer towards artificial general intelligence (AGI). We are the first to comprehensively study large graph models, to the best of our knowledge.

Machine Learning,Artificial Intelligence,Social and Information Networks
Engineering Exploration and Research on Large Language Models

Zirui Fang,Yifan Hong,Zhiyuan Wang,Ke Liu,Haitao Huang,Zijing Liang,Penghui Shang

DOI: https://doi.org/10.1145/3653081.3653111

2023-11-24

Abstract:Large Language Models, as a booming industry in artificial intelligence, empower various sectors, enhancing the efficiency of developers and application practitioners. However, deploying large models in private scenarios poses numerous challenges. This review focuses on the engineering applications of large language models, delving into the technical aspects of retrieval-enhanced generation, prompt engineering for large models, fine-tuning and incremental pre-training of large models, and the intelligent agent mode of large models. Through a detailed analysis of these technologies, the goal is to improve model performance, enhance adaptability in diverse scenarios, and address various challenges that may arise in practical deployment. Through this research, we aim to systematically outline the technical means for the engineering application of large models, providing insights and experiences for the deployment of large models.

Engineering,Computer Science
Large Language Models Empowered Autonomous Edge AI for Connected Intelligence

Yifei Shen,Jiawei Shao,Xinjie Zhang,Zehong Lin,Hao Pan,Dongsheng Li,Jun Zhang,Khaled B. Letaief

DOI: https://doi.org/10.1109/mcom.001.2300550

IF: 9.03

2024-01-01

IEEE Communications Magazine

Abstract:The evolution of wireless networks gravitates towards connected intelligence, a concept that envisions seamless interconnectivity among humans, objects, and intelligence in a hyper-connected cyber-physical world. Edge artificial intelligence (Edge AI) is a promising solution to achieve connected intelligence by delivering high-quality, low-latency, and privacy-preserving AI services at the network edge. This article presents a vision of autonomous edge AI systems that automatically organize, adapt, and optimize themselves to meet users' diverse requirements, leveraging the power of large language models (LLMs), i.e., Generative Pretrained Transformer (GPT). By exploiting the powerful abilities of GPT in language understanding, planning, and code generation, as well as incorporating classic wisdom such as task-oriented communication and edge federated learning, we present a versatile framework that efficiently coordinates edge AI models to cater to users' personal demands while automatically generating code to train new models in a privacy-preserving manner. Experimental results demonstrate the system's remarkable ability to accurately comprehend user demands, efficiently execute AI models with minimal cost, and effectively create highperformance AI models at edge servers.

telecommunications,engineering, electrical & electronic
Challenges and Responses in the Practice of Large Language Models

Hongyin Zhu

2024-08-21

Abstract:This paper carefully summarizes extensive and profound questions from all walks of life, focusing on the current high-profile AI field, covering multiple dimensions such as industry trends, academic research, technological innovation and business applications. This paper meticulously curates questions that are both thought-provoking and practically relevant, providing nuanced and insightful answers to each. To facilitate readers' understanding and reference, this paper specifically classifies and organizes these questions systematically and meticulously from the five core dimensions of computing power infrastructure, software architecture, data resources, application scenarios, and brain science. This work aims to provide readers with a comprehensive, in-depth and cutting-edge AI knowledge framework to help people from all walks of life grasp the pulse of AI development, stimulate innovative thinking, and promote industrial progress.

Computation and Language,Artificial Intelligence
Guest Editorial: Sustainable Big AI Model for Wireless Networks

Zhaoyang Zhang,Merouane Debbah,Yonina C. Eldar,Dinh Thai Hoang,Wen Tong,Kai-Kit Wong

DOI: https://doi.org/10.1109/mwc.2024.10558824

IF: 12.777

2024-01-01

IEEE Wireless Communications

Abstract:Machine learning is a promising approach to explore the vast amount of wireless data with artificial intelligence (AI) to accomplish a wide variety of large-scale, computation or communication-oriented tasks in next-generation wireless networks, from intelligent computing to environment sensing and intelligent communication. Traditional approaches rely on each individual task having a specific AI model, which results in high hardware (HW)/software (SW) overheads and prevents the deep exploration of the inherent correlation within data and among tasks. The rapidly emerging big AI model or foundation model (FM) has received a lot of attention recently, which aims at building a unified machine learning system based on a generic class of AI models capable of accomplishing multiple natively interrelated tasks.
The Rise and Potential of Large Language Model Based Agents: A Survey

Zhiheng Xi,Wenxiang Chen,Xin Guo,Wei He,Yiwen Ding,Boyang Hong,Ming Zhang,Junzhe Wang,Senjie Jin,Enyu Zhou,Rui Zheng,Xiaoran Fan,Xiao Wang,Limao Xiong,Yuhao Zhou,Weiran Wang,Changhao Jiang,Yicheng Zou,Xiangyang Liu,Zhangyue Yin,Shihan Dou,Rongxiang Weng,Wensen Cheng,Qi Zhang,Wenjuan Qin,Yongyan Zheng,Xipeng Qiu,Xuanjing Huang,Tao Gui,Qin Liu,Xuanjing Huan

DOI: https://doi.org/10.48550/arxiv.2309.07864

IF: 14.4

2023-09-14

Artificial Intelligence

Abstract:For a long time, humanity has pursued artificial intelligence (AI) equivalent to or surpassing the human level, with AI agents considered a promising vehicle for this pursuit. AI agents are artificial entities that sense their environment, make decisions, and take actions. Many efforts have been made to develop intelligent AI agents since the mid-20th century. However, these efforts have mainly focused on advancement in algorithms or training strategies to enhance specific capabilities or performance on particular tasks. Actually, what the community lacks is a sufficiently general and powerful model to serve as a starting point for designing AI agents that can adapt to diverse scenarios. Due to the versatile and remarkable capabilities they demonstrate, large language models (LLMs) are regarded as potential sparks for Artificial General Intelligence (AGI), offering hope for building general AI agents. Many research efforts have leveraged LLMs as the foundation to build AI agents and have achieved significant progress. We start by tracing the concept of agents from its philosophical origins to its development in AI, and explain why LLMs are suitable foundations for AI agents. Building upon this, we present a conceptual framework for LLM-based agents, comprising three main components: brain, perception, and action, and the framework can be tailored to suit different applications. Subsequently, we explore the extensive applications of LLM-based agents in three aspects: single-agent scenarios, multi-agent scenarios, and human-agent cooperation. Following this, we delve into agent societies, exploring the behavior and personality of LLM-based agents, the social phenomena that emerge when they form societies, and the insights they offer for human society. Finally, we discuss a range of key topics and open problems within the field.
Integration of cognitive tasks into artificial general intelligence test for large models

Youzhi Qu,Chen Wei,Penghui Du,Wenxin Che,Chi Zhang,Wanli Ouyang,Yatao Bian,Feiyang Xu,Bin Hu,Kai Du,Haiyan Wu,Jia Liu,Quanying Liu

2024-03-06

Abstract:During the evolution of large models, performance evaluation is necessarily performed to assess their capabilities and ensure safety before practical application. However, current model evaluations mainly rely on specific tasks and datasets, lacking a united framework for assessing the multidimensional intelligence of large models. In this perspective, we advocate for a comprehensive framework of cognitive science-inspired artificial general intelligence (AGI) tests, aimed at fulfilling the testing needs of large models with enhanced capabilities. The cognitive science-inspired AGI tests encompass the full spectrum of intelligence facets, including crystallized intelligence, fluid intelligence, social intelligence, and embodied intelligence. To assess the multidimensional intelligence of large models, the AGI tests consist of a battery of well-designed cognitive tests adopted from human intelligence tests, and then naturally encapsulates into an immersive virtual community. We propose increasing the complexity of AGI testing tasks commensurate with advancements in large models and emphasizing the necessity for the interpretation of test results to avoid false negatives and false positives. We believe that cognitive science-inspired AGI tests will effectively guide the targeted improvement of large models in specific dimensions of intelligence and accelerate the integration of large models into human society.

Artificial Intelligence,Computation and Language
Large models for intelligent transportation systems and autonomous vehicles: A survey

Lu Gan,Wenbo Chu,Guofa Li,Xiaolin Tang,Keqiang Li

DOI: https://doi.org/10.1016/j.aei.2024.102786

IF: 8.8

2024-08-27

Advanced Engineering Informatics

Abstract:Large models are widely used in intelligent transportation systems (ITS) and autonomous vehicles (AV) due to their excellent new capabilities such as intelligence emergence, domain application adaptive, and multi-task learning. By integrating massive amounts of data, vehicles and transportation systems based on large models can understand the real-world environment, simulate the reasoning process of human drivers, optimize traffic flow, and improve driving safety and efficiency. However, in the practical implementation of large models, there are three key research questions: (1) How can model reasoning be consistent with the target task? (2) How to improve the redundancy of structures and weights caused by complex models? (3) How to solve the problems of supercomputing power, high latency, and large throughput of large models in practical deployment? These challenges have stimulated the development of deployment techniques for large models. Although existing review articles discuss large model technologies from singular or partial perspectives, there remains a lack of comprehensive systematic investigations into the application and deployment of large models for ITS and AV. Therefore, this paper conducted a quantitative analysis of scientific literature, demonstrating the necessity and significance of studying large models for ITS and AV. Subsequently, it outlined the concept and characteristics of large models and provided a detailed summary of the frontier progress of large models for ITS and AV. Moreover, to bridge the gap between large model inference and target tasks, address structural and weight redundancies, and tackle challenges in practical deployment such as high computational power, latency, and throughput, it explored efficient deployment techniques to accelerate the rapid deployment of large models. Finally, it discussed the challenges and future trends. This paper aims to provide researchers and engineers with an understanding of the forefront advancements and future trends of large models to facilitate the rapid implementation of large models and accelerate their development in ITS and AV.

engineering, multidisciplinary,computer science, artificial intelligence
Research Status and Application of Artificial Intelligence Large Models in the Oil and Gas Industry

He Liu,Yili Ren,Xin Li,Yue Deng,Yongtao Wang,Qianwen Cao,Jinyang Du,Zhiwei Lin,Wenjie Wang

DOI: https://doi.org/10.1016/s1876-3804(24)60524-0

IF: 5.194

2024-01-01

Petroleum Exploration and Development

Abstract:This article elucidates the concept of large model technology, summarizes the research status of large model technology both domestically and internationally, provides an overview of the application status of large models in vertical industries, outlines the challenges and issues confronted in applying large models in the oil and gas sector, and offers prospects for the application of large models in the oil and gas industry. The existing large models can be briefly divided into three categories: large language models, visual large models, and multimodal large models. The application of large models in the oil and gas industry is still in its infancy. Based on open-source large language models, some oil and gas enterprises have released large language model products using methods like fine-tuning and retrieval augmented generation. Scholars have attempted to develop scenario-specific models for oil and gas operations by using visual/multimodal foundation models. A few researchers have constructed pre-trained foundation models for seismic data processing and interpretation, as well as core analysis. The application of large models in the oil and gas industry faces challenges such as current data quantity and quality being difficult to support the training of large models, high research and development costs, and poor algorithm autonomy and control. The application of large models should be guided by the needs of oil and gas business, taking the application of large models as an opportunity to improve data lifecycle management, enhance data governance capabilities, promote the construction of computing power, strengthen the construction of “artificial intelligence + energy” composite teams, and boost the autonomy and control of large model technology.

Large-Scale Artificial Intelligence Models

Scaling Graph Neural Networks for Large-Scale Power Systems Analysis: Empirical Laws for Emergent Abilities

Large AI Models in Health Informatics: Applications, Challenges, and the Future

Security Challenges and Reflections on Large Models

Opportunities and challenges in the application of large artificial intelligence models in radiology

Large Graph Models: A Perspective

Network model with internal complexity bridges artificial intelligence and neuroscience

Large Language Models for Scientific Synthesis, Inference and Explanation

Research on a Massively Large Artificial Intelligence Model and Its Application in Medicine

Large scale models in radiology: revolutionizing the future of medical imaging

Graph Meets LLMs: Towards Large Graph Models

Engineering Exploration and Research on Large Language Models

Large Language Models Empowered Autonomous Edge AI for Connected Intelligence

Challenges and Responses in the Practice of Large Language Models

Guest Editorial: Sustainable Big AI Model for Wireless Networks

The Rise and Potential of Large Language Model Based Agents: A Survey

Integration of cognitive tasks into artificial general intelligence test for large models

Large models for intelligent transportation systems and autonomous vehicles: A survey

Research Status and Application of Artificial Intelligence Large Models in the Oil and Gas Industry