AI Reinvents Chip Design

Samuel Greengard

DOI: https://doi.org/10.1145/3673645

IF: 22.7

2024-08-27

Communications of the ACM

Abstract:Design and engineering teams increasingly are turning to classical and generative AI to rethink, reinvent, and remake the modern microchip.

computer science, theory & methods, software engineering, hardware & architecture

What problem does this paper attempt to address?

AI in Chemical Engineering: A New Chapter of Innovation

Qilong Ren

DOI: https://doi.org/10.1016/j.eng.2024.07.006

IF: 12.834

2024-01-01

Engineering

Abstract:The integration of artificial intelli-gence(AI)into chemical engineering marks a transformative era,redefin-ing traditional methodologies with AI-driven approaches.AI has emerged as a powerful ally in tackling complex problems once considered insur-mountable.As chemical engineering grapples with increasingly complex systems and stringent sustainability targets,AI sets the stage for a new generation of solutions.
Accelerating Chip Design with Machine Learning: from Pre-Silicon to Post-Silicon

Cheng Zhuo,Bei Yu,Di Gao

DOI: https://doi.org/10.1109/socc.2017.8226046

2017-01-01

Abstract:At sub-22nm regime, chip designs have to go through hundreds to thousands of steps and tasks before shipment. Many tasks are data and simulation intensive, thereby demanding significant amount of resources and time. Unlike conventional methodologies relying on experiences to manually handle data and extract models, recent advances in machine learning techniques enable the successful applications in various complex tasks to accelerate modern chip designs, ranging from pre-silicon verification to post-silicon validation and tuning. The goals are to reduce the amount of time and efforts to process and understand data through automatic and effective learning and enhancing from examples. In this paper we review and discuss several application cases of machine learning techniques, including pre-silicon hotspot detection through classification, post-silicon variation extraction and bug localization through inference, and post-silicon timing tuning through iterative learning and optimization, so as to leverage the potentials and inspire more future innovations.
Analysis of the Designs and Applications of AI Chip

Xinnuo Li

DOI: https://doi.org/10.54097/k1p7yk27

2023-12-31

Abstract:The rapid evolution of deep learning model architectures and the increasing scale of model parameters have imposed heightened demands on deep learning training, inference, and deployment, leading to the swift advancement and unprecedented prosperity of AI chips. Therefore, this study sets out to analyze the designs and applications of AI chips by considering their unique requirements compared to conventional chips, and by combining software and hardware aspects. The paper delineates the classification of common AI chips along with their distinct design strategies and optimization algorithms. It commences with the fundamental hardware design of AI chips, elucidating the basic design process and addressing the specialized demands of AI computation, particularly data parallelism and storage optimization. Subsequently, transitioning to the manufacturing process, it examines how current AI chips circumvent fabrication bottlenecks and achieve significant breakthroughs in architecture and performance through chip stacking techniques. The paper then bridges hardware and software through the AI compiler, expounding on model optimization approaches, e.g., quantization and pruning, completing the comprehensive journey from AI chip design to deployment. It identifies current developmental challenges in the AI chip realm and provides a glimpse into future prospects. Through a holistic perspective spanning design, manufacturing, algorithms, and applications of AI chips, this paper offers insights that steer upcoming innovations and practical implementations in artificial intelligence, paving the way for a dynamic future in AI chip development.
AI-Driven Evolution in Integrated Circuit Design: A Qualitative Exploration of Transformative Potential and Human Collaboration

Danny Rittman,Jeffrey Butler,Abdullah Alshboul

DOI: https://doi.org/10.61643/c29186

2024-03-01

Abstract:This paper explores the intricate relationship between artificial intelligence (AI) and integrated circuit (IC) design. With the relentless evolution of technology, IC design faces escalating challenges in complexity, cost, and verification. AI emerges as a transformative force, offering solutions to these issues. The paper investigates AI's potential in IC design through a qualitative study involving domain experts. The findings reveal a consensus on AI's inevitability in the field. As ICs become more intricate, AI-driven automation becomes indispensable, though opinions on the traditional interpretation of Moore's Law diverge. The impact of AI varies across IC design domains, with certain areas benefiting significantly from automation while others rely on human expertise. AI is expected to play a pivotal role in synthesis, System-on-Chip (SoC), ASICs, and memory ICs, whereas domains like analog and photonics may experience less direct AI influence. Notably, AI is poised to revolutionize IC design verification, addressing mounting complexity. AI integration extends across essential IC design domains, including architecture, verification, validation, physical design, and manufacturing. AI-driven approaches target areas like physical verification, simulation, design for manufacturing (DFM) analysis, and cost reduction. Furthermore, AI's potential in quantum computing ICs is recognized, enhancing computing power and resource distribution efficiency. Crucially, AI is seen as a complement, not a replacement, for human expertise. The synergy between human creativity and AI-driven automation is deemed vital for achieving optimal IC design. This paper underscores the transformative potential of AI in IC design, offering insights into its role, challenges, and the enduring importance of human ingenuity.
Generative Artificial Intelligence Enhances Sudden Moments of Inspiration among Novice Designers

Xiaoran Zhang,Wenqi Wu,Songruoyao Wu,Jiaxing Yu,Shixuan Cai,Kejun Zhang

DOI: https://doi.org/10.1109/ihmsc62065.2024.00048

2024-01-01

Abstract:Sudden moments of inspiration are pivotal in the design process, playing a crucial role in advancing projects. With the rapid development of generative artificial intelligence (AI) technology, it has garnered increasing attention within the design community. Previous research has primarily focused on the impact of this technology on the overall design process, with few studies exploring how generative AI influences designers’ moments of inspiration. This paper investigates the specific effects of generative AI technology on designers’ moments of inspiration through experimental research. The results indicate that generative AI technology enhances the moments of inspiration for novice designers.
The Why, What and How of Artificial General Intelligence Chip Development

Alex P. James,Alex James

DOI: https://doi.org/10.1109/tcds.2021.3069871

IF: 4.546

2021-01-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:The AI chips increasingly focus on implementing neural computing at low power and cost. The intelligent sensing, automation, and edge computing applications have been the market drivers for AI chips. Increasingly, the generalisation, performance, robustness, and scalability of the AI chip solutions are compared with human-like intelligence abilities. Such a requirement to transit from application-specific to general intelligence AI chip must consider several factors. This article provides an overview of this cross-disciplinary field of study, elaborating on the generalisation of intelligence as understood in building artificial general intelligence (AGI) systems. This work presents a listing of emerging AI chip technologies, classification of edge AI implementations, and the funnel design flow for AGI chip development. Finally, the design consideration required for building an AGI chip is listed along with the methods for testing and validating it.

robotics,computer science, artificial intelligence,neurosciences
That Chip Has Sailed: A Critique of Unfounded Skepticism Around AI for Chip Design

Anna Goldie,Azalia Mirhoseini,Jeff Dean

2024-11-15

Abstract:In 2020, we introduced a deep reinforcement learning method capable of generating superhuman chip layouts, which we then published in Nature and open-sourced on GitHub. AlphaChip has inspired an explosion of work on AI for chip design, and has been deployed in state-of-the-art chips across Alphabet and extended by external chipmakers. Even so, a non-peer-reviewed invited paper at ISPD 2023 questioned its performance claims, despite failing to run our method as described in Nature. For example, it did not pre-train the RL method (removing its ability to learn from prior experience), used substantially fewer compute resources (20x fewer RL experience collectors and half as many GPUs), did not train to convergence (standard practice in machine learning), and evaluated on test cases that are not representative of modern chips. Recently, Igor Markov published a meta-analysis of three papers: our peer-reviewed Nature paper, the non-peer-reviewed ISPD paper, and Markov's own unpublished paper (though he does not disclose that he co-authored it). Although AlphaChip has already achieved widespread adoption and impact, we publish this response to ensure that no one is wrongly discouraged from innovating in this impactful area.

Artificial Intelligence,Machine Learning
AI-Driven Innovations in IC Designs: From Planning to Implementation

Pei-Yu Lee,Tung-Chieh Chen

DOI: https://doi.org/10.1109/VLSITSA60681.2024.10546365

2024-04-22

Abstract:This paper delves into the evolving landscape of Artificial Intelligence (AI) techniques within integrated circuit (K‘) design, spanning from design planning to implementation. We will focus on the capabilities of AI integration during the physical design stages, particularly in advanced nodes, because rapid growing design complexity and the shrinking of technology nodes have made physical design become incredibly challenging to achieve design closure and better power, performance, area, schedule (PPAS). Lastly, we will discuss the future challenges and opportunities in physical design optimization that could be resolved with the aid of AI.

Computer Science,Engineering
Analysis of the Principle and Configuration of AI Chip and the State-of-art Applications

Zhexi Lu

DOI: https://doi.org/10.54097/kxs0gn23

2023-12-31

Abstract:AI chips are specialized hardware components designed to accelerate AI operations, making them crucial for various industries. This study provides a comprehensive overview of artificial intelligence (AI) chips, their structure, principles, fabrication process, applications, limitations, and future outlooks. The article discusses the components commonly found in AI chip structures, including processing units, memory hierarchy, interconnects, and specialized hardware units. It delves into the principles guiding AI chip design, such as specialization, parallelism, low precision arithmetic, and hardware-software co-design. The fabrication process of AI chips involves intricate steps, including design, mask generation, deposition, lithography, and testing. Applications of AI chips span data centers, edge computing, autonomous vehicles, healthcare, NLP, and more. Despite their advancements, AI chips have limitations, such as energy efficiency and specificity, but the future holds promise with improvements in energy efficiency, specialized acceleration, hybrid architectures, and quantum AI chips. Overall, AI chips have transformed the AI landscape, setting the stage for continued innovation and impact in various sectors.
Automating Analogue AI Chip Design with Genetic Search

Olga Krestinskaya,Khaled N. Salama,Alex P. James

DOI: https://doi.org/10.1002/aisy.202000075

IF: 7.298

2020-06-25

Advanced Intelligent Systems

Abstract:Optimization of analogue neural circuit designs is one of the most challenging, complicated, time‐consuming, and expensive tasks. Design automation of analogue neuromemristive chips is made difficult by the need to design chips at low cost, ease of scaling, high‐energy efficiency, and small on‐chip area. The rapid progress in edge AI computing applications generates high demand for developing smart sensors. The integration of high‐density analogue computing AI chips as coprocessing units to sensors is gaining popularity. This article proposes a hardware–software codesign framework to speed up and automate the design of analogue neuromemristive chips. This work uses genetic algorithms with objective functions that take into account hardware nonidealities such as limited precision of devices, the device‐to‐device variability, and device failures. The optimized neural architectures and hyperparameters successfully map with the library of relevant neuromemristive analogue hardware blocks. The results demonstrate the advantage of proposed automation to speed up the analogue circuit design of large‐scale neuromemristive networks and reduce overall design costs for AI chips. An automated computer‐aided design solution with genetic search for designing analogue neuromemristive chips is used. The approach aims to lower design cost, ease of scaling, high‐energy efficiency, and small on‐chip area.
AI for EDA/Physical Design: Driving the AI Revolution: The Crucial Role of 3D-IC

Erick Chao

DOI: https://doi.org/10.1145/3626184.3635275

2024-03-12

Abstract:3D Integrated Circuits (3D-ICs) represent a significant advancement in semiconductor technology, offering enhanced functionality in smaller form factors, improved performance, and cost reductions. These 3D-ICs, particularly those utilizing Through-Silicon Vias (TSVs), are at the forefront of industry trends. They enable the integration of system components from various process nodes, including analog and RF, without being limited to a single node. TSVs outperform wire-bonded System in Package (SiP) in terms of reduced (RLC) parasitics, offering better performance, more power efficiency, and denser implementation. Compared to silicon interposer methods, vertical 3D die stacking achieves higher integration levels, smaller sizes, and quicker design cycles. This presentation introduces a novel AI-driven method designed to tackle the challenges hindering the automation of 3D-IC design flows.

Computer Science,Engineering
A review of design intelligence: progress, problems, and challenges

Yong-chuan Tang,Jiang-jie Huang,Meng-ting Yao,Jia Wei,Wei Li,Yong-xing He,Ze-jian Li

DOI: https://doi.org/10.1631/FITEE.1900398

IF: 2.526

2019-01-01

Frontiers of Information Technology & Electronic Engineering

Abstract:Design intelligence is an important branch of artificial intelligence (AI), focusing on the intelligent models and algorithms in creativity and design. In the context of AI 2.0, studies on design intelligence have developed rapidly. We summarize mainly the current emerging framework of design intelligence and review the state-of-the-art techniques of related topics, including user needs analysis, ideation, content generation, and design evaluation. Specifically, the models and methods of intelligence-generated content are reviewed in detail. Finally, we discuss some open problems and challenges for future research in design intelligence.
Generative AI for Product Design: Getting the Right Design and the Design Right

Matthew K. Hong,Shabnam Hakimi,Yan-Ying Chen,Heishiro Toyoda,Charlene Wu,Matt Klenk

2023-06-02

Abstract:Generative AI (GenAI) models excel in their ability to recognize patterns in existing data and generate new and unexpected content. Recent advances have motivated applications of GenAI tools (e.g., Stable Diffusion, ChatGPT) to professional practice across industries, including product design. While these generative capabilities may seem enticing on the surface, certain barriers limit their practical application for real-world use in industry settings. In this position paper, we articulate and situate these barriers within two phases of the product design process, namely "getting the right design" and "getting the design right," and propose a research agenda to stimulate discussions around opportunities for realizing the full potential of GenAI tools in product design.

Human-Computer Interaction
Reconfigurability, Why It Matters in AI Tasks Processing: A Survey of Reconfigurable AI Chips.

Shaojun Wei,Xinhan Lin,Fengbin Tu,Yang Wang,Leibo Liu,Shouyi Yin

DOI: https://doi.org/10.1109/tcsi.2022.3228860

2023-01-01

Abstract:Nowadays, artificial intelligence (AI) technologies, especially deep neural networks (DNNs), play an vital role in solving many problems in both academia and industry. In order to simultaneously meet the demand of performance, energy efficiency and flexibility in DNN processing, various reconfigurable AI chips have been proposed in the past several years. They are based on FPGA or CGRA platforms and have domain-specific reconfigurability to customize the computing units and data paths for different DNN tasks without re-produce the chips. This paper surveys typical reconfigurable AI chips from three reconfiguration hierarchies: processing element level, processing element array level, and chip level. Each reconfiguration hierarchy covers a set of important optimization techniques for DNN computation which are frequently adopted in real life. This paper lists the reconfigurable AI chip works in chronological order, discusses the hardware development process for each optimization techniques, and analyzes the necessity of reconfigurability in AI tasks processing. The trends of each reconfiguration hierarchy and insights about the cooperation of techniques from different hierarchies are also proposed.
Reconfigurable Computing: a Promising Microchip Architecture for Artificial Intelligence

Shaojun Wei

DOI: https://doi.org/10.1088/1674-4926/41/2/020301

2020-01-01

Journal of Semiconductors

Abstract:>Today, integrated circuit technology is approaching the physical limit. From performance and energy consumption perspective, reconfigurable computing is regarded as the most promising technology for future computing systems with excellent feature in computing and energy efficiency.From the perspective of computing performance, compared with single thread performance stagnation of general purpose processors (GPPS), reconfigurable computing may customize hardware according to application requirements, so
Revolutionizing microfluidics with artificial intelligence: a new dawn for lab-on-a-chip technologies

Keisuke Goda,Hang Lu,Peng Fei,Jochen Guck

DOI: https://doi.org/10.1039/d3lc90061d

2023-07-30

Lab on a Chip - Miniaturisation for Chemistry and Biology

Abstract:Keisuke Goda, Hang Lu, Peng Fei, and Jochen Guck introduce the AI in Microfluidics themed collection, on revolutionizing microfluidics with artificial intelligence: a new dawn for lab-on-a-chip technologies.
Chip-Chat: Challenges and Opportunities in Conversational Hardware Design

Jason Blocklove,Siddharth Garg,Ramesh Karri,Hammond Pearce

DOI: https://doi.org/10.1109/MLCAD58807.2023.10299874

2023-11-14

Abstract:Modern hardware design starts with specifications provided in natural language. These are then translated by hardware engineers into appropriate Hardware Description Languages (HDLs) such as Verilog before synthesizing circuit elements. Automating this translation could reduce sources of human error from the engineering process. But, it is only recently that artificial intelligence (AI) has demonstrated capabilities for machine-based end-to-end design translations. Commercially-available instruction-tuned Large Language Models (LLMs) such as OpenAI's ChatGPT and Google's Bard claim to be able to produce code in a variety of programming languages; but studies examining them for hardware are still lacking. In this work, we thus explore the challenges faced and opportunities presented when leveraging these recent advances in LLMs for hardware design. Given that these `conversational' LLMs perform best when used interactively, we perform a case study where a hardware engineer co-architects a novel 8-bit accumulator-based microprocessor architecture with the LLM according to real-world hardware constraints. We then sent the processor to tapeout in a Skywater 130nm shuttle, meaning that this `Chip-Chat' resulted in what we believe to be the world's first wholly-AI-written HDL for tapeout.

Machine Learning,Hardware Architecture,Programming Languages
Artificial intelligence in analogue circuit design

Ao Chen

DOI: https://doi.org/10.54254/2755-2721/48/20241365

2024-03-19

Abstract:Analog circuit design plays an integral part in modern society; however, traditional approaches often fall short in terms of efficiency and effectiveness. This paper explores the application and challenges presented by artificial intelligence (AI) technologies in analog circuit design. The objective of this paper was to evaluate the capacity of artificial intelligence technologies such as machine learning, deep learning and reinforcement learning to advance circuit modeling, optimization and layout design processes. A comprehensive literature review and analysis were performed. The study finds that while AI can make significant contributions to circuit design, several challenges must first be overcome. These include data scarcity for training AI models and the opaque nature of AI decisions which prevent their widespread acceptance. Finally, future research directions such as creating synthetic data or developing more interpretable AI models were identified as potential future research avenues.
AI on a chip

Akihiro Isozaki,Jeffrey Harmon,Yuqi Zhou,Shuai Li,Yuta Nakagawa,Mika Hayashi,Hideharu Mikami,Cheng Lei,Keisuke Goda

DOI: https://doi.org/10.1039/d0lc00521e

2020-08-26

Lab Chip

Abstract:Artificial intelligence (AI) has dramatically changed the landscape of science, industry, defence, and medicine in the last several years. Supported by considerably enhanced computational power and cloud storage, the field of AI has shifted from mostly theoretical studies in the discipline of computer science to diverse real-life applications such as drug design, material discovery, speech recognition, self-driving cars, advertising, finance, medical imaging, and astronomical observation, where AI-produced outcomes have been proven to be comparable or even superior to the performance of human experts. In these applications, what is essentially important for the development of AI is the data needed for machine learning. Despite its prominent importance, the very first process of the AI development, namely data collection and data preparation, is typically the most laborious task and is often a limiting factor of constructing functional AI algorithms. Lab-on-a-chip technology, in particular microfluidics, is a powerful platform for both the construction and implementation of AI in a large-scale, cost-effective, high-throughput, automated, and multiplexed manner, thereby overcoming the above bottleneck. On this platform, high-throughput imaging is a critical tool as it can generate high-content information (e.g., size, shape, structure, composition, interaction) of objects on a large scale. High-throughput imaging can also be paired with sorting and DNA/RNA sequencing to conduct a massive survey of phenotype-genotype relations whose data is too complex to analyze with traditional computational tools, but is analyzable with the power of AI. In addition to its function as a data provider, lab-on-a-chip technology can also be employed to implement the developed AI for accurate identification, characterization, classification, and prediction of objects in mixed, heterogeneous, or unknown samples. In this review article, motivated by the excellent synergy between AI and lab-on-a-chip technology, we outline fundamental elements, recent advances, future challenges, and emerging opportunities of AI with lab-on-a-chip technology or "AI on a chip" for short.

AI Reinvents Chip Design

AI in Chemical Engineering: A New Chapter of Innovation

Accelerating Chip Design with Machine Learning: from Pre-Silicon to Post-Silicon

Analysis of the Designs and Applications of AI Chip

AI-Driven Evolution in Integrated Circuit Design: A Qualitative Exploration of Transformative Potential and Human Collaboration

Generative Artificial Intelligence Enhances Sudden Moments of Inspiration among Novice Designers

The Why, What and How of Artificial General Intelligence Chip Development

That Chip Has Sailed: A Critique of Unfounded Skepticism Around AI for Chip Design

AI-Driven Innovations in IC Designs: From Planning to Implementation

Analysis of the Principle and Configuration of AI Chip and the State-of-art Applications

Automating Analogue AI Chip Design with Genetic Search

AI for EDA/Physical Design: Driving the AI Revolution: The Crucial Role of 3D-IC

A review of design intelligence: progress, problems, and challenges

Generative AI for Product Design: Getting the Right Design and the Design Right

Reconfigurability, Why It Matters in AI Tasks Processing: A Survey of Reconfigurable AI Chips.

Reconfigurable Computing: a Promising Microchip Architecture for Artificial Intelligence

Revolutionizing microfluidics with artificial intelligence: a new dawn for lab-on-a-chip technologies

Chip-Chat: Challenges and Opportunities in Conversational Hardware Design

Artificial intelligence in analogue circuit design

AI on a chip