Efficient Intelligence with Applications in Embedded Sensing

Xingxing Zuo,Yong Liu

DOI: https://doi.org/10.3390/s23104816

2023-01-01

Abstract:Despite the fact that computational technology continues to rapidly develop, edge devices and embedded systems are still limited in terms of their computation resources due to such factors as power consumption, physical size constraints, and manufacturing cost [...].

What problem does this paper attempt to address?

Breaking the Energy-Efficiency Barriers for Smart Sensing Applications with “sensing with Computing” Architectures

Xinghua Yang,Zheyu Liu,Kechao Tang,Xunzhao Yin,Cheng Zhuo,Qi Wei,Fei Qiao

DOI: https://doi.org/10.1007/s11432-023-3760-8

2023-01-01

Science China Information Sciences

Abstract:With the developing technologies of artificial intelligence and the Internet of Things, intelligent IoT (iIoT) is prevailing currently. Design and implementation of integrated IoT nodes with continuous perception capability are indispensable to realize various smart terminal devices, which would also be vital to reduce the power consumption, improve the real-time performance, and enhance the security/privacy of the IoT system. In this paper, we present the architecture of “Sensing with Computing” and its chip design for smart sensing applications, which would support multi-modal perception signal processing with multi-dimension extension ability. Specially, we explore the analog/mixed-signal circuit designs and algorithm-hardware co-design methodologies for perception signal processing, and we also study the multi-modal integration of novel sensors and their interface technologies. Additionally, some multi-modal smart sensing systems with “Sensing + Computing in Memory” mixed-signal chips would be fabricated, which would support typical always-on smart sensing tasks.
Architecture, Challenges and Applications of Edge Computing

LI Linzhe,ZHOU Peilei,CHENG Peng,SHI Zhiguo

DOI: https://doi.org/10.11959/j.issn.2096-0271.2019010

2019-01-01

Abstract:Edge computing is a new type of computing models that performs computing tasks at the edge of the network.Compared with cloud computing,it can respond to user’s needs more quickly and reliably.Starting from the shortcomings of cloud computing,the concept and general architecture of edge computing were illustrated,and then two reference frameworks proposed by industry alliances were elaborated.Four challenges of edge computing and their latest research progress were summarized.With the development of theory and technology related to edge computing,it will become a key technology to promote the upgrade of Internet of things (IoT) services.For this reason,two applications of edge computing in manufacturing and security monitoring were introduced.
Senputing: An Ultra-Low-Power Always-On Vision Perception Chip Featuring the Deep Fusion of Sensing and Computing

Han Xu,Ningchao Lin,Li Luo,Qi Wei,Runsheng Wang,Cheng Zhuo,Xunzhao Yin,Fei Qiao,Huazhong Yang

DOI: https://doi.org/10.1109/TCSI.2021.3090668

2022-01-01

Abstract:Always-on intelligent visual perception applications are widely deployed in edges in the AIoT era. In order to eliminate power costs of data conversion and transmission, this paper proposes Senputing, an ultra-low-power processing-in-sensor chip that completely fuses sensing and computing together for a BNN-based hierarchical processing system. This chip could operate in two modes. In computation ...
Edge Intelligence: Empowering Intelligence to the Edge of Network

Dianlei Xu,Tong Li,Yong Li,Xiang Su,Sasu Tarkoma,Tao Jiang,Jon Crowcroft,Pan Hui

DOI: https://doi.org/10.1109/jproc.2021.3119950

IF: 20.6

2021-11-01

Proceedings of the IEEE

Abstract:Edge intelligence refers to a set of connected systems and devices for data collection, caching, processing, and analysis proximity to where data are captured based on artificial intelligence. Edge intelligence aims at enhancing data processing and protects the privacy and security of the data and users. Although recently emerged, spanning the period from 2011 to now, this field of research has shown explosive growth over the past five years. In this article, we present a thorough and comprehensive survey of the literature surrounding edge intelligence. We first identify four fundamental components of edge intelligence, i.e., edge caching, edge training, edge inference, and edge offloading based on theoretical and practical results pertaining to proposed and deployed systems. We then aim for a systematic classification of the state of the solutions by examining research results and observations for each of the four components and present a taxonomy that includes practical problems, adopted techniques, and application goals. For each category, we elaborate, compare, and analyze the literature from the perspectives of adopted techniques, objectives, performance, advantages and drawbacks, and so on. This article provides a comprehensive survey of edge intelligence and its application areas. In addition, we summarize the development of the emerging research fields and the current state of the art and discuss the important open issues and possible theoretical and technical directions.

engineering, electrical & electronic
Edge-Centric Intelligent Computing: Intelligence, Privacy and Applications

Xiangyang Li

DOI: https://doi.org/10.1109/NaNA51271.2020.00007

2020-01-01

Abstract:Nowadays, we have witnessed the explosion of data and devices in the areas of IoT and mobile computing. Moreover, we are facing more and more complicated computation tasks, serious privacy and security problems, and critical delay requirements. All these challenges call for the applications of edge computing to deploy computing resource closed to mobile users and the data source. In this talk, based on our own research results, we will mainly focus on the theory and platform implemenation of edge intelligence, including online intelligence, distributed intelligence, as well as the privacy and security issues involved. We will also elaborate our current progress in the key applications of our odge platform such as Automatic Driving and AIoT Security.
Circuit and System Technologies for Energy-Efficient Edge Robotics

Zishen Wan,Ashwin Sanjay Lele,Arijit Raychowdhury

DOI: https://doi.org/10.48550/arXiv.2202.11237

2022-02-23

Abstract:As we march towards the age of ubiquitous intelligence, we note that AI and intelligence are progressively moving from the cloud to the edge. The success of Edge-AI is pivoted on innovative circuits and hardware that can enable inference and limited learning in resource-constrained edge autonomous systems. This paper introduces a series of ultra-low-power accelerator and system designs on enabling the intelligence in edge robotic platforms, including reinforcement learning neuromorphic control, swarm intelligence, and simultaneous mapping and localization. We put an emphasis on the impact of the mixed-signal circuit, neuro-inspired computing system, benchmarking and software infrastructure, as well as algorithm-hardware co-design to realize the most energy-efficient Edge-AI ASICs for the next-generation intelligent and autonomous systems.

Hardware Architecture,Robotics
A Survey on Edge Intelligence

Dianlei Xu,Tong Li,Yong Li,Xiang Su,Sasu Tarkoma,Pan Hui

2020-01-01

Abstract:Edge intelligence refers to a set of connected systems and devices for data collection, caching, processing, and analysis in locations close to where data is captured based on artificial intelligence. The aim of edge intelligence is to enhance the quality and speed of data processing and protect the privacy and security of the data. Although recently emerged, spanning the period from 2011 to now, this field of research has shown explosive growth over the past five years. In this paper, we present a thorough and comprehensive survey on the literature surrounding edge intelligence. We first identify four fundamental components of edge intelligence, namely edge caching, edge training, edge inference, and edge offloading, based on theoretical and practical results pertaining to proposed and deployed systems. We then aim for a systematic classification of the state of the solutions by examining research results and observations for each of the four components and present a taxonomy that includes practical problems, adopted techniques, and application goals. For each category, we elaborate, compare and analyse the literature from the perspectives of adopted techniques, objectives, performance, advantages and drawbacks, etc. This survey article provides a comprehensive introduction to edge intelligence and its application areas. In addition, we summarise the development of the emerging research field and the current state-of-the-art and discuss the important open issues and possible theoretical and technical solutions.
Innovative Architecture of Single Chip Edge Device Based on Virtualization Technology.

Zhang Yunzhou,Zhang Mo,Liu Haoqi,Zhang Gang

DOI: https://doi.org/10.1016/j.pmcj.2018.12.004

IF: 3.848

2019-01-01

Pervasive and Mobile Computing

Abstract:Single-chip edge devices (SCEDs) are small in size and low in power consumption. They are especially suitable for smart nodes of Internet of Things (IoT) to form an edge sub-cloud (ESC). Unfortunately, SCED’s intensive computing ability is often unsatisfactory. Therefore, we need to migrate cloud computing virtualization technology into SCED, and manage its on-chip resources by cloud computing mode, so as to make its computing capability more powerful. The focus of this research is how to set up the on-chip cloud architecture of a domain general purpose integrated circuit (DGIC). The goal of this research is to provide a DGIC solution for SCED, which owns both of CPU customizable semantic processes and ASIC reconfigurable syntax elements. The cooperation of multiple SCED devices can form a strong edge sub-cloud ESC. Its on-chip cloud architecture can ensure the security and confidentiality of ESC. Based on the on-chip cloud structure of DGIC, we fabricated and tested a SCED sample in the acceleration domain of multi-island genetic algorithm. Its acceleration ratio was obviously better than the existing GPU + CPU approach, which has the advantages of small in size and low in power consumption.
A Future Perspective on In-Sensor Computing

Wen Pan,Jiyuan Zheng,Lai Wang,Yi Luo

DOI: https://doi.org/10.1016/j.eng.2022.01.009

IF: 12.834

2022-01-01

Engineering

Abstract:The use of artificial intelligence (AI) is escalating rapidly in most applications nowadays, thanks to breakthroughs in biology and mathematics. Novel hardware systems are greatly needed to meet the requirements of AI, which include computing capacity and energy efficiency.
A Review of Artificial Intelligence in Embedded Systems

Zhaoyun Zhang,Jingpeng Li

DOI: https://doi.org/10.3390/mi14050897

IF: 3.4

2023-04-23

Micromachines

Abstract:Advancements in artificial intelligence algorithms and models, along with embedded device support, have resulted in the issue of high energy consumption and poor compatibility when deploying artificial intelligence models and networks on embedded devices becoming solvable. In response to these problems, this paper introduces three aspects of methods and applications for deploying artificial intelligence technologies on embedded devices, including artificial intelligence algorithms and models on resource-constrained hardware, acceleration methods for embedded devices, neural network compression, and current application models of embedded AI. This paper compares relevant literature, highlights the strengths and weaknesses, and concludes with future directions for embedded AI and a summary of the article.

chemistry, analytical,nanoscience & nanotechnology,instruments & instrumentation,physics, applied
Communication-Efficient Edge AI Inference Over Wireless Networks

Kai Yang,Yong Zhou,Zhanpeng Yang,Yuanming Shi

DOI: https://doi.org/10.48550/arXiv.2004.13351

IF: 4.729

2020-04-28

Signal Processing

Abstract:Given the fast growth of intelligent devices, it is expected that a large number of high-stake artificial intelligence (AI) applications, e.g., drones, autonomous cars, tactile robots, will be deployed at the edge of wireless networks in the near future. As such, the intelligent communication networks will be designed to leverage advanced wireless techniques and edge computing technologies to support AI-enabled applications at various end devices with limited communication, computation, hardware and energy resources. In this article, we shall present the principles of efficient deployment of model inference at network edge to provide low-latency and energy-efficient AI services. This includes the wireless distributed computing framework for low-latency device distributed model inference as well as the wireless cooperative transmission strategy for energy-efficient edge cooperative model inference. The communication efficiency of edge inference systems is further improved by building up a smart radio propagation environment via intelligent reflecting surface.
Intelligence-Empowered Mobile Edge Computing: Framework, Issues, Implementation, and Outlook

Kai Jiang,Chuan Sun,Huan Zhou,Xiuhua Li,Mianxiong Dong,Victor C. M. Leung,Kai Jiang,Chuan Sun,Huan Zhou,Xiuhua Li,Mianxiong Dong,Victor C. M. Leung

DOI: https://doi.org/10.1109/mnet.101.2100054

IF: 10.294

2021-09-01

IEEE Network

Abstract:Recently, artificial intelligence (AI) is undergoing a sustained success renaissance as it can substantially improve networks' cognitive performance and intelligence, thereby contributing to fully unleashing the potential of big data. Pushing the AI frontiers to the network edge in this context and trends has given rise to an emerging interdiscipline, namely, edge intelligence (EI). Indeed, EI can sink the cloud's processing capabilities to the edge side, and provide real-time response while enabling more intelligent services with high performance. However, the successful realization of EI is still in its infancy. Thus, this article aims to provide a comprehensive study of this young field from a broader perspective. We first discuss the prior knowledge based on which we take a holistic overview of EI, including its key concepts, advantages, and development trend. Then we highlight the collaboration modes in EI, and discuss two typical case categories. Subsequently, the entire processes of model training and inference in EI are elaborated. Finally, we discuss a typical application scenario and its specific embodiment of EI and strive to shed light on some potential challenges, which may facilitate the transformation of EI from theory to practice.

computer science, information systems,telecommunications,engineering, electrical & electronic, hardware & architecture
Energy efficient computing: from milliwatt to megawatt

Feng Zhao

DOI: https://doi.org/10.1109/ISLPED.2013.6629256

2013-01-01

Abstract:Energy is an important resource in today's computing systems, from mega data centers to tiny embedded devices. But the energy efficiency of these systems can be limited by our inability to accurately model and predict the energy usage. In this talk, I will describe our research in designing and deploying resource-constrained wireless sensor and mobile systems, and our work on monitoring and optimizing data centers with Internet-scale workloads. I will focus on the principles and tradeoffs learned from working on these systems. The design and optimization for energy efficiency requires a rethinking of the entire stack, from hardware to systems, networking, programming, and all the way to applications.
Reducing the Energy Cost of Inference via In-sensor Information Processing

Sai Zhang,Mingu Kang,Charbel Sakr,Naresh Shanbhag

DOI: https://doi.org/10.48550/arXiv.1607.00667

2016-07-04

Abstract:There is much interest in incorporating inference capabilities into sensor-rich embedded platforms such as autonomous vehicles, wearables, and others. A central problem in the design of such systems is the need to extract information locally from sensed data on a severely limited energy budget. This necessitates the design of energy-efficient sensory embedded system. A typical sensory embedded system enforces a physical separation between sensing and computational subsystems - a separation mandated by the differing requirements of the sensing and computational functions. As a consequence, the energy consumption in such systems tends to be dominated by the energy consumed in transferring data over the sensor-processor interface (communication energy) and the energy consumed in processing the data in digital processor (computational energy). In this article, we propose an in-sensor computing architecture which (mostly) eliminates the sensor-processor interface by embedding inference computations in the noisy sensor fabric in analog and retraining the hyperparameters in order to compensate for non-ideal computations. The resulting architecture referred to as the Compute Sensor - a sensor that computes in addition to sensing - represents a radical departure from the conventional. We show that a Compute Sensor for image data can be designed by embedding both feature extraction and classification functions in the analog domain in close proximity to the CMOS active pixel sensor (APS) array. Significant gains in energy-efficiency are demonstrated using behavioral and energy models in a commercial semiconductor process technology. In the process, the Compute Sensor creates a unique opportunity to develop machine learning algorithms for information extraction from data on a noisy underlying computational fabric.

Hardware Architecture,Emerging Technologies
Efficient Deep Learning Infrastructures for Embedded Computing Systems: A Comprehensive Survey and Future Envision

Xiangzhong Luo,Di Liu,Hao Kong,Shuo Huai,Hui Chen,Guochu Xiong,Weichen Liu

DOI: https://doi.org/10.48550/arXiv.2411.01431

2024-11-03

Abstract:Deep neural networks (DNNs) have recently achieved impressive success across a wide range of real-world vision and language processing tasks, spanning from image classification to many other downstream vision tasks, such as object detection, tracking, and segmentation. However, previous well-established DNNs, despite being able to maintain superior accuracy, have also been evolving to be deeper and wider and thus inevitably necessitate prohibitive computational resources for both training and inference. This trend further enlarges the computational gap between computation-intensive DNNs and resource-constrained embedded computing systems, making it challenging to deploy powerful DNNs upon real-world embedded computing systems towards ubiquitous embedded intelligence. To alleviate the above computational gap and enable ubiquitous embedded intelligence, we, in this survey, focus on discussing recent efficient deep learning infrastructures for embedded computing systems, spanning from training to inference, from manual to automated, from convolutional neural networks to transformers, from transformers to vision transformers, from vision models to large language models, from software to hardware, and from algorithms to applications. Specifically, we discuss recent efficient deep learning infrastructures for embedded computing systems from the lens of (1) efficient manual network design for embedded computing systems, (2) efficient automated network design for embedded computing systems, (3) efficient network compression for embedded computing systems, (4) efficient on-device learning for embedded computing systems, (5) efficient large language models for embedded computing systems, (6) efficient deep learning software and hardware for embedded computing systems, and (7) efficient intelligent applications for embedded computing systems.

Machine Learning,Artificial Intelligence
An Introduction to Communication Efficient Edge Machine Learning

Qiao Lan,Zezhong Zhang,Yuqing Du,Zhenyi Lin,Kaibin Huang

DOI: https://doi.org/10.48550/arXiv.1912.01554

2019-12-04

Abstract:In the near future, Internet-of-Things (IoT) is expected to connect billions of devices (e.g., smartphones and sensors), which generate massive real-time data at the network edge. Intelligence can be distilled from the data to support next-generation AI-powered applications, which is called edge machine learning. One challenge faced by edge learning is the communication bottleneck, which is caused by the transmission of high-dimensional data from many edge devices to edge servers for learning. Traditional wireless techniques focusing only on efficient radio access are ineffective in tackling the challenge. Solutions should be based on a new approach that seamlessly integrates communication and computation. This has led to the emergence of a new cross-disciplinary paradigm called communication efficient edge learning. The main theme in the area is to design new communication techniques and protocols for efficient implementation of different distributed learning frameworks (i.e., federated learning) in wireless networks. This article provides an overview of the emerging area by introducing new design principles, discussing promising research opportunities, and providing design examples based on recent work.

Information Theory,Signal Processing
Power Efficient Machine Learning Models Deployment on Edge IoT Devices

Anastasios Fanariotis,Theofanis Orphanoudakis,Konstantinos Kotrotsios,Vassilis Fotopoulos,George Keramidas,Panagiotis Karkazis

DOI: https://doi.org/10.3390/s23031595

IF: 3.9

2023-02-02

Sensors

Abstract:Computing has undergone a significant transformation over the past two decades, shifting from a machine-based approach to a human-centric, virtually invisible service known as ubiquitous or pervasive computing. This change has been achieved by incorporating small embedded devices into a larger computational system, connected through networking and referred to as edge devices. When these devices are also connected to the Internet, they are generally named Internet-of-Thing (IoT) devices. Developing Machine Learning (ML) algorithms on these types of devices allows them to provide Artificial Intelligence (AI) inference functions such as computer vision, pattern recognition, etc. However, this capability is severely limited by the device's resource scarcity. Embedded devices have limited computational and power resources available while they must maintain a high degree of autonomy. While there are several published studies that address the computational weakness of these small systems-mostly through optimization and compression of neural networks- they often neglect the power consumption and efficiency implications of these techniques. This study presents power efficiency experimental results from the application of well-known and proven optimization methods using a set of well-known ML models. The results are presented in a meaningful manner considering the "real world" functionality of devices and the provided results are compared with the basic "idle" power consumption of each of the selected systems. Two different systems with completely different architectures and capabilities were used providing us with results that led to interesting conclusions related to the power efficiency of each architecture.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Towards Edge-assisted Internet of Things: From Security and Efficiency Perspectives

Jianbing Ni,Xiaodong Lin,Xuemin,Shen

DOI: https://doi.org/10.48550/arXiv.1902.07094

2019-02-19

Cryptography and Security

Abstract:As we are moving towards the Internet of Things (IoT) era, the number of connected physical devices is increasing at a rapid pace. Mobile edge computing is emerging to handle the sheer volume of produced data and reach the latency demand of computation-intensive IoT applications. Although the advance of mobile edge computing on service latency is studied solidly, security and efficiency on data usage in mobile edge computing have not been clearly identified. In this article, we examine the architecture of mobile edge computing and explore the potentials of utilizing mobile edge computing to enhance data analysis for IoT applications, while achieving data security and computational efficiency. Specifically, we first introduce the overall architecture and several promising edge-assisted IoT applications. We then study the security, privacy and efficiency challenges in data processing for mobile edge computing, and discuss the opportunities to enhance data security and improve computational efficiency with the assistance of edge computing, including secure data aggregation, secure data deduplication and secure computational offloading. Finally, several interesting directions on edge-empowered data analysis are presented for future research.
Integrated Sensing-Communication-Computation for Edge Artificial Intelligence

Dingzhu Wen,Xiaoyang Li,Yong Zhou,Yuanming Shi,Sheng Wu,Chunxiao Jiang

2024-04-18

Abstract:Edge artificial intelligence (AI) has been a promising solution towards 6G to empower a series of advanced techniques such as digital twins, holographic projection, semantic communications, and auto-driving, for achieving intelligence of everything. The performance of edge AI tasks, including edge learning and edge AI inference, depends on the quality of three highly coupled processes, i.e., sensing for data acquisition, computation for information extraction, and communication for information transmission. However, these three modules need to compete for network resources for enhancing their own quality-of-services. To this end, integrated sensing-communication-computation (ISCC) is of paramount significance for improving resource utilization as well as achieving the customized goals of edge AI tasks. By investigating the interplay among the three modules, this article presents various kinds of ISCC schemes for federated edge learning tasks and edge AI inference tasks in both application and physical layers.

Information Theory,Artificial Intelligence,Machine Learning
Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computing

Zhi Zhou,Xu Chen,En Li,Liekang Zeng,Ke Luo,Junshan Zhang

2019-05-24

Abstract:With the breakthroughs in deep learning, the recent years have witnessed a booming of artificial intelligence (AI) applications and services, spanning from personal assistant to recommendation systems to video/audio surveillance. More recently, with the proliferation of mobile computing and Internet-of-Things (IoT), billions of mobile and IoT devices are connected to the Internet, generating zillions Bytes of data at the network edge. Driving by this trend, there is an urgent need to push the AI frontiers to the network edge so as to fully unleash the potential of the edge big data. To meet this demand, edge computing, an emerging paradigm that pushes computing tasks and services from the network core to the network edge, has been widely recognized as a promising solution. The resulted new inter-discipline, edge AI or edge intelligence, is beginning to receive a tremendous amount of interest. However, research on edge intelligence is still in its infancy stage, and a dedicated venue for exchanging the recent advances of edge intelligence is highly desired by both the computer system and artificial intelligence communities. To this end, we conduct a comprehensive survey of the recent research efforts on edge intelligence. Specifically, we first review the background and motivation for artificial intelligence running at the network edge. We then provide an overview of the overarching architectures, frameworks and emerging key technologies for deep learning model towards training/inference at the network edge. Finally, we discuss future research opportunities on edge intelligence. We believe that this survey will elicit escalating attentions, stimulate fruitful discussions and inspire further research ideas on edge intelligence.

Distributed, Parallel, and Cluster Computing,Artificial Intelligence,Networking and Internet Architecture

Efficient Intelligence with Applications in Embedded Sensing

Breaking the Energy-Efficiency Barriers for Smart Sensing Applications with “sensing with Computing” Architectures

Architecture, Challenges and Applications of Edge Computing

Senputing: An Ultra-Low-Power Always-On Vision Perception Chip Featuring the Deep Fusion of Sensing and Computing

Edge Intelligence: Empowering Intelligence to the Edge of Network

Edge-Centric Intelligent Computing: Intelligence, Privacy and Applications

Circuit and System Technologies for Energy-Efficient Edge Robotics

A Survey on Edge Intelligence

Innovative Architecture of Single Chip Edge Device Based on Virtualization Technology.

A Future Perspective on In-Sensor Computing

A Review of Artificial Intelligence in Embedded Systems

Communication-Efficient Edge AI Inference Over Wireless Networks

Intelligence-Empowered Mobile Edge Computing: Framework, Issues, Implementation, and Outlook

Energy efficient computing: from milliwatt to megawatt

Reducing the Energy Cost of Inference via In-sensor Information Processing

Efficient Deep Learning Infrastructures for Embedded Computing Systems: A Comprehensive Survey and Future Envision

An Introduction to Communication Efficient Edge Machine Learning

Power Efficient Machine Learning Models Deployment on Edge IoT Devices

Towards Edge-assisted Internet of Things: From Security and Efficiency Perspectives

Integrated Sensing-Communication-Computation for Edge Artificial Intelligence

Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computing