RIS rocks at RSNA. With workflow on everyone's minds, radiology information systems took center stage at imaging's super-conference.

M. Hagland

2008-02-01

Abstract:

What problem does this paper attempt to address?

Development of a Human-Robot Hybrid Intelligent System Based on Brain Teleoperation and Deep Learning SLAM

Jianlong Li,Zhijun Li,Ying Feng,Yiliang Liu,Guangming Shi

DOI: https://doi.org/10.1109/tase.2019.2911667

IF: 6.636

2019-01-01

IEEE Transactions on Automation Science and Engineering

Abstract:To achieve the better navigation performance of a mobile robot in the unknown environments, a novel human–robot hybrid system incorporating a motor-imagery (MI)-based brain teleoperation control is presented in this paper, where a deep-learning-based active perception is developed in the simultaneous localization and mapping (SLAM) framework. Using the deep-learning-based object recognition in the red–green–blue-depth (RGB-D) data acquisition process, the designed SLAM approach can select the valid feature points effectively, and the speed of displacement tracking can be improved by combining the oriented FAST and rotated BRIEF (ORB) SLAM algorithm with the optical flow method. The global trajectory map can also be mended using graph-based nonlinear error optimization. In addition, to build the connection between human intentions and the robot control commands flexibly in the developed mobile robot, a common spatial pattern (CSP)-based support vector machine (SVM) classification algorithm is proposed so that the control commands can be obtained directly from the human electroencephalograph (EEG) signals, which are preanalyzed and classified using the phenomena of event-related synchronization/desynchronization (ERS/ERD). Experiments involving several operators have verified the effectiveness of the proposed framework in the actual unstructured environments. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Note to Practitioners</italic> —This paper is motivated by the exploration of the mobile robots remotely controlled by the disables in an unstructured environment that includes some unknown moving objects in the background. In the conventional approaches, the image feedback and the brain–computer interface-based EEG signals invoked by the visual stimulus are used to guide the motion of the robots. In this paper, the MI of left or right hand is adopted as an input of the brain teleoperation system, and the EEG signals are classified into two categories representing two robot control commands through the designed algorithm. Besides, a deep-learning-based SLAM is designed to analyze the image and depth of the environmental information provided by the robot RGB-D sensor, and the results can be transferred into a 3-D map locating the robot and assisting the operator to understand the operating environment. It has been verified that the deep-learning-based SLAM presented is more efficient and robust than traditional SLAM. The feasibility of the system is demonstrated by a set of experiments in the corridor environment.
Intelligent Metasurface Imager and Recognizer

Lianlin Li,Ya Shuang,Qian Ma,Haoyang Li,Hanting Zhao,Menglin Wei1,Che Liu,Chenglong Hao,Cheng-Wei Qiu,Tie Jun Cui

DOI: https://doi.org/10.48550/arXiv.1910.00497

2019-09-02

Abstract:It is ever-increasingly demanded to remotely monitor people in daily life using radio-frequency probing signals. However, conventional systems can hardly be deployed in real-world settings since they typically require objects to either deliberately cooperate or carry a wireless active device or identification tag. To accomplish the complicated successive tasks using a single device in real time, we propose a smart metasurface imager and recognizer simultaneously, empowered by a network of artificial neural networks (ANNs) for adaptively controlling data flow. Here, three ANNs are employed in an integrated hierarchy: transforming measured microwave data into images of whole human body; classifying the specifically designated spots (hand and chest) within the whole image; and recognizing human hand signs instantly at Wi-Fi frequency of 2.4 GHz. Instantaneous in-situ imaging of full scene and adaptive recognition of hand signs and vital signs of multiple non-cooperative people have been experimentally demonstrated. We also show that the proposed intelligent metasurface system work well even when it is passively excited by stray Wi-Fi signals that ubiquitously exist in our daily lives. The reported strategy could open a new avenue for future smart cities, smart homes, human-device interactive interfaces, healthy monitoring, and safety screening free of visual privacy issues.

Applied Physics,Signal Processing
Intelligent Metasurface Based Indoor Positioning and Control System with Non-Cooperative Blind Signals

Hanting Zhao,Li,Hengxin Ruan,Hongrui Zhang,Zhuo Wang,Lianlin Li

DOI: https://doi.org/10.1109/icmmt52847.2021.9618588

2021-01-01

Abstract:It is ever-increasingly demanded to monitor the position of the people and the robot in industrial production and home life scene. However, conventional systems are limited in use because of low location accuracy and huge energy consumption. To utilize the ambient potential resources like the Wi-Fi signal, we propose a novel indoor positioning system simultaneously, uses the artificial neural networks (ANNs) to extract the necessary information for positioning and imaging. We use the metasurface to allocate the distribution and control the propagation of the Non-Cooperative Blind Wi-Fi signal to achieve the communication with the intelligent terminal. Other ANNs like deep Q-learning structure network (DQN) for comprehending the information and controlling the indoor intelligent entities are employed. Instantaneous in-situ positioning and imaging of full scene and real-time instruction issue of multiple intelligent entities have been experimentally demonstrated. The reported strategy could open a new avenue for future smart factory, smart homes, internet of things, healthy monitoring, and safety screening free of visual privacy issues.
Self-sensing Intelligent Microrobots for Non-Invasive and Wireless Monitoring Systems

Jing Zhao,Zhongyi Li,Kun Wang,Chaojian Hou,Chunyang Li,Fanqing Zhang,Wu Ren,Dong Liu

DOI: https://doi.org/10.21203/rs.3.rs-2759720/v1

2023-01-01

Abstract:Abstract Microrobots present great potential and wide applications in in-situ treatment and attract tremendous attention due to their small size and flexible movement. However, functional modification for microrobots became more important for their interaction with the environment, except for precise motion control. Here, we design a novel artificial intelligence (AI) microrobot, which can respond to changes in the external environment without onboard energy supplying and transmit signals wirelessly in real time. The AI microrobot can cooperate with external electromagnetic imaging equipment and enhance the local radiofrequency (RF) magnetic field to achieve a large penetration sensing depth and a high spatial resolution. The working ranges are determined by the structure of the sensor circuit and the corresponding enhancement effect can be modulated by the conductivity and permittivity of the surrounding environment, reaching ~ 560 times at most. Under the control of an external magnetic field, the magnetic tail can actuate the microrobotic agent to move accurately, with great potential to realize in-situ monitoring in different places in a human body in an almost noninvasive fashion, especially around potential diseases, which is of great significance for early disease discovery and accurate diagnosis. In addition, the compatible fabrication process provides an approach to swarms of functional microrobots. The findings highlight the feasibility of the self-sensing AI microrobot for the development of in-situ diagnosis or even treatment according to the sensing signals.
Reconfigurable Intelligent Computational Surfaces: when Wave Propagation Control Meets Computing

Bo Yang,Xuelin Cao,Jindan Xu,Chongwen Huang,George C. Alexandropoulos,Linglong Dai,Merouane Debbah,H. Vincent Poor,Chau Yuen

DOI: https://doi.org/10.1109/mwc.005.2200487

IF: 12.777

2023-01-01

IEEE Wireless Communications

Abstract:The envisioned sixth-generation (6G) of wireless networks will involve an intelligent integration of communications and computing to meet the urgent demands of task-oriented applications. To realize the concept of the smart radio environment, reconfigurable intelligent surfaces (RISs) are becoming promising options for offering programmable propagation of impinging electromagnetic signals via external control. However, the purely reflective nature of conventional RISs induces significant challenges in supporting a variety of computation tasks, such as wave-based calculation and signal processing. To fulfill such computing demands, new metamaterials are needed to complement the existing technologies of reconfigurable surfaces, enabling further diversification of electronics and their applications. In this event, we introduce the concept of reconfigurable intelligent computational surface (RICS), which is composed of two reconfigurable multifunctional layers: the reconfigurable beamforming layer, which is responsible for tunable signal reflection, absorption, and refraction, and the intelligence computation layer, which concentrates on meta-materials-based task-oriented computing. By exploiting the recent trends in computational metamaterials, RICSs have the potential to make joint computation and communication a reality. We further demonstrate two typical tasks of RICSs, in particular a spectrum learning task for intelligent communications and a signal processing task for physical layer security. Future research challenges arising from the design and operation of RICSs are finally highlighted.
Multi‐Task and Multi‐Scale Intelligent Electromagnetic Sensing with Distributed Multi‐Frequency Reprogrammable Metasurfaces

Zhuo Wang,Hongrui Zhang,Hanting Zhao,Shengguo Hu,Tie Jun Cui,Lianlin Li

DOI: https://doi.org/10.1002/adom.202203153

IF: 9

2024-01-01

Advanced Optical Materials

Abstract:Reprogrammable metasurface (RM) has been demonstrated as a key enabling technology for resolving the difficulties arising in conventional electromagnetic (EM) sensing strategies, and the RM-enabled intelligent EM sensing has emerged as a new paradigm with many advanced functionalities that are thought to be impossible. However, the RM-enabled sensing strategies developed so far are usually limited to the single-scale sensing task and the cooperative target, since they are designed to operate at a single frequency band and have the relatively small view angle. To address the formidable challenges, here the concept of multi-task multi-scale intelligent sensing is proposed with algorithm-driven distributed multi-frequency RMs. For principle illustration, a proof-of-principle system working at S-, C-, and X-bands is designed, and it is experimentally demonstrated that the system is capable of monitoring continuously the action behavior and healthy status of the target acting freely in real-world indoor settings. It is faithfully expected that the presented strategy could open a new avenue in the areas of internet-of-things (IoTs), digital twins, and so on.
Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces

George C. Alexandropoulos,Kyriakos Stylianopoulos,Chongwen Huang,Chau Yuen,Mehdi Bennis,Merouane Debbah

DOI: https://doi.org/10.1109/jproc.2022.3174030

IF: 20.6

2022-01-01

Proceedings of the IEEE

Abstract:The emerging technology of reconfigurable intelligent surfaces (RISs) is provisioned as an enabler of smart wireless environments, offering a highly scalable, low-cost, hardware-efficient, and almost energy-neutral solution for dynamic control of the propagation of electromagnetic signals over the wireless medium, ultimately providing increased environmental intelligence for diverse operation objectives. One of the major challenges with the envisioned dense deployment of RISs in such reconfigurable radio environments is the efficient configuration of multiple metasurfaces with limited, or even the absence of, computing hardware. In this article, we consider multiuser and multi-RIS-empowered wireless systems and present a thorough survey of the online machine learning approaches for the orchestration of their various tunable components. Focusing on the sum-rate maximization as a representative design objective, we present a comprehensive problem formulation based on deep reinforcement learning (DRL). We detail the correspondences among the parameters of the wireless system and the DRL terminology, and devise generic algorithmic steps for the artificial neural network training and deployment while discussing their implementation details. Further practical considerations for multi-RIS-empowered wireless communications in the sixth-generation (6G) era are presented along with some key open research challenges. Different from the DRL-based status quo, we leverage the independence between the configuration of the system design parameters and the future states of the wireless environment, and present efficient multiarmed bandits approaches, whose resulting sum-rate performances are numerically shown to outperform random configurations, while being sufficiently close to the conventional deep $Q$ network (DQN) algorithm, but with lower implementation complexity.
Indoor Signal Focusing with Deep Learning Designed Reconfigurable Intelligent Surfaces

Chongwen Huang,George C. Alexandropoulos,Chau Yuen,Mérouane Debbah

DOI: https://doi.org/10.1109/spawc.2019.8815412

2019-01-01

Abstract:Reconfigurable Intelligent Surfaces (RISs) comprised of tunable unit elements have been recently considered in indoor communication environments for focusing signal reflections to intended user locations. However, the current proofs of concept require complex operations for the RIS configuration, which are mainly realized via wired control connections. In this paper, we present a deep learning method for efficient online wireless configuration of RISs when deployed in indoor communication environments. According to the proposed method, a database of coordinate fingerprints is implemented during an offline training phase. This fingerprinting database is used to train the weights and bias of a properly designed Deep Neural Network (DNN), whose role is to unveil the mapping between the measured coordinate information at a user location and the configuration of the RIS's unit cells that maximizes this user's received signal strength. During the online phase of the presented method, the trained DNN is fed with the measured position information at the target user to output the optimal phase configurations of the RIS for signal power focusing on this intended location. Our realistic simulation results using ray tracing on a three dimensional indoor environment demonstrate that the proposed DNN-based configuration method exhibits its merits for all considered cases, and effectively increases the achievable throughput at the target user location.
Realization of Secure Robotic Brain Via Programmable Metasurface with Robust High‐Order BIC

Xiuyu Wang,Xiaoman Wang,Qun Ren,Jianwei You,Kaiwen Zou,Boxiang Yang,Zhihao Lan,Liu He,Wei E. I. Sha,Jianquan Yao

DOI: https://doi.org/10.1002/adom.202401611

IF: 9

2024-10-11

Advanced Optical Materials

Abstract:An aluminum‐graphene metasurface with high‐order BIC is presented which using magnetic EIT effect to achieve excitation of high‐order BIC with high robustness. One application of the high‐order BIC phenomenon is for secure hardware based on the DHR architecture used to fulfill requirements for intelligent robots. These insights provide broader prospects for terahertz sensing and communication applications. Terahertz waves can be widely used for short‐range communication in complex indoor environments and non‐destructive object detection applications. Metasurfaces are widely used in terahertz sensing and communication devices because they can modulate terahertz waves in multiple dimensions. Metamaterial robot brain can utilize metasurfaces' powerful direct modulation ability to achieve sensing and communication functions. The metasurface devices realized based on Dynamic Heterogeneous Redundancy (DHR) architecture can improve the confidentiality and security of terahertz wave wireless communication. While the intrinsic ohmic loss and quality factor of usual metallic metamaterials are usually low, the concept of bound states in the continuum (BIC) has been proposed for stronger terahertz‐matter interactions. Among them, high‐order BICs are of interest because of their strong robustness to structural defects. Therefore, an aluminium‐graphene hybrid metasurface with high‐order BIC is proposed. We have the principle of excitation of high‐order BICs is investigated and creatively proposed with high robustness realized using the magnetical EIT effect. The robustness of the high‐order BIC is also utilized to design security hardware based on DHR architecture. The designed secure hardware can satisfy the demand for an intelligent robotic brain to the internal terahertz wave confidential wireless communication.

materials science, multidisciplinary,optics
Intelligent Reflecting Surface Enhanced Indoor Robot Path Planning: A Radio Map-Based Approach

Xidong Mu,Yuanwei Liu,Li Guo,Jiaru Lin,Robert Schober

DOI: https://doi.org/10.1109/twc.2021.3062089

IF: 10.4

2021-07-01

IEEE Transactions on Wireless Communications

Abstract:Integrating robots into cellular networks creating connected robotic users has emerged as a promising technology for future smart cities and smart factories due to their low cost and high maneuverability. However, the requirement of establishing stable and high-quality communication links to the robotic users greatly restricts their applicability, especially in indoor environments where obstacles may block the wireless link. To tackle this challenge, in this paper, an indoor robot navigation system is investigated, where an intelligent reflecting surface (IRS) is employed to enhance the connectivity between the access point (AP) and robotic users. Both single-user and multiple-user scenarios are considered. In the single-user scenario, one mobile robotic user (MRU) communicates with the AP. In the multiple-user scenario, the AP serves one MRU and one static robotic user (SRU) employing either non-orthogonal multiple access (NOMA) or orthogonal multiple access (OMA) transmission. The considered system is optimized for minimization of the travelling time/distance of the MRU from a given starting point to a predefined final location, while satisfying constraints on the communication quality of the robotic users. To this end, a radio map based approach is proposed to exploit location-dependent channel propagation knowledge. For the single-user scenario, a channel power gain map is constructed, which characterizes the spatial distribution of the maximum expected effective channel power gain of the MRU for the optimal IRS phase shifts. Based on the obtained channel power gain map, the communication-aware robot path planing problem is solved by exploiting graph theory. For the multiple-user scenario, a communication rate map is constructed, which characterizes the spatial distribution of the maximum expected rate of the MRU for the optimal power allocation at the AP and the optimal IRS phase shifts subject to a minimum ra-e requirement for the SRU. The joint optimization problem is efficiently solved by invoking bisection search and successive convex approximation methods. Then, a graph theory based solution for the robot path planning problem is derived by exploiting the obtained communication rate map. Our numerical results show that: 1) the required travelling distance of the MRU can be significantly reduced by deploying an IRS; 2) NOMA yields a higher communication rate for the MRU than OMA; 3) the IRS performance gain is significantly more pronounced for NOMA than for OMA.

telecommunications,engineering, electrical & electronic
In-situ manipulation of wireless link with reinforcement-learning-driven programmable metasurface in indoor environment

Jiawen Xu,Rong Zhang,Jie Ma,Hanting Zhao,Lianlin Li

DOI: https://doi.org/10.1016/j.jiixd.2023.06.007

2023-01-01

Journal of Information and Intelligence

Abstract:It is of great importance to control flexibly wireless links in the modern society, especially with the advent of the Internet of Things (IoT), fifth-generation communication (5G), and beyond. Recently, we have witnessed that programmable metasurface (PM) or reconfigurable intelligent surface (RIS) has become a key enabling technology for manipulating flexibly the wireless link; however, one fundamental but challenging issue is to online design the PM's control sequence in a complicated wireless environment, such as the real-world indoor environment. Here, we propose a reinforcement learning (RL) approach to online control of the PM and thus in-situ improve the quality of the underline wireless link. We designed an inexpensive one-bit PM working at around 2.442 GHz and developed associated RL algorithms, and demonstrated experimentally that it is capable of enhancing the quality of commodity wireless link by a factor of about 10 dB and beyond in multiple scenarios, even if the wireless transmitter is in the glancing angle of the PM in the real-world indoor environment. Moreover, we also prove that our RL algorithm can be extended to improve the wireless signals of receivers in dual-receiver scenario. We faithfully expect that the presented technique could hold important potentials in future wireless communication, smart homes, and many other fields.
Wireless Measurement and Control System for a Bio-Inspired Mini-Robot.

Cenyu Yang,Tao Song,Jinguang Wang,Zhe Wang,Qingmeng Wang,Jiansheng Xu

DOI: https://doi.org/10.1109/robio.2011.6181405

2011-01-01

Abstract:According to the hybrid actuation mechanism of the proposed bio-inspired mini-robot, a wireless measurement and control system based on magnetic field and radio signal was designed. This system is used to locate and control the bio-inspired mini-robot which consists of a measurement subsystem and a control subsystem. In the measurement subsystem, differential magnetic sensor module and video detection module were designed to achieve the position and direction of the mini-robot; in the control subsystem, uniform magnetic field generated by Helmholtz coils was used to adjust the direction of mini-robot, and PWM (Pulse-Width Modulation) signal control module was used to change the velocity of mini-robot. Utilizing the measurement subsystem, positions and directions of mini-robot were obtained by processing the signal detected with magnetic sensors, and compared with the video tracking results. Utilizing the dynamic model and the control strategy designed, closed-loop simulation was carried out for mini-robot to track an L-shaped trajectory. This experiment was also performed on the wireless measurement and control platform. Simulated and experimental results demonstrated the accuracy of the dynamic model and the attitude agility of the hybrid mini-robot. Results verified that the wireless measurement and control system could effectively control the bio-inspired mini-robot.
Homeostatic neuro-metasurfaces for dynamic wireless channel management

Zhixiang Fan,Chao Qian,Yuetian Jia,Zhedong Wang,Yinzhang Ding,Dengpan Wang,Longwei Tian,Erping Li,Tong Cai,Bin Zheng,Ido Kaminer,Hongsheng Chen

DOI: https://doi.org/10.1126/sciadv.abn7905

IF: 13.6

2022-07-08

Science Advances

Abstract:The physical basis of a smart city, the wireless channel, plays an important role in coordinating functions across a variety of systems and disordered environments, with numerous applications in wireless communication. However, conventional wireless channel typically necessitates high-complexity and energy-consuming hardware, and it is hindered by lengthy and iterative optimization strategies. Here, we introduce the concept of homeostatic neuro-metasurfaces to automatically and monolithically manage wireless channel in dynamics. These neuro-metasurfaces relieve the heavy reliance on traditional radio frequency components and embrace two iconic traits: They require no iterative computation and no human participation. In doing so, we develop a flexible deep learning paradigm for the global inverse design of large-scale metasurfaces, reaching an accuracy greater than 90%. In a full perception-decision-action experiment, our concept is demonstrated through a preliminary proof-of-concept verification and an on-demand wireless channel management. Our work provides a key advance for the next generation of electromagnetic smart cities.

multidisciplinary sciences
Intelligent Adaptive Metasurface in Complex Wireless Environments

Han Qing Yang,Jun Yan Dai,Hui Dong Li,Lijie Wu,Meng Zhen Zhang,Zi Hang Shen,Si Ran Wang,Zheng Xing Wang,Wankai Tang,Shi Jin,Jun Wei Wu,Qiang Cheng,Tie Jun Cui

2024-11-13

Abstract:The programmable metasurface is regarded as one of the most promising transformative technologies for next-generation wireless system applications. Due to the lack of effective perception ability of the external electromagnetic environment, there are numerous challenges in the intelligent regulation of wireless channels, and it still relies on external sensors to reshape electromagnetic environment as desired. To address that problem, we propose an adaptive metasurface (AMS) which integrates the capabilities of acquiring wireless environment information and manipulating reflected electromagnetic (EM) waves in a programmable manner. The proposed design endows the metasurfaces with excellent capabilities to sense the complex electromagnetic field distributions around them and then dynamically manipulate the waves and signals in real time under the guidance of the sensed information, eliminating the need for prior knowledge or external inputs about the wireless environment. For verification, a prototype of the proposed AMS is constructed, and its dual capabilities of sensing and manipulation are experimentally validated. Additionally, different integrated sensing and communication (ISAC) scenarios with and without the aid of the AMS are established. The effectiveness of the AMS in enhancing communication quality is well demonstrated in complex electromagnetic environments, highlighting its beneficial application potential in future wireless systems.

Applied Physics
Intelligent Metasurface Sensors

Lianlin Li,Hanting Zhao,Tie Jun Cui

DOI: https://doi.org/10.1017/9781009277242

2023-01-01

Abstract:Intelligent electromagnetic (EM) sensing is a powerful contactless examination tool in science, engineering and military, enabling us to 'see' and 'understand' visually invisible targets. Using intelligence, the sensor can organize by itself the task-oriented sensing pipeline (data acquisition plus processing) without human intervention. Intelligent metasurface sensors, synergizing ultrathin artificial materials (AMs) for flexible wave manipulation and artificial intelligences (AIs) for powerful data manipulation, emerge in response to the proper time and conditions, and have attracted growing interest over the past years. The authors expect that the results in this Element could be utilized to achieve the goal that conventional sensors cannot achieve, and that the developed strategies can be extended over the entire EM spectra and beyond, which will produce important impacts on the society of the robot-human alliance.
Remotely mind-controlled metasurface via brainwaves

Ruichao Zhu,Jiafu Wang,Tianshuo Qiu,Yajuan Han,Xinmin Fu,Yuzhi Shi,Xingsi Liu,Tonghao Liu,Zhongtao Zhang,Zuntian Chu,Cheng-Wei Qiu,Shaobo Qu

DOI: https://doi.org/10.1186/s43593-022-00016-0

2022-06-12

eLight

Abstract:The power of controlling objects with mind has captivated a popular fascination to human beings. One possible path is to employ brain signal collecting technologies together with emerging programmable metasurfaces (PM), whose functions or operating modes can be switched or customized via on-site programming or pre-defined software. Nevertheless, most of existing PMs are wire-connected to users, manually-controlled and not real-time. Here, we propose the concept of remotely mind-controlled metasurface (RMCM) via brainwaves. Rather than DC voltage from power supply or AC voltages from signal generators, the metasurface is controlled by brainwaves collected in real time and transmitted wirelessly from the user. As an example, we demonstrated a RMCM whose scattering pattern can be altered dynamically according to the user's brain waves via Bluetooth. The attention intensity information is extracted as the control signal and a mapping between attention intensity and scattering pattern of the metasurface is established. With such a framework, we experimentally demonstrated and verified a prototype of such metasurface system which can be remotely controlled by the user to modify its scattering pattern. This work paves a new way to intelligent metasurfaces and may find applications in health monitoring, 5G/6G communications, smart sensors, etc.
Intelligent Imaging and Sensing Based on Programmable Metasurface

Hongrui Zhang,Zhuo Wang,Hanting Zhao,Shengguo Hu,Siyuan Jiang,Lianlin Li

DOI: https://doi.org/10.1109/iws58240.2023.10222797

2023-01-01

Abstract:Recently, electromagnetic (EM) sensing has been rapidly applied to many areas like science, health and military, working in a all-weather and all-day way without invasion of visual privacy. In order to tackle the data crisis of traditional EM sensing algorithms, we propose an intelligent metasurface sensing system by synergizing the programmable metasurface for flexible wave manipulation on physical level and artificial intelligence for powerful computation on data level. The integrated sensor can jointly learn the optimal settings of data acquisition and processing and achieves excellent performance on a variety of indoor imaging and detection tasks. The reported work could pave a new avenue for future smart homes and healthy monitoring.
Practical Exploration of Reconfigurable Intelligent Surface Deployed in 5G Wireless Environment

Yijun Feng,Kui Tang,Qi Hu,Na Zhang,Ke Chen

DOI: https://doi.org/10.1109/apcap59480.2023.10470346

2023-01-01

Abstract:Metasurfaces, the two-dimensional version of metamaterials, which are compose of array of artificially engineered meta-atoms arranged in a surface that can locally manipulate electromagnetic (EM) waves over a subwavelength thickness, have attracted unprecedented research interests due to their powerful ability of manipulating EM wavefronts and realizing many exotic physics phenomena and novel devices. By incorporated various tunable materials or elements into metasurface designs, reconfigurable metasurfaces and related meta-devices with functionalities controlled by external stimuli can be realized, opening a new avenue to achieve dynamical manipulation of EM waves. Recently, based on the tunable metasurface concept, reconfigurable intelligent surface (RIS) have been put forward and regarded as a promising emerging technique in future wireless communication due to their potential to enhance the capacity and coverage of wireless networks by smartly reconfiguring the wireless propagation environment. In this talk, firstly we will briefly discuss the various design aspects of RISs, and the associated technical issues of the implementation of the RIS systems. Then, we will showcase our recent attempts to practically explore the RIS systems in 5G wireless environment, which include deploying reflective RIS system to indoor scenario to enhance the wireless network coverage, utilizing omni-directional intelligent metasurface to improve both indoor and through-wall wireless communication quality. Finally, we will give our own perspectives on possible future research directions and existing challenges for the RIS hardware towards a truly commercial RIS-based intelligent technology platform.
A Human Microrobot Interface Based on Acoustic Manipulation.

Xiaolong Lu,Kangdong Zhao,Wenjuan Liu,Dongxin Yang,Hui Shen,Hanmin Peng,Xiasheng Guo,Jinxing Li,Joseph Wang

DOI: https://doi.org/10.1021/acsnano.9b04930

IF: 17.1

2019-01-01

ACS Nano

Abstract:Micro/nanorobotic systems capable of targeted transporting and releasing hold considerable promise for drug delivery, cellular surgery, biosensing, nano assembling, etc. However, on-demand precise control of the micro/nanorobot movement remains a major challenge. In particular, a practical interface to realize instant and customized interactions between human and micro/nanorobots, which is quite essential for developing next generation intelligent micro/nanorobots, has seldom been explored. Here, we present a human-microrobot user interface to perform direct and agile recognition of user commands and signal conversion for driving the microrobot. The microrobot platform is built based on locally enhanced acoustic streaming which could precisely transport microparticles and cells along a given pathway, while the interface is enabled by tuning the actuation frequency and time with different instructions and inputs. Our numerical simulations and experimental demonstrations illustrate that microparticles can be readily transported along the path by the acoustic robotic system, due to the vibration-induced locally enhanced acoustic streaming and resultant propulsion force. The acoustic robotic platform allows large-scale parallel transportation for microparticles and cells along given paths. The human microrobot interface enables the micromanipulator to response promptly to the users' commands input by typing or music playing for accurate transport. For example, the music tone of a playing melody is used for manipulating a cancer cell to a targeted position. The interface offers several attractive capabilities, including tunable speed and orientation, quick response, considerable delivery capacities, high precision and favorable controllability. We expect that such interface will work as a compelling and versatile platform for myriad potential scenarios in transportation units of microrobots, single cell analysis instruments, lab-on-chip systems, microfactories, etc.
3D Navigation Control of Untethered Magnetic Microrobot in Centimeter-Scale Workspace Based on Field-of-View Tracking Scheme

Liushuai Zheng,Yuanjun Jia,Dingran Dong,Wahshing Lam,Dongfang Li,Haibo Ji,Dong Sun

DOI: https://doi.org/10.1109/tro.2021.3118205

IF: 7.8

2021-01-01

IEEE Transactions on Robotics

Abstract:Automatic 3D navigation control of microrobot in large microenvironment is one of the primary challenges hindering its applications. In this article, we present a systematic approach to use an electromagnetic manipulation system to deal with this challenge. Two movable orthogonal microscopic cameras scan the microenvironment on the top view and side view to build a stereo occupancy map automatically. The initial position of microrobot can be located on the basis of the similarity curves generated by the scanning sequences. In accordance with the distribution characteristic of electromagnetic fields in workspace, an enhanced rapidly exploring random tree algorithm is proposed to avoid obstacles in the complex environment. To ensure continuous visual servo in wide range, a field-of-view tracking method is developed using a specific image definition evaluation algorithm. A prescribed performance controller with disturbance observer is designed, which guarantees that the microrobot can remain in the view of microscopic cameras, and the transient and steady-state performance of the system can satisfy the expected requirements. A set of experiments are performed to verify the effectiveness of the proposed automatic 3D navigation strategy. Experimental results show that the microrobot can navigate automatically in a $\boldsymbol{12}\,\times 10\,\times \text{10-mm}$ microenvironment containing obstacles, and achieve reliable field-of-view tracking and path following at high speed.

robotics

RIS rocks at RSNA. With workflow on everyone's minds, radiology information systems took center stage at imaging's super-conference.

Development of a Human-Robot Hybrid Intelligent System Based on Brain Teleoperation and Deep Learning SLAM

Intelligent Metasurface Imager and Recognizer

Intelligent Metasurface Based Indoor Positioning and Control System with Non-Cooperative Blind Signals

Self-sensing Intelligent Microrobots for Non-Invasive and Wireless Monitoring Systems

Reconfigurable Intelligent Computational Surfaces: when Wave Propagation Control Meets Computing

Multi‐Task and Multi‐Scale Intelligent Electromagnetic Sensing with Distributed Multi‐Frequency Reprogrammable Metasurfaces

Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces

Indoor Signal Focusing with Deep Learning Designed Reconfigurable Intelligent Surfaces

Realization of Secure Robotic Brain Via Programmable Metasurface with Robust High‐Order BIC

Intelligent Reflecting Surface Enhanced Indoor Robot Path Planning: A Radio Map-Based Approach

In-situ manipulation of wireless link with reinforcement-learning-driven programmable metasurface in indoor environment

Wireless Measurement and Control System for a Bio-Inspired Mini-Robot.

Homeostatic neuro-metasurfaces for dynamic wireless channel management

Intelligent Adaptive Metasurface in Complex Wireless Environments

Intelligent Metasurface Sensors

Remotely mind-controlled metasurface via brainwaves

Intelligent Imaging and Sensing Based on Programmable Metasurface

Practical Exploration of Reconfigurable Intelligent Surface Deployed in 5G Wireless Environment

A Human Microrobot Interface Based on Acoustic Manipulation.

3D Navigation Control of Untethered Magnetic Microrobot in Centimeter-Scale Workspace Based on Field-of-View Tracking Scheme