Intelligent Insect–Computer Hybrid Robot: Installing Innate Obstacle Negotiation and Onboard Human Detection onto Cyborg Insect
Phuoc Thanh Tran-Ngoc,Duc Long Le,Bing Sheng Chong,Huu Duoc Nguyen,Van Than Dung,Feng Cao,Yao Li,Kazuki Kai,Jia Hui Gan,Tat Thang Vo-Doan,Thanh Luan Nguyen,Hirotaka Sato
DOI: https://doi.org/10.1002/aisy.202200319
IF: 7.298
2023-01-29
Advanced Intelligent Systems
Abstract:Cyborg insects for the rescues. A living cockroach is fused with an electronic backpack to form a cyborg for search‐and‐rescue missions. The cyborg can navigate across post‐disaster terrains by incorporating the insects' natural behaviors and an artificial predictive controller. The backpack is equipped with a thermal camera and artificial intelligence‐based human‐detection algorithm, allowing the cyborg to search for survivors. Developing small mobile robots for Urban Search and Rescue (USAR) is a major challenge due to constraints in size and power required to perform vital functions such as obstacle navigation, victim detection, and wireless communication. Drawing upon the idea that insects' locomotion can be controlled, what if we further utilize the insects' intrinsic ability to avoid obstacles? Herein, a cockroach hybrid robot (≈ 1.5 cm height, 5.7 cm length) that implements the abovementioned functions is developed. It is tested in an arena with randomly placed obstacles, and a motion capture system is used to track the insect's position among the untracked obstacles. A navigation algorithm that uses an inertial measurement unit (IMU) is developed to heuristically predict the insect's situation and stimulate the insect to escape nearby obstacles. The utilization of insect's intrinsic locomotor ability and low‐powered IMU reduces the onboard power load, allowing the addition of a human‐detecting function. An image classification model enables the use of an onboard low‐resolution infrared camera for human detection. Consequently, a single hybrid robot is established that includes locomotion control, autonomous navigation in obstructed areas, onboard human detection, and wireless communication, representing a significant step toward real USAR application.