Advances in Legged Robots Control, Perception and Learning

Qiuguo Zhu,Rui Song,Jun Wu,Yamakita Masaki,Zhangguo Yu

DOI: https://doi.org/10.1049/csy2.12075

2022-01-01

IET Cyber-Systems and Robotics

Abstract:This is the Institution of Engineering and Technology (IET) Cyber-systems and Robotics Special Issue of Advances in Legged Robots: Control, Perception and Learning. Legged mammals are found everywhere in nature. These legged animals can reach anywhere on Earth, adapt to uneven, discontinuous and obstructed environment. Their locomotion patterns are flexible and diverse to better adapt to the living environment. Imitating these real animals, legged robots have potential advantages over wheeled or tracked vehicles in regard to the traversal of rough and unstructured terrain. However, there are still many challenges for legged systems in solving the technical problems of the real world. Control, perception and learning are the key technologies in the field of legged robots. Control is the basis of the stable and flexible locomotion of the legged robot. The combination of control and mechatronics machines will show excellent passing ability in continuous stairs, discrete terrain and vertical obstacle environments. The control methods of legged robots mainly include model-based control and learning-based control. After decades of development, research results have made robots more flexible and stable. The latter is a new method combining artificial intelligence, exploring how robots can acquire new motor skills in the process of interacting with the environment and achieve expected motor abilities. Perception allows the robot to understand the world. Autonomous navigation, behavioural decision-making and task operation, all require environmental awareness and understanding. This ability is an unattainable component of the legged robot. For example, different road surfaces require different gait modes, which is the most direct perceptual demand for legged robots. List: Paper 1: Disturbance rejection for biped robots during walking and running using control moment gyroscopes, Paper 2: A self-stabilised walking gait for humanoid robots based on the essential model with internal states, Paper 3: Squat motion of a bipedal robot using real-time kinematic prediction (RKP) and whole-body control, Paper 4: Design and control of a robotic system with legs, wheels and a reconfigurable arm, Paper 5: A heuristic control framework for heavy-duty hexapod robot over complex terrain, Paper 6: Efficient learning of robust quadruped bounding using pretrained neural networks, Paper 7: A new control for the pneumatic muscle (PM) bionic legged robot based on neural network, Paper 8: Sampling visual simultaneous localization and mapping (SLAM) with a wide-angle camera for legged mobile robots, Paper 9: Research on the autonomous system of the quadruped robot with a manipulator to realize leader-following, object recognition, navigation and operation. Paper 1 by Haochen Xu, paper 2 by Qiuyue Luo and paper 3 by Wenhan Cai investigated the control problems of biped robots, paper 4 by Linqi Ye studied the leg–arm and wheel reconfiguration design and control strategy problems and paper 5 by Jinmian Hou extended the multi-leg hexapod robot problems. The design, control and strategy of the legged robot are discussed. In paper 1, Haochen Xu et al. studied the disturbance rejection for biped robots during walking and running using CMG. They used the CMG as an auxiliary stabilisation device for fully actuated biped robots and integrated the CMG into the balance control framework. This method can effectively help the robot resist disturbance and remain stable over time. In paper 2, Qiuyue Luo et al. exploited a self-stabilised walking gait for humanoid robots based on the essential model with internal states. They extended an essential dynamic model to the full dynamic model of humanoid robots based on the zero dynamics concept. By adjusting the step timing and landing position of the swing foot automatically and following the intrinsic dynamic characteristics, the humanoid robot can achieve robust walking. In paper 3, Wenhan Cai et al. proposed the squat motion of a bipedal robot using RKP and whole-body control. The RKP method considers upcoming reference motion trajectories and combines it with quadratic programming (QP)-based whole body control (WBC). It greatly reduces the computational cost compared to model predictive control with WBC and exhibits high adaptability to rough planning with much less computation time. In paper 4, Linqi Ye et al. designed a robotic system with legs, wheels and a reconfigurable arm, which takes advantage of the wheel and legs. In this robotic system, a leg–arm reconfiguration design allows the robot to walk, reducing the total weight of the robot, and the multi-task control strategy was described based on variable configuration to complicate environments. In paper 5, Jinmian Hou et al. introduced a novel heuristic whole-body motion control framework for the heavy-duty hexapod robot to traverse complex terrain. They designed a whole-body motion planning and whole-body torque controller, and virtual model control was used to optimise the ground reaction forces for tracking the pre-planned motion based on single rigid-body dynamics. Paper 6 by Zhicheng Wang et al. investigated the deep reinforcement learning (DRL) problem, while paper 7 by Chaoyue Xu et al. studied the neural network control problem. Both are essential aspects of learning to achieve control. The DRL approach can help learn robust and variety gaits more efficiently and better terrain adaptation. The neural network can help improve the dynamic performance of non-linear actuators. In paper 6, Zhicheng Wang et al. proposed the efficient learning of robust quadruped bounding using pretrained neural networks. In their method, they designed a reward function to enforce the gait symmetry and periodicity to improve the bounding performance and learnt feedback controller by simulation where they can build variety of environments for simulation learning. This method has been deployed on the real quadruped robot. In paper 7, Chaoyue Xu et al. described a new control for a PM bionic legged robot based on the neural network. In their method, a double closed-loop control strategy of the PM bionic leg was designed. Based on the three-element model, a feedforward neuron proportion-integral-derivative controller is designed as the inner control loop, and a sliding mode robust controller with local model approximation is designed using the radial basis function neural network as the outer control loop. Paper 8 by Guangyu Fan et al. investigated the SLAM problem in dynamic environments, while paper 9 by Jiamin Guo et al. studied autonomous recognition and navigation problems. Both are essential aspects of perception. The SLAM method can help improve the robustness of localization, enabling navigation tasks in dynamic environments. Additionally, the autonomous recognition and navigation method can help understand the environment, make decisions and move to destinations. In paper 8, Guangyu Fan et al. proposed sampling visual SLAM with a wide-angle camera for legged robots. Their method sampled image blocks with clear texture and enhanced the image details to extract the feature points, and the matched feature points were extracted from the images. These points were selected as the template points, the relationship between the template points and the images was established through the wide-angle camera model, and the pixel coordinates of the template in the images and the descriptors were calculated. In paper 9, Jiamin Guo et al. researched a quadruped robot with a manipulator to realise leader-following, object recognition, navigation and operation. In this paper, the authors developed a systematic solution including the hardware and software system and system architecture. This can achieve recognition, autonomous navigation and operation on a quadruped robot with a manipulator, and it can be extended to other forms of mobile robots. All of the papers selected for this special issue indicate trends in the emerging field of control, perception and learning in legged robots. We hope that this special issue will benefit researchers around the world by exchanging and sharing the latest results. The guest editors would like to thank IET Cyber-systems and Robotics editors-in-chief Rob Buckingham, Jian Chu and Max Meng for their continued support. Finally, they acknowledge the many peer experts who have contributed to the Special Issue and provided helpful reviews. Qiuguo Zhu received his bachelor’s degree from Mechanical Engineering College of Zhejiang University and master’s degree from Control Science College of Zhejiang University in 2008 and 2011, respectively. Then, he received his Ph.D. degree in Control Science College of Zhejiang University in 2020. His research interests include the control of humanoid robots, bipedal and quadrupedal walking and running, manipulators and machine intelligence. As a PI, he obtained research funds from many organizations such as National & Zhejiang Natural Science Foundation, and he is the associate editor of IET Cyber Systems and Robotics. Rui Song received his bachelor’s degree from Shandong University of Science and Technology, Jinan, China in 2001, and his doctoral degree in control theory and engineering from Shandong University, Jinan, China in 2011. He is currently a professor and doctoral supervisor with the School of Control Science and Engineering at Shandong University. He is also working as the Vice President of the Shandong Institute of Science and Technology. He is the Deputy Head of the Expert Group of the Ministry of Science and Technology's “14th Five-Year Plan” Intelligent robot Key Project Guidelines. Professor Song was awarded as the distinguished professor of Cheung Kong Scholars Program. He has won the second prize and the third prize of the Science and Technology Progress Award of Shandong Province. During the past five years, he has granted more than 40 national invention patents and published more than 50 SCI/EI papers. Jun Wu received his B.Eng and Ph.D degrees both in industrial automation from Huazhong University of Science and Technology, China, in 1989 and 1994, respectively. Since 1994, he has been a faculty member at the College of Control Science and Engineering, Zhejiang University, where he currently is a professor. Dr Wu is a senior member of IEEE and was awarded the Royal Society K.C. Wong Fellowship. He has published over 80 papers in journals and conference proceedings and was awarded the 1997/1998 IEE Heaviside Premium. Yamakita Masaki received the BE, ME and PhD degrees from Tokyo Institute of Technology in 1984, 1986 and 1989, respectively. From 1989 he was a research associate in the department of control engineering of the institute and from 1993 he was a lecturer at Toyohashi University of Technology. He is currently an associate professor in the department of mechanical and control engineering of Tokyo Institute of Technology. His research interests include robotics, learning control, robust and non-linear control. He is a member of IEEE, SICE and RSJ. Zhangguo Yu is currently a full professor and the director of Intelligent Robotics Institute, Beijing Institute of Technology, China. He received the B.S. degree in electronics engineering and the M.S. degree in control engineering from the Southwest University of Science and Technology (SWUST), China, in 1997 and 2005, respectively, and the Ph.D. degree in mechatronics engineering from the Beijing Institute of Technology (BIT), Beijing, China, in 2009. From 1997 to 2000, he was an Engineer with Changhong Electric Company Ltd., China. From 2001 to 2009, he was a staff with SWUST. He was a visiting scholar with Waseda University, Tokyo, Japan, in 2008. He served as Program Chair of IEEE ARSO 2019, and Program Co-Chair of IEEE Humanoids 2018, IEEE ICMA 2015 and ICMA 2020. He is an associate editor of the International Journal of Humanoid Robotics. His current research interests include design, motion planning and control of humanoid robots.