Vision based range and bearing algorithm for robot swarms

Hamid Majidi Balanji,Ali Emre Turgut

DOI: https://doi.org/10.48550/arXiv.2103.08006

IF: 3.7

2021-03-14

Robotics

Abstract:This paper presents a novel computer vision the algorithm proposed for the on-line range and bearing detection of the robot swarms. Results demonstrated the reliability of the proposed vision system such that it can be used for the robot swarms applications.

What problem does this paper attempt to address?

A Computer Vision for Navigation of Mobile Robots

Zhu Miaoliang,He Zhijun

DOI: https://doi.org/10.1117/12.968257

1987-01-01

Abstract:A computer system which can find the pathway in the robot's sensor field of view with only one camera has been developed. The low level extraction of linear segmentations is performed by edge following algorithm with the local gray level and gradient as heuristics. The symbolic lists which describe the optical and geometric properties of linear segmentations are generated as the output of the low level and submit to the high level. In high level stage a reasoning mechanism whose knowledge base consists of the rules modeling three basic types of pathway segments (non-branch, branch, and end) works on the symbolic lists to make the judgement of which type to be happened in the sensor area. Several parameters such as the exact positions of the pathway can be calculated as the signals for navigation control system. The experiments showed that the system behaved specially well for the existence of noise. shadow. and irregularities of environments.
Robot SLAM algorithm based on laser range finder for large scale environment

ErYong Wu,Zhiyu Xiang,MinYi Shen,LIU Ji-lin

2007-01-01

Abstract:A simultaneous localization and mapping(SLAM) algorithm based on Rao-Blackwellised particle filter was presented for autonomous robot in large scale environment.Through selecting the stable and distinctive landmarks,a new data association method was proposed based on global constraints,accordingly the probability of error matching was decreased much.Then,an improved proposal function was adopted to improve the performance of particle filter.Experimental results showed that the algorithm has low computational complexity and high precision,and it can solve the robot SLAM problem in large scale environment.
Real-time vision system for a Ping-Pong robot

ZHANG YiFeng,XIONG Rong

DOI: https://doi.org/10.1360/112011-335

2012-01-01

Abstract:As a typical real-time éye-hand' system,the Ping-Pong robot is an ideal platform for high-speed visual perception and fast motor control.It involves high-speed object identification and tracking,trajectory prediction,and fast arm servo,which are also very significant in industrial and military field.This paper proposes a whole solution of real-time vision system for a ping-pong robot,including target recognition algorithm based on feature histogram analysis and fast contour search,modeling algorithm based on dynamics analysis,learning and training algorithms of model parameters,state estimating and trajectory predicting algorithms based on model adaption.To get more robust and accurate prediction under various serving conditions,the proposed method establishes two equivalent forms of the dynamic model of flying ball,the discrete form for state estimation and the continuous form for trajectory prediction.These two forms share the same parameters.According to force analysis,the model parameters are deeply related to ball's state.So we trained the model parameters offline respect to ball's state,instead of setting them to constant values.Thus the model can be adapted accordingly online.Experimental results show the effectiveness and accuracy of the algorithms.It also works very well on Ping-Pong robots to rally with each other and with human.
Vision System for Aerial Robot

WANG Wei,LI Ping,HAN Bo

DOI: https://doi.org/10.3969/j.issn.1001-4551.2005.06.014

2005-01-01

Abstract:Vision system is one of the most important parts of the aerial robot for locating and tracking mission. This paper describes a vision system of aerial robot, including hardware and software. In the end, the experimental results show the system effectiveness.
Vision-based autonomous mapping and exploration on robot tracked vehicle

Hairol Nizam Mohd Shah,Muhamad Afif Mat Yusoff,Zalina Kamis,Azhar Ahmad,Mohd Rizuan Baharon,Mohd Ali Arshad

DOI: https://doi.org/10.11591/eei.v12i6.5952

2023-12-01

Bulletin of Electrical Engineering and Informatics

Abstract:Vision based mapping is an emerging technology with decades of research advancements. The most famous mapping method available is silmuntaneous localization and mapping (SLAM) which provide an accurate map projected in a simulation. Unfortunately, SLAM requires an active sensor in order to acquire the data from its environment opposite the vision-based mapping which requires a passive sensor to collect data. This project aims to develop an autonomous mapping and exploration algorithm, design a controller for the robot-tracked vehicle and analyze the accuracy of the algorithm. The problem in autonomous mapping is precision, limitation of computational power and complex computation. So, the algorithm will be based on the visual odometer algorithm through a single-visual sensor. The robot tracker has also been designed and implemented on Raspberry Pi 3. The accuracy of two object with different height was calculated to ensure the validation of the algorithm being able to project the real object in 3D projection. The result for the task is shown in figures as to present the capability of the algorithm in projecting the map in 3D projection. The algorithm works as expected but still requires improvements to increase the precision of the map projection.

English Else
An approach of IR-Based short-range correspondence systems for swarm robot balanced requisitions and communications

Rafiqul Islam,Iftekharul Mobin,Md. Nazmus Shakib,Md Matiur Rahman

DOI: https://doi.org/10.48550/arXiv.1608.03610

2016-08-12

Abstract:This paper exhibits a short-run correspondence method appropriate for swarm versatile robots application. Infrared is utilized for transmitting and accepting information and obstruction location. The infrared correspondence code based swarm signaling is utilized for an independent versatile robot communication system in this research. A code based signaling system is developed for transmitting information between different entities of robot. The reflected infrared sign is additionally utilized for separation estimation for obstruction evasion. Investigation of robot demonstrates the possibility of utilizing infrared signs to get a solid nearby correspondence between swarm portable robots. This paper exhibits a basic decentralized control for swarm of self-collecting robots. Every robot in the code based swarm signaling is completely self-governing and controlled utilizing a conduct based methodology with just infrared-based nearby detecting and correspondences. The viability of the methodology has been checked with simulation, for a set of swarm robots.

Robotics
Active Sensing and Information Structuring for Intelligent Robot Vision with Range Imaging Sensor

Sasaki, H.,Fukukawa, T.,Chen Fei,Sun Baiqing

DOI: https://doi.org/10.1109/mhs.2010.5669513

2010-01-01

Abstract:Recently, various types of robots have been researched and developed for supporting our life. Also, the perceptual system for the robot is researched. Visual perception includes a lot of valuable information and it is useful for all intelligent robot system. In this paper, we discuss intelligent robot vision in order to active sensing and information structuring for human-robot collaboration system. There are many visual sensors and we use the range-imaging camera to detect distance and image data. We propose a method for active sensing and target information structuring by using growing neural Network and Genetic algorithm. In the experimental results, we show the potency of our method.
Vision-based Drone Flocking in Outdoor Environments

Fabian Schilling,Fabrizio Schiano,Dario Floreano

DOI: https://doi.org/10.48550/arXiv.2012.01245

2021-02-16

Abstract:Decentralized deployment of drone swarms usually relies on inter-agent communication or visual markers that are mounted on the vehicles to simplify their mutual detection. This letter proposes a vision-based detection and tracking algorithm that enables groups of drones to navigate without communication or visual markers. We employ a convolutional neural network to detect and localize nearby agents onboard the quadcopters in real-time. Rather than manually labeling a dataset, we automatically annotate images to train the neural network using background subtraction by systematically flying a quadcopter in front of a static camera. We use a multi-agent state tracker to estimate the relative positions and velocities of nearby agents, which are subsequently fed to a flocking algorithm for high-level control. The drones are equipped with multiple cameras to provide omnidirectional visual inputs. The camera setup ensures the safety of the flock by avoiding blind spots regardless of the agent configuration. We evaluate the approach with a group of three real quadcopters that are controlled using the proposed vision-based flocking algorithm. The results show that the drones can safely navigate in an outdoor environment despite substantial background clutter and difficult lighting conditions. The source code, image dataset, and trained detection model are available at <a class="link-external link-https" href="https://github.com/lis-epfl/vswarm" rel="external noopener nofollow">this https URL</a>.

Robotics,Computer Vision and Pattern Recognition,Machine Learning,Multiagent Systems
Robust Multi-Robot Coverage of Unknown Environments using a Distributed Robot Swarm

S. Anavatti,V. Tran,M. Garratt,Kathryn E. Kasmarik

Abstract:—In mobile robotics, area exploration and coverage are critical capabilities. In most of the available research, a common assumption is global, long-range communication and centralised cooperation. This paper proposes a novel swarm-based coverage control algorithm that relaxes these assumptions. The algorithm combines two elements: swarm rules and frontier search algorithms. Inspired by natural systems in which large numbers of simple agents (e.g., schooling ﬁsh, ﬂocking birds, swarming insects) perform complicated collective behaviors, the ﬁrst element uses three simple rules to maintain a swarm formation in a distributed manner. The second element provides means to select promising regions to explore (and cover) using the minimization of a cost function involving the agent’s relative position to the frontier cells and the frontier’s size. We tested our approach’s performance on both heterogeneous and homogeneous groups of mobile robots in different environments. We measure both coverage performance and swarm formation statistics that permit the group to maintain communication. Through a series of comparison experiments, we demonstrate the proposed strategy has superior performance over recently presented map coverage methodologies and the conventional artiﬁcial potential ﬁeld based on a percentage of cell-coverage, turnaround, and safe paths while maintaining a formation that permits short-range communication.

Engineering,Computer Science
Design of Multisensor Mobile Robot Vision Based on the RBPF-SLAM Algorithm

Yiyi Cai,Tuanfa Qin

DOI: https://doi.org/10.1155/2022/1518968

IF: 1.43

2022-09-01

Mathematical Problems in Engineering

Abstract:The existing algorithms are mainly based on the laser or visual inertial odometer, which has problems such as large particle recommendation distribution error, particle consumption, and long running time of the algorithm. An SLAM scheme based on multisensor fusion is proposed, which integrates multisource sensor data including lidar, camera, and IMU and constructs a set of real-time mapping and positioning system with better robustness and higher accuracy. The experimental results show that the proposed SLAM method uses less running time, and the accuracy of map construction is better.

engineering, multidisciplinary,mathematics, interdisciplinary applications
FACT: Fast and Active Coordinate Initialization for Vision-based Drone Swarms

Yuan Li,Anke Zhao,Yingjian Wang,Ziyi Xu,Xin Zhou,Jinni Zhou,Chao Xu,Fei Gao

2024-03-20

Abstract:Swarm robots have sparked remarkable developments across a range of fields. While it is necessary for various applications in swarm robots, a fast and robust coordinate initialization in vision-based drone swarms remains elusive. To this end, our paper proposes a complete system to recover a swarm's initial relative pose on platforms with size, weight, and power (SWaP) constraints. To overcome limited coverage of field-of-view (FoV), the drones rotate in place to obtain observations. To tackle the anonymous measurements, we formulate a non-convex rotation estimation problem and transform it into a semi-definite programming (SDP) problem, which can steadily obtain global optimal values. Then we utilize the Hungarian algorithm to recover relative translation and correspondences between observations and drone identities. To safely acquire complete observations, we actively search for positions and generate feasible trajectories to avoid collisions. To validate the practicability of our system, we conduct experiments on a vision-based drone swarm with only stereo cameras and inertial measurement units (IMUs) as sensors. The results demonstrate that the system can robustly get accurate relative poses in real time with limited onboard computation resources. The source code is released.

Robotics
Active Sensing for Intelligent Robot Vision with Range Imaging Sensor

Sasaki, H.,Fukukawa, T.,Chen Fei,Sun Baiqing

2010-01-01

Abstract:Recently, various types of robots have been researched and developed for supporting our life. Also, the perceptual system for the robot is researched. Visual perception includes a lot of valuable information and it is useful for all intelligent robot system. In this research, we discuss about 3-D information structuring for intelligent robot vision. There are many visual sensors and we use the range-imaging camera to detect distance and image data. We propose a method for perceive moving target by using Growing Neural Gas. In the experimental results, we show the potency of our method.
Agile Formation Control of Drone Flocking Enhanced With Active Vision-Based Relative Localization

Peihan Zhang,Gang Chen,Yuzhu Li,Wei Dong

DOI: https://doi.org/10.1109/lra.2022.3171096

IF: 5.2

2022-07-01

IEEE Robotics and Automation Letters

Abstract:The vision-based relative localization can provide effective feedback for the cooperation of aerial swarm and has been widely investigated in previous works. However, the limited field of view (FOV) inherently restricts its performance. To cope with this issue, we propose a novel distributed active vision-based relative localization framework and apply it to formation control in aerial swarms. Inspired by bird flocks in nature, we realize omnidirectional visual detection with a novel active vision structure and devise graph-based attention planning (GAP) to obtain the optimal observation target assignment for the swarms active vision. Then active visual detection results are fused with onboard measurements from Ultra-WideBand (UWB) and visual-inertial odometry (VIO) to obtain real-time relative positions, which further improve the formation control performance of the swarm. Simulations and experiments demonstrate that the proposed active vision system outperforms the fixed vision system in terms of estimation and formation accuracy.

robotics
3D surveillance coverage using maps extracted by a monocular SLAM algorithm

Lefteris Doitsidis,Alessandro Renzaglia,Stephan Weiss,Elias Kosmatopoulos,Davide Scaramuzza,Roland Siegwart,L. Doitsidis,A. Renzaglia,S. Weiss,E. Kosmatopoulos,D. Scaramuzza,R. Siegwart

DOI: https://doi.org/10.1109/iros.2011.6094460

2011-09-01

Abstract:This paper deals with the problem of deploying a team of flying robots to perform surveillance coverage missions over a terrain of arbitrary morphology. In such missions, a key factor for the successful completion is the knowledge of the terrain's morphology. In this paper, we introduce a two-step centralized procedure to align optimally a swarm of flying vehicles for the aforementioned task. Initially, a single robot constructs a map of the area of interest using a novel monocular-vision-based approach. A state-of-the-art visual-SLAM algorithm tracks the pose of the camera while, simultaneously, building an incremental map of the surrounding environment. The map generated is processed and serves as an input in an optimization procedure using the cognitive adaptive methodology initially introduced in [1], [2]. The output of this procedure is the optimal arrangement of the robot team, which maximizes the monitored area. The efficiency of our approach is demonstrated using real data collected from aerial robots in different outdoor areas.
SwarmHive: Heterogeneous Swarm of Drones for Robust Autonomous Landing on Moving Robot

Ayush Gupta,Ahmed Baza,Ekaterina Dorzhieva,Mert Alper,Mariia Makarova,Stepan Perminov,Aleksey Fedoseev,Dzmitry Tsetserukou

DOI: https://doi.org/10.48550/arXiv.2206.08856

IF: 3.7

2022-06-17

Robotics

Abstract:The paper focuses on a heterogeneous swarm of drones to achieve a dynamic landing of formation on a moving robot. This challenging task was not yet achieved by scientists. The key technology is that instead of facilitating each agent of the swarm of drones with computer vision that considerably increases the payload and shortens the flight time, we propose to install only one camera on the leader drone. The follower drones receive the commands from the leader UAV and maintain a collision-free trajectory with the artificial potential field. The experimental results revealed a high accuracy of the swarm landing on a static mobile platform (RMSE of 4.48 cm). RMSE of swarm landing on the mobile platform moving with the maximum velocities of 1.0 m/s and 1.5 m/s equals 8.76 cm and 8.98 cm, respectively. The proposed SwarmHive technology will allow the time-saving landing of the swarm for further drone recharging. This will make it possible to achieve self-sustainable operation of a multi-agent robotic system for such scenarios as rescue operations, inspection and maintenance, autonomous warehouse inventory, cargo delivery, and etc.
Certifiable Mutual Localization and Trajectory Planning for Bearing-Based Robot Swarm

Yingjian Wang,Xiangyong Wen,Fei Gao

2024-01-15

Abstract:Bearing measurements,as the most common modality in nature, have recently gained traction in multi-robot systems to enhance mutual localization and swarm collaboration. Despite their advantages, challenges such as sensory noise, obstacle occlusion, and uncoordinated swarm motion persist in real-world scenarios, potentially leading to erroneous state estimation and undermining the system's flexibility, practicality, and

Robotics
Real-Time Objects Recognition and Obstacles Avoidance for Mobile Robot

Rui Lin,Maohai Li,Lining Sun

DOI: https://doi.org/10.1109/robio.2013.6739620

2013-01-01

Abstract:The paper describes a mobile robot application based on monocular vision and laser that recognizes environment objects with capacity of avoiding obstacles in real time. Object recognition algorithm is based on mobile robot vision combining adaptive appearance matching and Kalman filter. The algorithm can adjust color matching threshold adaptively to reduce the influence of brightness variations in the scene. First, it carries out color modeling of environment objects in the YCrCb color space. Then it detects edge features in the image sequence by the Sobel algorithm, and thus to identify the outlines of targets. Finally mobile robot can recognize these objects with high empirical probability under some prior knowledge. Kalman filter is used as our prediction module to search objects in view window instead of the whole image sequence and to reduce calculation time. A virtual sub-targets based algorithm is also presented for real-time obstacles avoidance for mobile robot. Experimental results show that objects recognition algorithm can adapt to brightness variations and is simple, effective, easy to imply and operates with high efficiency. Mobile robot can also avoid obstacles smoothly in real time while navigating in the real scene.
Source-Seeking Problem with Robot Swarms

Antonio Acuaviva,Hector Garcia de Marina,Juan Jimenez

2024-08-20

Abstract:We present an algorithm to solve the problem of locating the source, or maxima, of a scalar field using a robot swarm. We demonstrate how the robot swarm determines its direction of movement to approach the source using only field intensity measurements taken by each robot. In contrast with the current literature, our algorithm accommodates a generic (non-degenerate) geometry for the swarm's formation. Additionally, we rigorously show the effectiveness of the algorithm even when the dynamics of the robots are complex, such as a unicycle with constant speed. Not requiring a strict geometry for the swarm significantly enhances its resilience. For example, this allows the swarm to change its size and formation in the presence of obstacles or other real-world factors, including the loss or addition of individuals to the swarm on the fly. For clarity, the article begins by presenting the algorithm for robots with free dynamics. In the second part, we demonstrate the algorithm's effectiveness even considering non-holonomic dynamics for the robots, using the vector field guidance paradigm. Finally, we verify and validate our algorithm with various numerical simulations.

Robotics
Research on Robot Binocular Ranging Based on SIFT Feature Extraction Algorithm

Dong Haifeng,Yao Jun

DOI: https://doi.org/10.1088/1742-6596/1607/1/012015

2020-08-01

Journal of Physics: Conference Series

Abstract:Abstract Binocular stereo vision belongs to the reconstruction technology of images. It has the characteristics of non-contact measurement and easy implementation. It has broad application prospects in many fields. The study of its basic theory also has great theoretical and practical significance. As part of stereo vision, robot binocular distance measurement has an irreplaceable role. In this paper, a complete binocular ranging system is divided into the following five steps: principle analysis, camera calibration, image preprocessing, SIFT feature point extraction, distance measurement, a simple model in robot binocular ranging is realized, which is a robot Route planning and obstacle avoidance provide data support, which has the advantages of easy operation and simple calculation.
Computationally-Efficient Distributed Algorithms of Navigation of Teams of Autonomous UAVs for 3D Coverage and Flocking

Taha Elmokadem,Andrey V. Savkin

DOI: https://doi.org/10.3390/drones5040124

IF: 5.532

2021-10-25

Drones

Abstract:This paper proposes novel distributed control methods to address coverage and flocking problems in three-dimensional (3D) environments using multiple unmanned aerial vehicles (UAVs). Two classes of coverage problems are considered in this work, namely barrier and sweep problems. Additionally, the approach is also applied to general 3D flocking problems for advanced swarm behavior. The proposed control strategies adopt a region-based control approach based on Voronoi partitions to ensure collision-free self-deployment and coordinated movement of all vehicles within a 3D region. It provides robustness for the multi-vehicle system against vehicles’ failure. It is also computationally-efficient to ensure scalability, and it handles obstacle avoidance on a higher level to avoid conflicts in control with the inter-vehicle collision avoidance objective. The problem formulation is rather general considering mobile robots navigating in 3D spaces, which makes the proposed approach applicable to different UAV types and autonomous underwater vehicles (AUVs). However, implementation details have also been shown considering quadrotor-type UAVs for an example application in precision agriculture. Validation of the proposed methods have been performed using several simulations considering different simulation platforms such as MATLAB and Gazebo. Software-in-the-loop simulations were carried out to asses the real-time computational performance of the methods showing the actual implementation with quadrotors using C++ and the Robot Operating System (ROS) framework. Good results were obtained validating the performance of the suggested methods for coverage and flocking scenarios in 3D using systems with different sizes up to 100 vehicles. Some scenarios considering obstacle avoidance and robustness against vehicles’ failure were also used.

Vision based range and bearing algorithm for robot swarms

A Computer Vision for Navigation of Mobile Robots

Robot SLAM algorithm based on laser range finder for large scale environment

Real-time vision system for a Ping-Pong robot

Vision System for Aerial Robot

Vision-based autonomous mapping and exploration on robot tracked vehicle

An approach of IR-Based short-range correspondence systems for swarm robot balanced requisitions and communications

Active Sensing and Information Structuring for Intelligent Robot Vision with Range Imaging Sensor

Vision-based Drone Flocking in Outdoor Environments

Robust Multi-Robot Coverage of Unknown Environments using a Distributed Robot Swarm

Design of Multisensor Mobile Robot Vision Based on the RBPF-SLAM Algorithm

FACT: Fast and Active Coordinate Initialization for Vision-based Drone Swarms

Active Sensing for Intelligent Robot Vision with Range Imaging Sensor

Agile Formation Control of Drone Flocking Enhanced With Active Vision-Based Relative Localization

3D surveillance coverage using maps extracted by a monocular SLAM algorithm

SwarmHive: Heterogeneous Swarm of Drones for Robust Autonomous Landing on Moving Robot

Certifiable Mutual Localization and Trajectory Planning for Bearing-Based Robot Swarm

Real-Time Objects Recognition and Obstacles Avoidance for Mobile Robot

Source-Seeking Problem with Robot Swarms

Research on Robot Binocular Ranging Based on SIFT Feature Extraction Algorithm

Computationally-Efficient Distributed Algorithms of Navigation of Teams of Autonomous UAVs for 3D Coverage and Flocking