The Study of Maritime Helicopter-landing System Using Electro-optical Technology

Li Geng

2005-01-01

Abstract:The principle of an electro-optical landing system for maritime helicopters is introduced.Functions of the subsystems are also described.Focus is concentrated on the digital image processing method and the arithmetic of ranging and gesture.The performance of the system is proved by simulating test.

What problem does this paper attempt to address?

Research on Dynamic Landing Guidance Algorithm for the Maritime Quadrotor

Weitao Ding,Haocai Huang

DOI: https://doi.org/10.1016/j.oceaneng.2023.113775

IF: 5

2023-01-01

Ocean Engineering

Abstract:The dynamic landing guidance of the marine quadrotor is composed of trajectory guidance and landing guidance, which can't be completed by the traditional land-based landing guidance method. In addition, complex sea environment will increase the difficulty in dynamic landing guidance such as enhancing the position deviation, which will make the quadrotor unable to land accurately. To address the large trajectory tracking error when the quadrotor is flying, an adaptive step-based line-of-sight (LOS) guidance algorithm is adopted in this work to achieve dynamic three-dimensional (3D) trajectory tracking. The algorithm can not only track the trajectory of the quadrotor in a 3D space based on the position information of the wave glider, but also dynamically adjust the tracking angle and orientation in real time based on the distance and orientation information to improve the tracking accuracy. To address the low accuracy in dynamic positioning of the quadrotor while landing on the wave glider floating body, a visual landing guidance method with fused electromagnetic compensation is used. It can improve accuracy in the dynamic landing guidance of the April Tag visual reference system and reduce the interference from shaking of the wave glider floating body on landing positioning guidance of the quadrotor. The simulation results verify that the proposed algorithm can effectively reduce the trajectory tracking error of the quadrotor and accelerate trajectory convergence. The sea trial experiments prove that the trajectory tracking and landing guidance algorithm adopted in this work can well guide the quadrotor in dynamic and accurate landing on the wave glider floating body, and shorten the time.
Development and Test of a Subsea Docking System Applied to an Autonomous Underwater Helicopter

Chengye Cai,Zhenwei Rong,Xinyi Xie,Bo Xu,Zhuoyu Zhang,Zheyuan Wu,Yulin Si,Haocai Huang

DOI: https://doi.org/10.1109/oceans47191.2022.9977180

2022-01-01

Abstract:With the increasing demand for long-term underwater observation and operation of AUVs, the subsea docking system (SDS) as a solution has been extensively concerned. Now, an autonomous underwater helicopter (AUH), as a kind of disc-shaped AUV developed in near-seafloor observation and operation, is also eager for an approach to realize its long-term underwater observation operation mode. Therefore, this paper proposes an SDS applied to the AUH. Furthermore, for the SDS to achieve its long-term underwater operation, this paper also adds a communication link that an electrical-optical-mechanical (EOM) cable connects a communication buoy to the SDS. It can charge the SDS and realize the communication between the SDS and the outside world. Finally, we have completed the development of an SDS prototype and a graphical user interface (GUI). Through the tests in the water tank and Qiandao Lake, the SDS successfully assisted the AUH in docking with it and then succeeded in locking and charging the AUH. This study not only meets the needs of the AUH but also proves a feasible approach to realizing the long-term underwater operation of SDS.
Study on Marine-aerial Acousto-optic Information Link

ZHOU Yue,XU Wen,SHEN Yong-hang,LIU Wei

DOI: https://doi.org/10.3969/j.issn.1001-9146.2011.04.017

2011-01-01

Abstract:This paper introduces the framework of marine-aerial,acousto-optic information link.The theory for the air-sea interface optical-to-acoustic conversion and down-link of this framework is discussed.Experiment results demonstrate that the derived optical-to-acoustic energy conversion efficiency can be used as a theoretical lower bound and the optical-to-acoustic information link is feasible.
Vision System for an Unmanned Helicopter Landing in Complex Environment

Guanlin Wang,Haiqing Shi,Hong Wang,Jihong Zhu

DOI: https://doi.org/10.1109/cisp.2009.5305195

2009-01-01

Abstract:This paper presents a vision-based navigation algorithm for an autonomous helicopter landing in complex environment include appointed landing mark coupled with several similar targets. The vision navigation system is integrated with algorithms of vision detection, target recognition and navigation instruction calculation. The navigation is used for indicating the helicopter to land on the landing mark exactly. In our algorithm, we use international standard landing mark as helicopter landing signal. The experiments results demonstrate that the algorithm has feature of robustness, accuracy and real-time. It meets the actual flight requirements well.
Height Estimation Method for Landing of Small Unmanned Helicopter Based on Monocular Vision

ZHENG Xiao-ping,HAN Bo,LI Ping,ZHANG Yu

DOI: https://doi.org/10.3969/j.issn.1000-9787.2013.02.040

2013-01-01

Abstract:Aiming at situation that small unmanned helicopter(SUH)changes its attitude during landing stage,and non-differential GPS lacks of precision,a monocular vision-based SUH height measurement method is researched to enhance the quality of autonomous landing.Under the condition of obtaining the body attitude angles previously,recognizes and extracts the parallel feature straight lines according to on-board camera projection model,real-time calculate height during landing.The feasibility of this method is testified on the measuring system,and experimental results indicate that the method performs a relative high feature recognizing rate and real-time and accuracy of output result can entirely meet requirements of landing when tilt angle exists between airframe plane and landing plane.
A vision system for landing an unmanned helicopter in a complex environment

Haiqing Shi,Hong Wang

DOI: https://doi.org/10.1117/12.832009

2009-01-01

Abstract:We present a vision-based landing algorithm for an autonomous helicopter under complex environment (there are several suspected targets). The algorithm is integrated with algorithms for visual acquisition, recognition of the target and computing the navigation information. In our algorithm, we use international standard landing mark as our landing target. The experiment results demonstrate that our algorithm has the feature of robustness, accuracy and real time. It can meet the actual flight requirements well: the average processing time of a 640×480 image is less than 40ms; the position error is below 5cm in each axis of translation; the angle error is below 3.5°. Based on the algorithm, we win the champion of the aerial robot competition in the 2008 China robot competition and the RoboCup China open.
A Scheme of Landing for an Autonomous Unmanned Aerial Vehicle

WANG Bin,LV Tiansheng,WANG Geng,ZHOU Tuoyu

DOI: https://doi.org/10.3969/j.issn.1001-3881.2006.01.042

2006-01-01

Abstract:In order to control the unmanned helicopter to land autonomous on target(a helipad of a known shape),a real-time,vision-based landing algorithm was presented.The vision-based algorithm can realize precise target detection and recognition,make the helicopter to update its landing target parameters based on vision and use an on board behavior-based controller to follow a path to the landing site.Results from flight trials show that the detection,recognition and control algorithms are accurate,reliable,robust and repeatable.
Theoretical and Experimental Study for Dual Camera Photogrammetry Algorithm in Photoelectric Guidance System for Helicopter Landing

YANG Cheng,ZHU Da-yong,PENG Zhen-ming,ZHANG Jing

DOI: https://doi.org/10.3969/j.issn.1003-501x.2010.10.010

2010-01-01

Abstract:Based on the positioning technology of beacon photogrammetry, Dual Camera Photogrammetry (DCP) algorithm was proposed in photoelectric guidance system for helicopter landing. Two Charge Coupled Device (CCD) cameras were used to image four beacons on both sides of the helicopter. Target coordinate systems, camera coordinate systems and image pixel coordinate systems were established. Based on the colinearity of beacon, lens center and beacon image point, a system of linear equations on rotation matrix and translation vector could be obtained. The position and posture parameters of helicopter relative to the landing point could be solved. A photoelectric guidance experiment system for helicopter landing was designed. In high performance Digital Signal Processor (DSP) system, two channels of image signal were processed in real time. The real time helicopter landing guidance information was calculated with DCP algorithm. The simulation experiments show that in the distance interval from 8 m to 13 m, the distance measurement accuracy can reach ±5 cm and the angle measurement accuracy can reach ±3° in the photoelectric guidance experiment system.
Track and parameter measures in electro-optical landing guidance system

Da-yong ZHU,Cheng YANG,Jin ZHANG,Zhi-yong ZHANG,Zhen-ming PENG,Bin HUANG

DOI: https://doi.org/10.3969/j.issn.1007-2276.2008.03.004

2008-01-01

Abstract:The accurate orientation technology of CCD photogrammetry was analyzed, the mathematic model using four beacons to measure the exact position of the object in the space was established, and the calculation formula was deduced. The primary features of photogrammetry was high precision in calculation and able to calculate the real-time position information so as to accomplish the accurate orientation of spatial object. The method had significant useful value in the application of spaceflight and aviation. An electrooptical guidance system was designed for helicopter landing and recovery. Two infrared CCD cameras were used to image the four beacons illuminated by semiconductor lasers on both sides of the helicopter. The beacon position and attitude were extracted through image processing and target identification. The helicopter coordinates in real time were calculated relative to the landing point based on the dual camera photogrammetry (DCP) model. Using the high performance DSP system, two channel image signal were detected and tracked in real time, the experimental results were given. The simulation experiment shows that the measurement accuracy of the distance can reach ±5cm and the measurement accuracy of the angle can reach ±3° in the distance from 8m to 13m for electro-optical guidance system.
Vertical Modeling and Autonomous Landing of a Mini Unmanned Helicopter

Wenda Sun,Ping Li,Yu Xu,Zhou Fang,Xin Hou

DOI: https://doi.org/10.1109/wcica.2010.5554317

2010-01-01

Abstract:By analyzing the physical and aerodynamic principles, the vertical dynamics of a mini unmanned helicopter is modeled, and from which the analytic form of linearized model is derived out. A vertical velocity controller is designed based on this model, which scheduled by a multilevel finite state machine (FSM). In the addition, an effective autonomous landing programming method with effectively utilizing several sensors is proposed. A mount of flight experimental results have shown that the designed controller and programming method can successfully perform autonomous landing flights on several grounds of specific characteristics.
A Multi-stage Precision Landing Method for Autonomous Evtol Based on Multi-marker Joint Localization

Senwei Xiang,Minxiang Ye,Shiqiang Zhu,Jason Gu,Anhuan Xie,Zehua Men

DOI: https://doi.org/10.1109/robio55434.2022.10011837

2022-01-01

Abstract:Electric vertical takeoff and landing aircraft (eVTOL) has drawn more and more attention from home and abroad in recent years. It is believed autonomous eVTOL will create a new era of Urban Air Mobility (UAM) and Advanced Air Mobility (AAM). To autonomous eVTOL, precision landing is an extremely critical operation for it directly affects flight safety. In this paper, we analyze the special issues an eVTOL will encounter when it lands in the UAM applications. A multi-stage precision landing method based on multi-marker joint localization is proposed accordingly. Our method contains three key elements: a compatible vertiport with multiple visual markers; an accurate, fast detection and localization algorithm for the vertiport and a multi-stage landing strategy. We implement our method on an eVTOL prototype named ZJ-Copter developed by Zhejiang Lab. A series of real-world experiments have been conducted to validate the effectiveness and accuracy of the proposed method. Experiment results show that our method works well in real-world scenarios for autonomous eVTOL without GPS signal during landing process. The positioning accuracy is less than 0.1m (altitude $< \mathbf{10}\mathbf{m}$ ), while the landing accuracy is less than 0.5m.
Maritime operation of an unmanned rotorcraft with tethered ship deck landing system

B. I. Schuchardt,T. Dautermann,A. Donkels,S. Krause,N. Peinecke,G. Schwoch

DOI: https://doi.org/10.1007/s13272-020-00472-9

2020-09-24

CEAS Aeronautical Journal

Abstract:Abstract In security-critical situations in the maritime area, ship-based deployment of remotely piloted aircraft systems could enable automated acquisition of aerial images and other sensor data. If intervention is required, response times of federal institutions could be shortened significantly without endangering personnel. This paper gives an overview of research undertaken at DLR in cooperation with the German Federal Police for Maritime Tasks. For a safe ship deck landing of an unmanned rotorcraft a combination of precise navigation and tethered landing system has been developed and patented. Relative double-difference algorithms are used for precise navigation of the rotorcraft to a hover point over the ship deck. From there, an electromagnetic winch is lowered from the rotorcraft that connects to the ship deck. The resulting cable connection is used for aligning the rotorcraft during landing and securing it on the ship deck afterwards. First demonstrations on a real ship deck show the feasibility of the system.
Vision navigation for unmanned helicopter autonomous landing

GuanLin Wang,Haiqing Qing Shi,Hongsheng Tan,Hui Xia,Hong Wang,Jihong Zhu

2009-01-01

Abstract:This paper introduces an unmanned helicopter vision navigation system and algorithm. During the helicopter landing phase, the ground control station detects and identifyies the landing mark from the video shot by helicopter, thus continuously calculating three navigation instructions and sending back to the helicopter. The helicopter can modify the location and yaw angle error until landing on the mark. Therefore, the unmanned helicopter becomes a position servo system based on computer vision navigation. Simulation and real flight experiments indicate that the system has the characteristics of robustness, accuracy and real time. It meets the actual flight requirements of the unmanned helicopter autonomous landing in a complex environment.
STEREO VISION-BASED ESTIMATION OF POSE AND MOTION FOR AUTONOMOUS LANDING OF AN UNMANNED HELICOPTER

Cui Xu,Liankui Qiu,Ming Liu,Bin Kong,Yunjian Ge

DOI: https://doi.org/10.1142/s0219878906000940

2006-01-01

International Journal of Information Acquisition

Abstract:In this paper, we present a real-time stereo vision based pose and motion estimation system that will be used for landing an unmanned helicopter on a moving target such as a ship deck. The vision algorithm mainly consists of a feature extraction task and a pose and motion estimation task. The 2D planer target with regular features defined can significantly simplify the feature extraction task such as corner detection and feature points matching. To effectively estimate the distance between the camera carrier and target a stereo camera system is applied. By means of sub-pixel corner location the precisions of pose estimation and relative motion detection can be improved. We present results from semi-physical simulation which show that our vision algorithm is accurate and robust. The methodology provides an effective subsystem for the development of autonomous robot helicopter that will land on a given target under the guide of vision.
Intelligent Vision-based Autonomous Ship Landing Of VTOL UAVs

Bochan Lee,Vishnu Saj,Dileep Kalathil,Moble Benedict

DOI: https://doi.org/10.4050/jahs.68.022010

2023-04-01

Journal of the American Helicopter Society

Abstract:The paper discusses an intelligent vision-based control solution for autonomous tracking and landing of vertical take-off and landing (VTOL) capable unmanned aerial vehicles (UAVs) on ships without utilizing GPS signals. The central idea involves automating the Navy helicopter ship landing procedure where the pilot utilizes the ship as the visual reference for long-range tracking; however, it refers to a standardized visual cue installed on most Navy ships called the "horizon bar" for the final approach and landing phases. This idea is implemented using a uniquely designed nonlinear controller integrated with machine vision. The vision system utilizes machine learning based object detection for long-range ship tracking and classical computer vision for the estimation of aircraft relative position and orientation utilizing the horizon bar during the final approach and landing phases. The nonlinear controller operates based on the information estimated by the vision system and has demonstrated robust tracking performance even in the presence of uncertainties. The developed autonomous ship landing system was implemented on a quad-rotor UAV equipped with an onboard camera, and approach and landing were successfully demonstrated on a moving deck, which imitates realistic ship deck motions. Extensive simulations and flight tests were conducted to demonstrate vertical landing safety, tracking capability, and landing accuracy.

engineering, aerospace
Landmark recognition system for mini rotor aerial robot

Ren Qinyuan,Li Ping,Han Bo

DOI: https://doi.org/10.1109/WCICA.2006.1713972

2006-01-01

Abstract:Landmark recognition system is a very important part of mini rotor aerial robot. It recognizes landmarks, and supplies the navigation computer with location information of it. However, mini rotor aerial robots have low pay-load and are small in size. This means that the sensor like radar not fit in with this application, and the small size and low power cost cameras may be the only sensors can be used. In this paper we focus on a landmark recognition system which uses an onboard camera as the sensor. Meanwhile, this paper presents an approach that is applied to real-time recognizing of landmark in video stream. This problem poses several challenges. Landmark in images captured from video stream by moving mini rotor robot vary in shape, size, scale and orientation. Unlike other approaches, this approach is based on classification algorithms. An extended set of haar-like features is used, due to their simplicity. Landmarks are divided into several viewpoint categories according to their poses and each of these categories is processed by a cascade classifier which is trained by the Adaboosting algorithm. In the end, the experimental results verify the effectiveness of the system. © 2006 IEEE.
A Method of Vision-Based State Estimation of an Unmanned Helicopter

Bin Yuan,YingGuang Hao

DOI: https://doi.org/10.1109/WICOM.2010.5600249

2010-01-01

Abstract:This paper presents a real-time algorithm of accurately identifying helipad and estimating the state information for landing an unmanned aerial helicopter autonomously via computer vision. The algorithm estimates the instantaneous attitude and position parameters of the helicopter relative to the helipad from continuously tracked points using the optical flow method. The vision system, consisting of a calibrated monocular camera, a helipad and an experiment platform, can perform image processing, helipad recognition, feature extraction, target tracking and motion estimation. The experimental results show that the algorithm is accuracy, robust and fast.
Monocular visual autonomous landing system for quadcopter drones using software in the loop

Miguel Saavedra-Ruiz,Ana Mario Pinto-Vargas,Victor Romero-Cano

DOI: https://doi.org/10.48550/arXiv.2108.06616

2021-08-15

Abstract:Autonomous landing is a capability that is essential to achieve the full potential of multi-rotor drones in many social and industrial applications. The implementation and testing of this capability on physical platforms is risky and resource-intensive; hence, in order to ensure both a sound design process and a safe deployment, simulations are required before implementing a physical prototype. This paper presents the development of a monocular visual system, using a software-in-the-loop methodology, that autonomously and efficiently lands a quadcopter drone on a predefined landing pad, thus reducing the risks of the physical testing stage. In addition to ensuring that the autonomous landing system as a whole fulfils the design requirements using a Gazebo-based simulation, our approach provides a tool for safe parameter tuning and design testing prior to physical implementation. Finally, the proposed monocular vision-only approach to landing pad tracking made it possible to effectively implement the system in an F450 quadcopter drone with the standard computational capabilities of an Odroid XU4 embedded processor.

Robotics,Computer Vision and Pattern Recognition
Study on Computer Vision-Based Approaches to Estimate Positionand Orientation of Unmanned Helicopter

刘士清,胡春华,朱纪洪

DOI: https://doi.org/10.3969/j.issn.1000-7024.2004.04.026

2004-01-01

Abstract:The relative position and orientation estimation between an unmanned helicopter and a desired landing site is the pre-condition for its automatic landing, and it is the current tendency to complete this task by computer vision techniques. The charac-teristics of vision-based approaches to estimate relative position and orientation were sketched, and then the approaches in current researches on automatic unmanned helicopter landing were classified and reviewed, which provided reference for the design of similar vision systems and the research of relational problems.

The Study of Maritime Helicopter-landing System Using Electro-optical Technology

Research on Dynamic Landing Guidance Algorithm for the Maritime Quadrotor

Development and Test of a Subsea Docking System Applied to an Autonomous Underwater Helicopter

Study on Marine-aerial Acousto-optic Information Link

Vision System for an Unmanned Helicopter Landing in Complex Environment

Height Estimation Method for Landing of Small Unmanned Helicopter Based on Monocular Vision

A vision system for landing an unmanned helicopter in a complex environment

A Scheme of Landing for an Autonomous Unmanned Aerial Vehicle

Theoretical and Experimental Study for Dual Camera Photogrammetry Algorithm in Photoelectric Guidance System for Helicopter Landing

Track and parameter measures in electro-optical landing guidance system

Vertical Modeling and Autonomous Landing of a Mini Unmanned Helicopter

A Multi-stage Precision Landing Method for Autonomous Evtol Based on Multi-marker Joint Localization

Maritime operation of an unmanned rotorcraft with tethered ship deck landing system

Vision navigation for unmanned helicopter autonomous landing

STEREO VISION-BASED ESTIMATION OF POSE AND MOTION FOR AUTONOMOUS LANDING OF AN UNMANNED HELICOPTER

Intelligent Vision-based Autonomous Ship Landing Of VTOL UAVs

Landmark recognition system for mini rotor aerial robot

A Method of Vision-Based State Estimation of an Unmanned Helicopter

Monocular visual autonomous landing system for quadcopter drones using software in the loop

Study on Computer Vision-Based Approaches to Estimate Positionand Orientation of Unmanned Helicopter