Abstract:The Bureau d'Enqu{ê}tes et d'Analyses pour la S{é}curit{é} de l'Aviation Civile (BEA) has to analyze accident videos from on-board or ground cameras involving all types of aircraft. Until now, this analysis has been manual and time-consuming. The aim of this study is to identify the applications of photogrammetry and to automate the extraction of 4D trajectories from these videos. Taking into account all potential flight configurations, photogrammetric algorithms are being developed on the basis of IGN's MicMac software and tested in the field. The results of these automated processes are intended to replace flight data from recorders such as FDRs or CVRs, which are sometimes missing. The information of interest to the BEA includes: three-dimensional position with the associated time component, the orientations of the aircraft's three axes (pitch, roll and yaw navigation angles) and average speeds (including rate of climb).

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: **How to automatically extract 4D trajectories (i.e., three - dimensional space plus time dimension) from videos to assist in aviation accident investigations, especially when flight data recorder (FDR) or cockpit voice recorder (CVR) data are missing**. Specifically, the paper aims to solve this problem in the following ways: 1. **Identify and apply usage scenarios of photogrammetry techniques**: Use photogrammetry techniques to extract the 4D trajectories of the aircraft from videos. This includes steps such as determining key points in the video, camera calibration, and image processing. 2. **Develop and test algorithms based on MicMac software**: Develop photogrammetry algorithms suitable for processing video data according to different flight configurations, and verify the effectiveness of these algorithms in actual tests. 3. **Replace missing flight data**: Through automated processing, generate 4D trajectory information that can replace FDR or CVR data, providing important supplementary data for aviation accident investigations. ### Specific Objectives - **Position and Attitude Information**: Obtain the three - dimensional position (longitude, latitude, altitude) of the aircraft and its changes over time. - **Navigation Angles**: Calculate the attitude angles (pitch angle, roll angle, yaw angle) of the aircraft. - **Speed Information**: Determine the average speed, including the climb rate. ### Key Challenges - **Camera Calibration**: Since the camera may be damaged after an accident, post - accident calibration needs to be carried out by other methods. - **Video Frame Processing**: Select an appropriate frame rate and image quality to ensure sufficient overlap and clarity while reducing the amount of computation. - **Object Location**: Whether it is a fixed camera or a mobile camera, it is necessary to accurately locate the objects in the video. Through these methods, the paper hopes to be able to reconstruct the detailed situation at the time of the accident even without traditional flight data records, thereby improving the efficiency and accuracy of aviation accident investigations.

Automated extraction of 4D aircraft trajectories from video recordings

High-Resolution Vehicle Trajectory Extraction and Denoising from Aerial Videos.

Massive Trajectory Matching and Construction from Aerial Videos based on Frame-by-Frame Vehicle Detections

Vehicle-Human Interactive Behaviors in Emergency: Data Extraction from Traffic Accident Videos

Automatic creation of urban velocity fields from aerial video

Generating Flight Summaries Conforming to Cinematographic Principles

Three-frame Algorithm of Car Path Reconstruction from Airborne Traffic Data

Analysis of UAV Flight Patterns for Road Accident Site Investigation

3D Trajectory Reconstruction of Drones using a Single Camera

Automatic vehicle trajectory data reconstruction at scale

AeroTraj: Trajectory Planning for Fast, and Accurate 3D Reconstruction Using a Drone-based LiDAR

Automated Cinematography with Unmanned Aerial Vehicles

Trajectory Approximation of Video Based on Phase Correlation for Forward Facing Camera

3D Reconstruction of Bird Flight Trajectories Using a Single Video Camera

Vehicle Trajectory Extraction at the Exit Areas of Urban Freeways Based on a Novel Composite Algorithms Framework

Auto Filmer: Autonomous Aerial Videography Under Human Interaction

TUMDOT–MUC: Data Collection and Processing of Multimodal Trajectories Collected by Aerial Drones

The Time-SIFT method : detecting 3-D changes from archival photogrammetric analysis with almost exclusively image information

Automated 3D trajectory measuring of large numbers of moving particles

Multi-Modal Contextualization of Trajectory Data for Advanced Analysis

Modeling Trajectories for 3D Motion Analysis