Abstract:Highlights A machine learning-based real-time monitoring system for agricultural machinery operators was developed. Categorization of tractor operators’ behaviors in real-time into low, medium, and high-risk safety behaviors. Visual and sound feedback alert system of Ag-OMS triggered when operators engaged in unsafe operating behaviors. ABSTRACT. The 2015 CS-CASH (Central States Center for Agricultural Safety and Health, 2015) Injury Surveillance Surveys showed that around 19% of injuries to agricultural producers are related to tractors or large agricultural machinery, yet only a limited number of studies are found that address tools and methods for monitoring safety behaviors of agricultural machinery operators in real-time. The current safety behavior monitoring approaches require an in-person presence, which can be both time- and cost-inefficient, and the other available methods lack a feedback element to alert operators in real-time. As a result, the research presented in this study aimed to develop an automated approach to monitoring tractor operators' safety behaviors through the use of a trained machine learning (ML) model and a feedback system to alert operators when they engage in unsafe practices. For the ML model development, a skeleton-detecting algorithm called OpenPose was used to detect real-time human postures in a livestreaming video feed from a camera installed in the tractor cab. The model was then trained on three separate categories of tractor operators’ safety operating behaviors, and this trained classifier was used to label operators’ safety behaviors in real time based on the three safety classes. A feedback mechanism controlled by an onboard microcontroller was then used to alert the operators when unsafe operating behavior was detected to facilitate safe practices. This monitoring system, named Ag-OMS (Agricultural Machinery Operators Monitoring System), monitored the ingress/egress operators’ behaviors in real-time entering and exiting the tractor cab. The Ag-OMS successfully identified the ingress/egress operators’ behaviors with an accuracy of 97% on the testing datasets for all safety risk categories. Keywords: Ag-OMS, Machine learning (ML), Safety behaviors, OpenPose, Tractor operator.

Support Vector Machine Approaches to Classifying Operator Functional State in Human-Machine System

Operator functional state classification using least-square support vector machine based recursive feature elimination technique.

Analysis on Operator Functional State of Human-Machine System Based on Approach of LSSVM Regressive Model

Classifying Human Operator Functional State Based on Electrophysiological and Performance Measures and Fuzzy Clustering Method.

Recursive Feature Elimination and Least Square Support Vector Machine Approaches to Operator Functional State Feature Selection and Classification

Artificial Neural Network based Predictive Modeling of Operator Functional State

Predictive Modeling of Human Operator Cognitive State Via Sparse and Robust Support Vector Machines.

Fuzzy Logic based Identification of Operator Functional States Using Multiple Physiological and Performance Measures

An adaptive human-machine control system based on multiple fuzzy predictive models of operator functional state.

Recognition of Mental Workload Levels under Complex Human–Machine Collaboration by Using Physiological Features and Adaptive Support Vector Machines

A video processing and machine learning based method for evaluating safety-critical operator engagement in a motorway control room

Health State Estimation of Hydraulic System Based on Generalized Multiclass Support Vector Machine

Pattern Classification of Instantaneous Cognitive Task-Load Through Gmm Clustering, Laplacian Eigenmap, and Ensemble Svms

Instantaneous Mental Workload Level Recognition by Combining Kernel Fisher Discriminant Analysis and Kernel Principal Component Analysis

Functional support vector machine

Assessment of Human Operator Functional State Using a Novel Differential Evolution Optimization Based Adaptive Fuzzy Model

Agricultural Machinery Operator Monitoring System (Ag-OMS): A Machine Learning Approach for Real-Time Operator Safety Assessment

Research of Discriminant Method for Human Body Physiological State Based on Support Vector Machine

Modeling and Control of Operator Functional State in A Unified Framework of Fuzzy Inference Petri Nets

Classification of Driving Postures by Support Vector Machines

A Comparison of OCMPM and OCSVM in Motor and Sensor Fault Detection for Traction Control System.