Abstract:Computer vision is an emerging tool in ecological research for rapidly, automatically, and accurately classifying images of specimens. In this methods guide, Blair et al. provide a gentle introduction and tutorial for computer vision‐based classification methods using ecological data. Classifying specimens is a critical component of ecological research, biodiversity monitoring and conservation. However, manual classification can be prohibitively time‐consuming and expensive, limiting how much data a project can afford to process. Computer vision, a form of machine learning, can help overcome these problems by rapidly, automatically and accurately classifying images of specimens. Given the diversity of animal species and contexts in which images are captured, there is no universal classifier for all species and use cases. As such, ecologists often need to train their own models. While numerous software programs exist to support this process, ecologists need a fundamental understanding of how computer vision works to select appropriate model workflows based on their specific use case, data types, computing resources and desired performance capabilities. Ecologists may also face characteristic quirks of ecological datasets, such as long‐tail distributions, 'unknown' species, similarity between species and polymorphism within species, which impact the efficacy of computer vision. Despite growing interest in computer vision for ecology, there are few resources available to help ecologists face the challenges they are likely to encounter. Here, we present a gentle introduction for species classification using computer vision. In this manuscript and associated GitHub repository, we demonstrate how to prepare training data, basic model training procedures, and methods for model evaluation and selection. Throughout, we explore specific considerations ecologists should make when training classification models, such as data domains, feature extractors and class imbalances. With these basics, ecologists can adjust their workflows to achieve research goals and/or account for uncertainty in downstream analysis. Our goal is to provide guidance for ecologists for getting started in or improving their use of machine learning for visual classification tasks.

From images in the wild to video-informed image classification

Image classification for content-based indexing

Look and Listen: A Multi-modality Late Fusion Approach to Scene Classification for Autonomous Machines

Fine-Grained ImageNet Classification in the Wild

ON IMAGE CLASSIFICATION: CITY IMAGES VS. LANDSCAPES

Towards Textually Describing Complex Video Contents with Audio-Visual Concept Classifiers

Fine-grained Image Classification by Visual-Semantic Embedding

Write a Classifier: Predicting Visual Classifiers from Unstructured Text

Performance of computer vision algorithms for fine-grained classification using crowdsourced insect images

Real-time Object Classification in Video Surveillance Based on Appearance Learning

Image-to-Image Translation of Synthetic Samples for Rare Classes

Exploring Local Features and the Bag-of-Visual-Words Approach for Bioimage Classification.

Reviving the Context: Camera Trap Species Classification as Link Prediction on Multimodal Knowledge Graphs

Towards Automatic Identification of Elephants in the Wild

Design of a high-density bio-inspired feature analysis deep learning model for sub-classification of natural & synthetic imagery

Plant Species Classification and Biodiversity Estimation from UAV Images with Deep Learning

A gentle introduction to computer vision‐based specimen classification in ecological datasets

Hierarchical Classification for Automated Image Annotation of Coral Reef Benthic Structures

Computer Vision for Primate Behavior Analysis in the Wild

Application of neural networks for the classification of objects in video data in the tasks of automatic monitoring of the condition of biological objects

Combining bag of visual words-based features with CNN in image classification