[The neurochemical bases of psychopharmacology].

V. Bonavita

Abstract:

What problem does this paper attempt to address?

An Open-Source Platform For Underwater Image And Video Analytics

Matthew Dawkins,Linus Sherrill,Keith Fieldhouse,Anthony Hoogs,Benjamin Richards,David Zhang,Lakshman Prasad,Kresimir Williams,Nathan Lauffenburger,Gaoang Wang

DOI: https://doi.org/10.1109/WACV.2017.105

2017-01-01

Abstract:Global fisheries and the future of sustainable seafood are predicated on healthy populations of various species of fish and shellfish. Recent developments in the collection of large-volume optical data by autonomous underwater vehicles (AUVs), stationary camera arrays, and towed vehicles has made it possible for fishery scientists to generate species-specific, size-structured abundance estimates for different species of marine organisms via imagery. The immense volume of data collected by such devices quickly exceeds manual processing capacity and creates a strong need for automatic image analysis. This paper presents an open-source computer vision software platform designed to integrate common image and video analytics, such as stereo calibration, object detection and object classification, into a sequential data processing pipeline that is easy to program, multi-threaded, and generic. The system provides a cross-language common interface for each of these components, multiple implementations of each, as well as unified methods for evaluating and visualizing the results of different methods for accomplishing the same task.
Online Fish Tracking with Portable Smart Device for Ocean Observatory Network

Rui Nian,Xiaorun Wang,Renzheng Che,Bo He,Xiao Xu,Peiliang Li,Amaury Lendasse

2017-01-01

Abstract:Nowadays, ocean observatory networks, which gather and provide multidisciplinary, long-term, 3D continuous marine observations at multiple temporal spatial scales, play a more and more important role in ocean investigations. In this paper, we try to develop a portable smart device with online fish detection and tracking strategies by ARM7 microprocessor for ocean observatory networks, combining the deformable fish body description with compressive sensing together. A fish detection system is introduced to represent highly variable objects using mixtures of multiscale deformable fish body description which include three parts:(1) root filter, which describes the global contour feature of underwater fish.(2) fish body part filter, which capture finer resolution features of underwater fish. (3) spatial model, which describes the relationship between the fish body part filters and the root filter. And then, we apply a simple yet effective, real-time and robust of fast compressive tracking algorithm with an appearance model to focus on the motion trajectories of underwater fish. It has been shown in the simulation experiments that the developed scheme of this paper achieves consistent performance improvements on online fish tracking for ocean observatory network.
Multi-detector and Motion Prediction-Based High-Speed Non-Intrusive Fingerling Counting Method

Jialong Zhou,Zhangying Ye,Jian Zhao,Daxiong Ji,Zequn Peng,Guoxing Lu,Musa Abubakar Tadda,Abubakar Shitu,Songming Zhu

DOI: https://doi.org/10.1016/j.biosystemseng.2024.06.009

IF: 5.002

2024-01-01

Biosystems Engineering

Abstract:Fingerling counting is a basic operation in fish farming and provides an important guideline for many aspects of aquaculture. However, most of the current counting methods are inefficient or computationally cumbersome. This study proposed a high-speed, non -intrusive fingerling counting method based on multiple detectors and a motion prediction model, which achieved high -accuracy counting under the condition of low -frame rate. Firstly, to effectively detect and locate the adherent fingerlings, the detector was accomplished by combining the mixture of Gaussian -based (MOG) segmentation algorithm and the local extremum-based blob detection algorithm. Secondly, three different functions were used to construct a motion prediction model to predict the approximate probability of the fingerlings at each position in the previous frame. Thirdly, the cost matrix was constructed with probability as the feature to associate the fingerlings in the consecutive frames, and the newly appeared fingerlings were counted in real-time, realising the continuous fingerling counting with high precision. Through testing and analysis on 52 collected datasets under low -frame -rate (10 fps) acquisition conditions using largemouth bass (Micropterus salmoides, 3-5 cm) and crucian carp (Carassius auratus, 2-6 cm), results indicated that the best motion prediction model with segmentation function reached over 99% average counting accuracy for both species, with a standard deviation of accuracy less than 0.7%. This method provides a low-cost, highspeed, and stable application solution for computer vision -based fingerling counting.
A Kinematic Analysis-Based On-Line Fingerlings Counting Method Using Low-Frame-rate Camera

Jialong Zhou,Daxiong Ji,Jian Zhao,Songming Zhu,Zequn Peng,Guoxing Lu,Zhangying Ye

DOI: https://doi.org/10.1016/j.compag.2022.107193

IF: 8.3

2022-01-01

Computers and Electronics in Agriculture

Abstract:Accurate estimation of fingerlings quantity is one of the most challenging aspects of aquaculture, relevant simple and efficient solutions, however, are still lacking. To address this problem, an accurate and practical on-line counting method for 2-8 cm fingerlings, which was simple to implement, computational inexpensively (without huge pre-training like that in deep learning), and suitable for five different kinds of fingerlings, based on fish kinematics characteristics was proposed in this study. First, the kinematic model of the fingerlings for motion prediction was constructed based on the analysis of their kinematics characteristics; secondly, adaptive threshold segmentation (ATS) algorithm was used to segment and detect the fingerlings; and then, the fingerlings in previous and current frames were associated and tracked by using the kinematic model and the probability density function (PDF). Following this, the new fingerlings were identified and counted in real-time. Finally, through the exhaustive test on 102 datasets (acquired with a low frame rate (10 fps)), the present method showed the average counting accuracy rate (ACAR) and standard deviation (SD) of more than 98.78% and less than 0.95%, respectively. Specifically, the ACAR of Pseudosciaena Crocea (2-3 cm) and Ctenopharyngodon idellus (3-5 cm, 6-8 cm) exceeded 99.19%, and the corresponding SD was less than 0.59%.
Tracking Fish Abundance by Underwater Image Recognition

Simone Marini,Emanuela Fanelli,Valerio Sbragaglia,Ernesto Azzurro,Joaquin Del Rio Fernandez,Jacopo Aguzzi

DOI: https://doi.org/10.1038/s41598-018-32089-8

IF: 4.6

2018-09-13

Scientific Reports

Abstract:Marine cabled video-observatories allow the non-destructive sampling of species at frequencies and durations that have never been attained before. Nevertheless, the lack of appropriate methods to automatically process video imagery limits this technology for the purposes of ecosystem monitoring. Automation is a prerequisite to deal with the huge quantities of video footage captured by cameras, which can then transform these devices into true autonomous sensors. In this study, we have developed a novel methodology that is based on genetic programming for content-based image analysis. Our aim was to capture the temporal dynamics of fish abundance. We processed more than 20,000 images that were acquired in a challenging real-world coastal scenario at the OBSEA-EMSO testing-site. The images were collected at 30-min. frequency, continuously for two years, over day and night. The highly variable environmental conditions allowed us to test the effectiveness of our approach under changing light radiation, water turbidity, background confusion, and bio-fouling growth on the camera housing. The automated recognition results were highly correlated with the manual counts and they were highly reliable when used to track fish variations at different hourly, daily, and monthly time scales. In addition, our methodology could be easily transferred to other cabled video-observatories.

multidisciplinary sciences
Edge computing based real-time Nephrops (Nephrops norvegicus) catch estimation in demersal trawls using object detection models

Ercan Avsar,Jordan P. Feekings,Ludvig Ahm Krag

DOI: https://doi.org/10.1038/s41598-024-60255-8

IF: 4.6

2024-04-26

Scientific Reports

Abstract:In demersal trawl fisheries, the unavailability of the catch information until the end of the catching process is a drawback, leading to seabed impacts, bycatches and reducing the economic performance of the fisheries. The emergence of in-trawl cameras to observe catches in real-time can provide such information. This data needs to be processed in real-time to determine the catch compositions and rates, eventually improving sustainability and economic performance of the fisheries. In this study, a real-time underwater video processing system counting the Nephrops individuals entering the trawl has been developed using object detection and tracking methods on an edge device (NVIDIA Jetson AGX Orin). Seven state-of-the-art YOLO models were tested to discover the appropriate training settings and YOLO model. To achieve real-time processing and accurate counting simultaneously, four frame skipping ideas were evaluated. It has been shown that adaptive frame skipping approach, together with YOLOv8s model, can increase the processing speed up to 97.47 FPS while achieving correct count rate and F-score of 82.57% and 0.86, respectively. In conclusion, this system can improve the sustainability of the Nephrops directed trawl fishery by providing catch information in real-time.

multidisciplinary sciences
Computer vision system to count crustacean larvae

Chen Rothschild

DOI: https://doi.org/10.48550/arXiv.2209.05834

2022-09-13

Abstract:Fish products account for about 16 percent of the human diet worldwide, as of 2017. The counting action is a significant component in growing and producing these products. Growers must count the fish accurately, to do so technological solutions are needed. Two computer vision systems to automatically count crustacean larvae grown in industrial ponds were developed. The first system included an iPhone 11 camera with 3024X4032 resolution which acquired images from an industrial pond in indoor conditions. Two experiments were performed with this system, the first one included 200 images acquired in one day on growth stages 9,10 with an iPhone 11 camera on specific illumination condition. In the second experiment, a larvae industrial pond was photographed for 11 days with two devices an iPhone 11 and a SONY DSCHX90V cameras. With the first device (iPhone 11) two illumination conditions were tested. In each condition, 110 images were acquired. That system resulted in an accuracy of 88.4 percent image detection. The second system included a DSLR Nikon D510 camera with a 2000X2000 resolution with which seven experiments were performed outside the industrial pond. Images were acquired on day 1 of larvae growing stage resulting in the acquisition of a total of 700 images. That system resulted in an accuracy of 86 percent for a density of 50. An algorithm that automatically counts the number of larvae was developed for both cases based on the YOLOv5 CNN model. In addition, in this study, a larvae growth function was developed. Daily, several larvae were taken manually from the industrial pond and analyzed under a microscope. Once the growth stage was determined, images of the larva were acquired. Each larva's length was measured manually from the images. The most suitable model was the Gompertz model with a goodness of fit index of R squared of 0.983.

Computer Vision and Pattern Recognition,Image and Video Processing
A Deep-Learning Based Pipeline for Estimating the Abundance and Size of Aquatic Organisms in an Unconstrained Underwater Environment from Continuously Captured Stereo Video

Gordon Böer,Joachim Paul Gröger,Sabah Badri-Höher,Boris Cisewski,Helge Renkewitz,Felix Mittermayer,Tobias Strickmann,Hauke Schramm

DOI: https://doi.org/10.3390/s23063311

IF: 3.9

2023-03-22

Sensors

Abstract:The utilization of stationary underwater cameras is a modern and well-adapted approach to provide a continuous and cost-effective long-term solution to monitor underwater habitats of particular interest. A common goal of such monitoring systems is to gain better insight into the dynamics and condition of populations of various marine organisms, such as migratory or commercially relevant fish taxa. This paper describes a complete processing pipeline to automatically determine the abundance, type and estimate the size of biological taxa from stereoscopic video data captured by the stereo camera of a stationary Underwater Fish Observatory (UFO). A calibration of the recording system was carried out in situ and, afterward, validated using the synchronously recorded sonar data. The video data were recorded continuously for nearly one year in the Kiel Fjord, an inlet of the Baltic Sea in northern Germany. It shows underwater organisms in their natural behavior, as passive low-light cameras were used instead of active lighting to dampen attraction effects and allow for the least invasive recording possible. The recorded raw data are pre-filtered by an adaptive background estimation to extract sequences with activity, which are then processed by a deep detection network, i.e., Yolov5. This provides the location and type of organisms detected in each video frame of both cameras, which are used to calculate stereo correspondences following a basic matching scheme. In a subsequent step, the size and distance of the depicted organisms are approximated using the corner coordinates of the matched bounding boxes. The Yolov5 model employed in this study was trained on a novel dataset comprising 73,144 images and 92,899 bounding box annotations for 10 categories of marine animals. The model achieved a mean detection accuracy of 92.4%, a mean average precision (mAP) of 94.8% and an F1 score of 93%.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Improved Accuracy for Automated Counting of a Fish in Baited Underwater Videos for Stock Assessment

Rod M. Connolly,David V. Fairclough,Eric L. Jinks,Ellen M. Ditria,Gary Jackson,Sebastian Lopez-Marcano,Andrew D. Olds,Kristin I. Jinks

DOI: https://doi.org/10.3389/fmars.2021.658135

IF: 5.247

2021-10-12

Frontiers in Marine Science

Abstract:The ongoing need to sustainably manage fishery resources can benefit from fishery-independent monitoring of fish stocks. Camera systems, particularly baited remote underwater video system (BRUVS), are a widely used and repeatable method for monitoring relative abundance, required for building stock assessment models. The potential for BRUVS-based monitoring is restricted, however, by the substantial costs of manual data extraction from videos. Computer vision, in particular deep learning (DL) models, are increasingly being used to automatically detect and count fish at low abundances in videos. One of the advantages of BRUVS is that bait attractants help to reliably detect species in relatively short deployments (e.g., 1 h). The high abundances of fish attracted to BRUVS, however, make computer vision more difficult, because fish often obscure other fish. We build upon existing DL methods for identifying and counting a target fisheries species across a wide range of fish abundances. Using BRUVS imagery targeting a recovering fishery species, Australasian snapper ( Chrysophrys auratus ), we tested combinations of three further mathematical steps likely to generate accurate, efficient automation: (1) varying confidence thresholds (CTs), (2) on/off use of sequential non-maximum suppression (Seq-NMS), and (3) statistical correction equations. Output from the DL model was more accurate at low abundances of snapper than at higher abundances (>15 fish per frame) where the model over-predicted counts by as much as 50%. The procedure providing the most accurate counts across all fish abundances, with counts either correct or within 1–2 of manual counts ( R 2 = 88%), used Seq-NMS, a 45% CT, and a cubic polynomial corrective equation. The optimised modelling provides an automated procedure offering an effective and efficient method for accurately identifying and counting snapper in the BRUV footage on which it was tested. Additional evaluation will be required to test and refine the procedure so that automated counts of snapper are accurate in the survey region over time, and to determine the applicability to other regions within the distributional range of this species. For monitoring stocks of fishery species more generally, the specific equations will differ but the procedure demonstrated here could help to increase the usefulness of BRUVS.

marine & freshwater biology
Smart Headset, Computer Vision and Machine Learning for Efficient Prawn Farm Management

Mingze Xi,Ashfaqur Rahman,Chuong Nguyen,Stuart Arnold,John McCulloch

DOI: https://doi.org/10.1016/j.aquaeng.2023.102339

IF: 4

2023-05-04

Aquacultural Engineering

Abstract:Understanding the growth and distribution of the prawns is critical for optimising the feed and harvest strategies. An inadequate understanding of prawn growth can lead to reduced financial gain, for example, crops are harvested too early. The key to maintaining a good understanding of prawn growth is frequent sampling. However, the most commonly adopted sampling practice, the cast net approach, is unable to sample the prawns at a high frequency as it is expensive and laborious. An alternative approach is to sample prawns from feed trays that farm workers inspect each day. This will allow growth data collection at a high frequency (each day). But measuring prawns manually each day is a laborious task. In this article, we propose a new approach that utilises smart glasses, depth camera, computer vision and machine learning to detect prawn distribution and growth from feed trays. A smart headset was built to allow farmers to collect prawn data while performing daily feed tray checks. A computer vision + machine learning pipeline was developed and demonstrated to detect the growth trends of prawns in 4 prawn ponds over a growing season.

fisheries,agricultural engineering
Fish Monitoring from Low-Contrast Underwater Images

Nikos Petrellis,Georgios Keramidas,Christos P. Antonopoulos,Nikolaos Voros

DOI: https://doi.org/10.3390/electronics12153338

IF: 2.9

2023-08-05

Electronics

Abstract:A toolset supporting fish detection, orientation, tracking and especially morphological feature estimation with high speed and accuracy, is presented in this paper. It can be exploited in fish farms to automate everyday procedures including size measurement and optimal harvest time estimation, fish health assessment, quantification of feeding needs, etc. It can also be used in an open sea environment to monitor fish size, behavior and the population of various species. An efficient deep learning technique for fish detection is employed and adapted, while methods for fish tracking are also proposed. The fish orientation is classified in order to apply a shape alignment technique that is based on the Ensemble of Regression Trees machine learning method. Shape alignment allows the estimation of fish dimensions (length, height) and the localization of fish body parts of particular interest such as the eyes and gills. The proposed method can estimate the position of 18 landmarks with an accuracy of about 95% from low-contrast underwater images where the fish can be hardly distinguished from its background. Hardware and software acceleration techniques have been applied at the shape alignment process reducing the frame processing latency to less than 0.5 us on a general purpose computer and less than 16 ms on an embedded platform. As a case study, the developed system has been trained and tested with several Mediterranean fish species in the category of seabream. A large public dataset with low-resolution underwater videos and images has also been developed to test the proposed system under worst case conditions.

engineering, electrical & electronic,computer science, information systems,physics, applied
Accelerating Species Recognition and Labelling of Fish From Underwater Video With Machine-Assisted Deep Learning

Daniel Marrable,Kathryn Barker,Sawitchaya Tippaya,Mathew Wyatt,Scott Bainbridge,Marcus Stowar,Jason Larke

DOI: https://doi.org/10.3389/fmars.2022.944582

IF: 5.247

2022-08-03

Frontiers in Marine Science

Abstract:Machine-assisted object detection and classification of fish species from Baited Remote Underwater Video Station (BRUVS) surveys using deep learning algorithms presents an opportunity for optimising analysis time and rapid reporting of marine ecosystem statuses. Training object detection algorithms for BRUVS analysis presents significant challenges: the model requires training datasets with bounding boxes already applied identifying the location of all fish individuals in a scene, and it requires training datasets identifying species with labels. In both cases, substantial volumes of data are required and this is currently a manual, labour-intensive process, resulting in a paucity of the labelled data currently required for training object detection models for species detection. Here, we present a "machine-assisted" approach for i) a generalised model to automate the application of bounding boxes to any underwater environment containing fish and ii) fish detection and classification to species identification level, up to 12 target species. A catch-all " fish " classification is applied to fish individuals that remain unidentified due to a lack of available training and validation data. Machine-assisted bounding box annotation was shown to detect and label fish on out-of-sample datasets with a recall between 0.70 and 0.89 and automated labelling of 12 targeted species with an F 1 score of 0.79. On average, 12% of fish were given a bounding box with species labels and 88% of fish were located and given a fish label and identified for manual labelling. Taking a combined, machine-assisted approach presents a significant advancement towards the applied use of deep learning for fish species detection in fish analysis and workflows and has potential for future fish ecologist uptake if integrated into video analysis software. Manual labelling and classification effort is still required, and a community effort to address the limitation presented by a severe paucity of training data would improve automation accuracy and encourage increased uptake.

marine & freshwater biology
Detect+Track: Robust and flexible software tools for improved tracking and behavioural analysis of fish

Abhishek Dutta,Natalia Perez-Campanero,Graham K Taylor,Andrew Zisserman,Cait Newport

DOI: https://doi.org/10.1101/2023.04.20.537633

2024-10-01

Abstract:Developments in automated animal behavioural analysis software are increasing the efficiency of data collection and improving the standardization of behavioural measurements. There are now several open-source tools for tracking laboratory animals, but often these are only accurate under limited conditions (e.g. uniform lighting and background, uncluttered scenes, unobstructed focal animal). Tracking fish presents a particular challenge for these tools because movement at the water's surface introduces significant noise. Partial occlusion of the focal animal can also be troublesome, particularly when tracking the whole organism. But identifying the position of an animal is only part of the task -- analysing the movement of the animal relative to their environment and experimental context is often what provides information about their behaviour. Therefore, the automated detection of physical objects and boundaries would also be beneficial, but this feature is not commonly incorporated into existing tracking software. Here we describe a video processing method that uses a range of computer vision algorithms (e.g. object detector and tracker, optical flow, parallel plane homology) and computational geometry techniques (e.g. Voronoi tessellation) to analyse the movement behaviour of fish in response to experimental stimuli. A behavioural experiment, which involved tracking a fish's trajectory through a field of obstacles, motivated our development of a set of tools that: (1) measure an animal's trajectory, (2) record obstacle position, and (3) detect when the fish passed through 'virtual gates' between adjacent obstacles and/or the aquarium wall. We have introduced a novel Detect+Track approach that significantly enhances the accuracy and robustness of animal tracking, overcoming some of the limitations of existing tools and providing a more reliable solution for complex experimental conditions. Our workflow is divided into several discrete steps, and provides a set of modular software building blocks that can be adapted to analyse other experimental designs. A detailed tutorial is provided, together with all the data and code required to reproduce our results.

Animal Behavior and Cognition
Computer vision in aquaculture: a case study of juvenile fish counting

Krishna Moorthy Babu,Daniel Bentall,David T Ashton,Morgan Puklowski,Warren Fantham,Harris T Lin,Nicholas P L Tuckey,Maren Wellenreuther,Linley K Jesson

DOI: https://doi.org/10.1080/03036758.2022.2101484

2022-08-03

Abstract:In aquaculture breeding or production programmes, counting juvenile fish represents a considerable cost in terms of the human hours needed. In this study, we explored the use of two state-of-the-art machine learning architectures (Single Shot Detection, hereafter SSD and Faster Regions with convolutional neural networks, hereafter Faster R-CNN) to augment a manual image-based juvenile fish counting method for the Australasian snapper (Chrysophrys auratus) bred at The New Zealand Institute for Plant and Food Research Limited. We tested model accuracy after tuning for confidence thresholds and non-maximal suppression overlap parameters, and implementing a bias correction using a Poisson regression model. Validation of image data showed that after tuning, bias-corrected SSD and Faster R-CNN models had mean absolute percent errors (MAPE) of less than 10%, with SSD having MAPE of less than 5%. Comparison of the results with those from manual counts showed that, while manual counts are slightly more accurate (MAPE = 1.56), the machine learning methods allow for more rapid assessment of counts and thus facilitating a higher throughput. This work represents a first step for deploying machine learning applications to an existing real-life aquaculture scenario and provides a useful starting point for further developments, such as real-time counting of fish or collecting additional phenotypic data from the source images.
Automated detection of feeding strikes by larval fish using continuous high-speed digital video: a novel method to extract quantitative data from fast, sparse kinematic events

Eyal Shamur,Miri Zilka,Tal Hassner,Victor China,Alex Liberzon,Roi Holzman

DOI: https://doi.org/10.1242/jeb.133751

IF: 3.308

2016-01-01

Journal of Experimental Biology

Abstract:Using videography to extract quantitative data on animal movement and kinematics constitutes a major tool in biomechanics and behavioral ecology. Advanced recording technologies now enable acquisition of long video sequences encompassing sparse and unpredictable events. While such events may be ecologically important, analysis of sparse data can be extremely time-consuming and potentially biased; data quality is often strongly dependent on the training level of the observer and subject to contamination by observer dependent biases. These constraints often limit our ability to study animal performance and fitness. Using long videos of foraging fish larvae, we provide a framework for the automated detection of prey acquisition strikes, a behavior that is infrequent yet critical for larval survival. We compared the performance of four video descriptors and their combinations against manually identified feeding events. For our data, the best single descriptor provided a classification accuracy of 77-95% and detection accuracy of 88-98%, depending on fish species and size. Using a combination of descriptors improved the accuracy of classification by ∼2%, but did not improve detection accuracy. Our results indicate that the effort required by an expert to manually label videos can be greatly reduced to examining only the potential feeding detections in order to filter false detections. Thus, using automated descriptors reduce the amount of manual work needed to identify events of interest from weeks to hours, enabling the assembly of an unbiased large dataset of ecologically relevant behaviors.

biology
Automatic detection of fish and tracking of movement for ecology

Sebastian Lopez‐Marcano,Eric Jinks,Christina A. Buelow,Christopher J. Brown,Dadong Wang,Branislav Kusy,Ellen Ditria,Rod M. Connolly

DOI: https://doi.org/10.1002/ece3.7656

IF: 3.167

2021-05-18

Ecology and Evolution

Abstract:Animal movement studies are conducted to monitor ecosystem health, understand ecological dynamics, and address management and conservation questions. In marine environments, traditional sampling and monitoring methods to measure animal movement are invasive, labor intensive, costly, and limited in the number of individuals that can be feasibly tracked. Automated detection and tracking of small‐scale movements of many animals through cameras are possible but are largely untested in field conditions, hampering applications to ecological questions.Here, we aimed to test the ability of an automated object detection and object tracking pipeline to track small‐scale movement of many individuals in videos. We applied the pipeline to track fish movement in the field and characterize movement behavior. We automated the detection of a common fisheries species (yellowfin bream, Acanthopagrus australis) along a known movement passageway from underwater videos. We then tracked fish movement with three types of tracking algorithms (MOSSE, Seq‐NMS, and SiamMask) and evaluated their accuracy at characterizing movement. We successfully detected yellowfin bream in a multispecies assemblage (F1 score =91%). At least 120 of the 169 individual bream present in videos were correctly identified and tracked. The accuracies among the three tracking architectures varied, with MOSSE and SiamMask achieving an accuracy of 78% and Seq‐NMS 84%.By employing this integrated object detection and tracking pipeline, we demonstrated a noninvasive and reliable approach to studying fish behavior by tracking their movement under field conditions. These cost‐effective technologies provide a means for future studies to scale‐up the analysis of movement across many visual monitoring systems.

ecology,evolutionary biology
Detection of Critical Parts of River Crab Based on Lightweight YOLOv7-SPSD

Guoai Fang,Yu Zhao

DOI: https://doi.org/10.3390/s24237593

IF: 3.9

2024-11-29

Sensors

Abstract:The removal of back armor marks the first stage in the comprehensive processing of river crabs. However, the current low level of mechanization undermines the effectiveness of this process. By integrating robotic systems with image recognition technology, the efficient removal of dorsal armor from river crabs is anticipated. This approach relies on the rapid identification and precise positioning of the processing location at the crab's tail, both of which are essential for optimal results. In this paper, we propose a lightweight deep learning model called YOLOv7-SPSD for detecting river crab tails. The goal is to accurately determine the processing location for the robotic removal of river crab back armor. We start by constructing a crab tail dataset and completing the data labeling process. To enhance the lightweight nature of the YOLOv7-tiny model, we incorporate the Slimneck module, PConv, and the SimAM attention mechanism. These additions help achieve an initial reduction in model size while preserving detection accuracy. Furthermore, we optimize the model by removing redundant parameters using the DepGraph pruning algorithm, which facilitates its application on edge devices. Experimental results show that the lightweight YOLOv7-SPSD model achieves a mean Average Precision (mAP) of 99.6% at a threshold of 0.5, an F1-score of 99.6%, and processes frames at a rate of 7.1 frames per second (FPS) on a CPU. Compared to YOLOv7-tiny, the improved model increases FPS by 2.7, reduces GFLOPS by 74.6%, decreases the number of parameters by 71.6%, and lowers its size by 8.1 MB. This study enhances the deployment of models in river crab processing equipment and introduces innovative concepts and methodologies for advancing intelligent river crab deep processing technology.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Automated Detection, Classification and Counting of Fish in Fish Passages With Deep Learning

Vishnu Kandimalla,Matt Richard,Frank Smith,Jean Quirion,Luis Torgo,Chris Whidden

DOI: https://doi.org/10.3389/fmars.2021.823173

IF: 5.247

2022-01-13

Frontiers in Marine Science

Abstract:The Ocean Aware project, led by Innovasea and funded through Canada's Ocean Supercluster, is developing a fish passage observation platform to monitor fish without the use of traditional tags. This will provide an alternative to standard tracking technology, such as acoustic telemetry fish tracking, which are often not appropriate for tracking at-risk fish species protected by legislation. Rather, the observation platform uses a combination of sensors including acoustic devices, visual and active sonar, and optical cameras. This will enable more in-depth scientific research and better support regulatory monitoring of at-risk fish species in fish passages or marine energy sites. Analysis of this data will require a robust and accurate method to automatically detect fish, count fish, and classify them by species in real-time using both sonar and optical cameras. To meet this need, we developed and tested an automated real-time deep learning framework combining state of the art convolutional neural networks and Kalman filters. First, we showed that an adaptation of the widely used YOLO machine learning model can accurately detect and classify eight species of fish from a public high resolution DIDSON imaging sonar dataset captured from the Ocqueoc River in Michigan, USA. Although there has been extensive research in the literature identifying particular fish such as eel vs. non-eel and seal vs. fish, to our knowledge this is the first successful application of deep learning for classifying multiple fish species with high resolution imaging sonar. Second, we integrated the Norfair object tracking framework to track and count fish using a public video dataset captured by optical cameras from the Wells Dam fish ladder on the Columbia River in Washington State, USA. Our results demonstrate that deep learning models can indeed be used to detect, classify species, and track fish using both high resolution imaging sonar and underwater video from a fish ladder. This work is a first step toward developing a fully implemented system which can accurately detect, classify and generate insights about fish in a wide variety of fish passage environments and conditions with data collected from multiple types of sensors.

marine & freshwater biology
Coastal Fisheries Resource Monitoring Through A Deep Learning-Based Underwater Video Analysis

Dian Zhang,Noel E. O'Conner,Andre J. Simpson,Chunjie Cao,Suzanne Little,Bing Wu

DOI: https://doi.org/10.1016/j.ecss.2022.107815

IF: 3.229

2022-01-01

Estuarine Coastal and Shelf Science

Abstract:Unlike land, the oceans, although covering more than 70% of the planet, are largely unexplored. Global fisheries resources are central to the sustainability and quality of life on earth but are under threat from climate change, ocean acidification and over consumption. One way to analyze these marine resource is through remote underwater surveying. However, the sheer volume of recorded data often make classification and analyses difficult, time consuming and resource intensive. Recent developments in machine learning (ML) have shown promising application in extracting high level context with near human performance on image classification tasks. The application of ML in remote underwater surveying can drastically reduce the processing time of these datasets. In order to train these deep neural networks used in ML, it is necessary to create a series of large-scale benchmark datasets to test any proposed algorithm for this kind of specific imaging classification. Currently, none of the publicly available datasets in the marine vision research domain have sufficiently large data volumes to reliably train a deep model. In this work, a publicly available large-scale benchmark underwater video dataset is created and used to retrain a state-of-the-art machine vision deep model (MaskRCNN). This model is in turn applied into detecting and classifying underwater marine lives through random under-sampling (RUS), and achieves a reasonably high average precision (0.628 mAP), indicating great applicability of this dataset in training instance segmentation deep neural network for detecting underwater marine species.
Automating the analysis of fish grazing behaviour from videos using image classification and optical flow

Ellen M. Ditria,Eric L. Jinks,Rod M. Connolly

DOI: https://doi.org/10.1016/j.anbehav.2021.04.018

IF: 3.041

2021-07-01

Animal Behaviour

Abstract:<p>Studying and quantifying behaviour is important to understand how animals interact with their environments. However, manually extracting and analysing behavioural data from the large volume of camera footage collected is often time consuming. Deep learning techniques have emerged as useful tools in automating the analysis of certain behaviours under controlled or laboratory conditions, but the complexities of using raw footage from the field has resulted in this technology remaining largely unexplored as a possible data analysis alternative for animals in situ. Here, we use deep learning techniques to automate the analysis of fish grazing behaviour from real-world field imagery. We collected video footage in sea grass meadows in Queensland, Australia, and trained models on a training data set of over 3000 annotations. We used a combination of dense optical flow to assess pixel movement in underwater footage, spatiotemporal filtering to increase accuracy, and deep learning algorithms to classify grazing behaviour of luderick, <em>Girella tricuspidata</em>. When tested on novel videos the model had not seen in training, the model correctly identified nearly all individual grazing events. Deep learning shows promise as a viable tool for determining animal behaviour from underwater videos, and with further development offers an alternative to current time-consuming manual methods of data extraction.</p>

zoology,behavioral sciences

[The neurochemical bases of psychopharmacology].

An Open-Source Platform For Underwater Image And Video Analytics

Online Fish Tracking with Portable Smart Device for Ocean Observatory Network

Multi-detector and Motion Prediction-Based High-Speed Non-Intrusive Fingerling Counting Method

A Kinematic Analysis-Based On-Line Fingerlings Counting Method Using Low-Frame-rate Camera

Tracking Fish Abundance by Underwater Image Recognition

Edge computing based real-time Nephrops (Nephrops norvegicus) catch estimation in demersal trawls using object detection models

Computer vision system to count crustacean larvae

A Deep-Learning Based Pipeline for Estimating the Abundance and Size of Aquatic Organisms in an Unconstrained Underwater Environment from Continuously Captured Stereo Video

Improved Accuracy for Automated Counting of a Fish in Baited Underwater Videos for Stock Assessment

Smart Headset, Computer Vision and Machine Learning for Efficient Prawn Farm Management

Fish Monitoring from Low-Contrast Underwater Images

Accelerating Species Recognition and Labelling of Fish From Underwater Video With Machine-Assisted Deep Learning

Detect+Track: Robust and flexible software tools for improved tracking and behavioural analysis of fish

Computer vision in aquaculture: a case study of juvenile fish counting

Automated detection of feeding strikes by larval fish using continuous high-speed digital video: a novel method to extract quantitative data from fast, sparse kinematic events

Automatic detection of fish and tracking of movement for ecology

Detection of Critical Parts of River Crab Based on Lightweight YOLOv7-SPSD

Automated Detection, Classification and Counting of Fish in Fish Passages With Deep Learning

Coastal Fisheries Resource Monitoring Through A Deep Learning-Based Underwater Video Analysis

Automating the analysis of fish grazing behaviour from videos using image classification and optical flow