Abstract:This paper studies fish growth trajectory tracking using Q-learning under a representative bioenergetic growth model of Nile tilapia (Oreochromis niloticus). The fish growth rate varies in practice and cannot be easily estimated due to the complex aquaculture condition and variable environmental factors. Additionally, the growth trajectory tracking problem is challenging to solve by most of the model-based control approaches due to the nonlinear couplings and interactions between multi-inputs such as temperature, dissolved oxygen, un-ionized ammonia, and the model uncertainty of the fish growth system. We formulate the growth trajectory tracking problem as sampled-data optimal control using discrete state-action pairs Markov decision process on the simulated growth trajectories data to mimic the real aquaculture environment adequately. We propose two Q-learning algorithms that learn the optimal control policy from the simulated data of the fish growth trajectories beginning from the juvenile stage until the desired market weight in the aquaculture environment. The first Q-learning scheme learns the optimal feeding control policy to fish growth rate cultured in cages, while the second one online updates the optimal feeding control policy within an optimal temperature profile for the aquaculture fish growth rate in tanks. The simulation results demonstrate that both Q-learning control strategies achieve good trajectory tracking performance with lower feeding rates and help compensate for the environmental changes of the manipulated variables and the bioenergetic model uncertainties of fish growth in the aquaculture environment. The proposed Q-learning control policies achieve 1.7% and 6.6% relative trajectory tracking errors of the average total weight of fish from both tanks on land and floating cages, respectively. Furthermore, the feeding and temperature control policies reduce 11% relative feeding quantity of the food waste in tanks on land compared to the floating cages where the water temperature is maintained at the ambient temperature of 29.7°C.

Fish Growth Trajectory Tracking via Reinforcement Learning in Precision Aquaculture

Fish growth trajectory tracking using Q-learning in precision aquaculture

Model-based versus model-free feeding control and water quality monitoring for fish growth tracking in aquaculture systems

An Equilibrium-Based Learning Approach with Application to Robotic Fish

Feeding control and water quality monitoring in aquaculture systems: Opportunities and challenges

Precise Speed Tracking Control of a Robotic Fish Via Iterative Learning Control

Speed Trajectory Tracking Of A Robotic Fish Based On Iterative Learning Control Approach

A Data-Driven Motion Control Approach for a Robotic Fish

Model predictive control paradigms for fish growth reference tracking in precision aquaculture

Motion Control of a Multi-Joint Robotic Fish Based on Biomimetic Learning

A Motion Control Approach for a Robotic Fish with Iterative Feedback Tuning

Motion control of a robotic fish via learning control approach with self-adaption

Deep reinforcement learning for forecasting fish survival in open aquaculture ecosystem

LQR Control and Optimization for Trajectory Tracking of Biomimetic Robotic Fish Based on Unreal Engine

Cooperative Control for Trajectory Tracking of Robotic Fish

Design of Deep Reinforcement Learning Controller Through Data-assisted Model for Robotic Fish Speed Tracking

Trajectory Tracking and Obstacle Avoidance of Robotic Fish Based on Nonlinear Model Predictive Control

Fish Trajectory Extraction Based on Object Detection

Underwater Target Tracking Control of an Untethered Robotic Fish With a Camera Stabilizer

Towards Precision Feeding Using Behavioral Monitoring in Marine Cages

Trajectory Tracking Control of Rowing Pectoral Fin-Actuated Robotic Fish