Abstract:The past decade has witnessed the rapid development and adoption of ML & DL methodologies in agricultural systems, showcased by great successes in agricultural applications. However, these conventional ML/DL models have certain limitations: they heavily rely on large, costly-to-acquire labeled datasets for training, require specialized expertise for development and maintenance, and are mostly tailored for specific tasks, thus lacking generalizability. Recently, large pre-trained models, also known as FMs, have demonstrated remarkable successes in language, vision, and decision-making tasks across various domains. These models are trained on a large amount of data from multiple domains and modalities. Once trained, they can accomplish versatile tasks with just minor fine-tuning and minimal task-specific labeled data. Despite their proven effectiveness and huge potential, there has been little exploration of applying FMs to agriculture AI. Thus, this study aims to explore the potential of FMs in the field of smart agriculture. In particular, conceptual tools and technical background are presented to help the understanding of the problem space and uncover new research directions. To this end, recent FMs in the general CS domain are reviewed, and the models are categorized into four categories: language FMs, vision FMs, multimodal FMs, and reinforcement learning FMs. Then, the steps of developing agriculture FMs (AFMs) are outlined and potential applications in smart agriculture are discussed. Moreover, challenges and risks associated with developing AFMs are discussed, including model training, validation, and deployment. In summary, the advancement of AI in agriculture is explored by introducing AFMs as a promising paradigm that can significantly mitigate the reliance on extensive labeled datasets and enhance the efficiency, effectiveness, and generalization of agricultural AI systems.

An Intelligent Industrial Visual Monitoring and Maintenance Framework Empowered by Large-Scale Visual and Language Models

Large-Scale Visual Language Model Boosted by Contrast Domain Adaptation for Intelligent Industrial Visual Monitoring

Large Language Model Empowered by Domain-Specific Knowledge Base for Industrial Equipment Operation and Maintenance

A Unified Industrial Large Knowledge Model Framework in Industry 4.0 and Smart Manufacturing

Applying Large Language Models for Intelligent Industrial Automation

Myriad: Large Multimodal Model by Applying Vision Experts for Industrial Anomaly Detection

Control Industrial Automation System with Large Language Models

Industrial Language-Image Dataset (ILID): Adapting Vision Foundation Models for Industrial Settings

IDA-VLM: Towards Movie Understanding via ID-Aware Large Vision-Language Model

Insights into the Development Trends of Industrial Large Language Models

VSLLaVA: a pipeline of large multimodal foundation model for industrial vibration signal analysis

Exploring Large Vision-Language Models for Robust and Efficient Industrial Anomaly Detection

Enhancing machine vision: the impact of a novel innovative technology on video question-answering

Effectiveness Assessment of Recent Large Vision-Language Models

AVIS: Autonomous Visual Information Seeking with Large Language Model Agent

Emerging Practices for Large Multimodal Model (LMM) Assistance for People with Visual Impairments: Implications for Design

VMAD: Visual-enhanced Multimodal Large Language Model for Zero-Shot Anomaly Detection

Large Language Models and Foundation Models in Smart Agriculture: Basics, Opportunities, and Challenges

Human-artificial intelligence teaming for scientific information extraction from data-driven additive manufacturing research using large language models

VIALM: A Survey and Benchmark of Visually Impaired Assistance with Large Models