Abstract:Learning from Demonstration (LfD) constitutes one of the most robust methodologies for constructing efficient cognitive robotic systems. Despite the large body of research works already reported, current key technological challenges include those of multi-agent learning and long-term autonomy. Towards this direction, a novel cognitive architecture for multi-agent LfD robotic learning is introduced in this paper, targeting to enable the reliable deployment of open, scalable and expandable robotic systems in large-scale and complex environments. In particular, the designed architecture capitalizes on the recent advances in the Artificial Intelligence (AI) (and especially the Deep Learning (DL)) field, by establishing a Federated Learning (FL)-based framework for incarnating a multi-human multi-robot collaborative learning environment. The fundamental conceptualization relies on employing multiple AI-empowered cognitive processes (implementing various robotic tasks) that operate at the edge nodes of a network of robotic platforms, while global AI models (underpinning the aforementioned robotic tasks) are collectively created and shared among the network, by elegantly combining information from a large number of human-robot interaction instances. Regarding pivotal novelties, the designed cognitive architecture a) introduces a new FL-based formalism that extends the conventional LfD learning paradigm to support large-scale multi-agent operational settings, b) elaborates previous FL-based self-learning robotic schemes so as to incorporate the human in the learning loop and c) consolidates the fundamental principles of FL with additional sophisticated AI-enabled learning methodologies for modelling the multi-level inter-dependencies among the robotic tasks. The applicability of the proposed framework is explained using an example of a real-world industrial case study (subject to ongoing research activities) for agile production-based Critical Raw Materials (CRM) recovery.

LADICA: A Large Shared Display Interface for Generative AI Cognitive Assistance in Co-Located Team Collaboration

LLM enabled generative collaborative design in a mixed reality environment

LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning

Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation

GraphiMind: LLM-centric Interface for Information Graphics Design

VizGroup: An AI-Assisted Event-Driven System for Real-Time Collaborative Programming Learning Analytics

Large Language Models Meet User Interfaces: The Case of Provisioning Feedback

DesignMinds: Enhancing Video-Based Design Ideation with Vision-Language Model and Context-Injected Large Language Model

A large display-based approach supporting natural user interaction in virtual reality environment

LayoutCopilot: An LLM-powered Multi-agent Collaborative Framework for Interactive Analog Layout Design

LLaVA-Interactive: An All-in-One Demo for Image Chat, Segmentation, Generation and Editing

Large Language Model Agents Enabled Generative Design of Fluidic Computation Interfaces

Low-code LLM: Graphical User Interface over Large Language Models

Leveraging Large Language Models for Collective Decision-Making

Mindalogue: LLM-Powered Nonlinear Interaction for Effective Learning and Task Exploration

Collaboration with Generative Artificial Intelligence: An Exploratory Study Based on Learning Analytics

Utilizing Interactive Surfaces to Enhance Learning, Collaboration and Engagement: Insights from Learners' Gaze and Speech

Enabling Generative Design Tools with LLM Agents for Mechanical Computation Devices: A Case Study

Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement

Towards Open and Expandable Cognitive AI Architectures for Large-Scale Multi-Agent Human-Robot Collaborative Learning

Making Large Language Models Interactive: A Pioneer Study on Supporting Complex Information-Seeking Tasks with Implicit Constraints