Abstract:Cyber-physical systems (CPS), in most instances, represent systems of systems with an informationally decentralized structure such as emerging mobility systems, networked control systems, sustainable manufacturing, smart power grids, power systems, mobility markets, social media platforms, cooperation of robots, and internet of things. To optimize the operation of such systems, we typically assume an ideal model. Such model-based control approaches cannot effectively facilitate optimal solutions with performance guarantees due to the discrepancy between the model and the actual CPS. On the other hand, in most CPS there is a large volume of data with a dynamic nature which is added to the system gradually in real time and not altogether in advance. Thus, traditional supervised learning approaches cannot always facilitate robust solutions using data derived offline. By contrast, applying reinforcement learning approaches directly to the actual CPS might impose significant implications on the safety and robust operation of the system. The overarching goal of the Information and Decision Science (IDS) Lab is to investigate how to circumvent these challenges by developing data-driven system approaches at the intersection of learning and control. The emphasis is on how to improve energy efficiency and reduce greenhouse gas emissions in applications related to emerging mobility systems, e.g., connected and automated vehicles (CAVs), shared mobility, sociotechnical systems, and smart cities, and thus contribute to the health of the planet.

Reinforcement Learning Architecture for Cyber–physical–social AI: State-of-the-art and Perspectives

Robot Simulation and Reinforcement Learning Training Platform Based on Distributed Architecture.

Representation Learning for Knowledge Fusion and Reasoning in Cyber-Physical-Social Systems: Survey and Perspectives

Perception-enhancement Based Task Learning and Action Scheduling for Robotic Limb in CPS Environment

Review of Cyber-Physical System Architecture.

Toward a Psychology of Deep Reinforcement Learning Agents Using a Cognitive Architecture

Smart Resource Allocation Using Reinforcement Learning in Content-Centric Cyber-Physical Systems.

Building Trust in AI-Driven Decision Making for Cyber-Physical Systems (CPS): A Comprehensive Review

Security Analysis of Cyber-Physical Systems Using Reinforcement Learning

Combining Learning and Control for Data-driven Approaches of Cyber-Physical Systems

A Design Trajectory Map of Human-AI Collaborative Reinforcement Learning Systems: Survey and Taxonomy

When Cyber-Physical Systems Meet AI: A Benchmark, an Evaluation, and a Way Forward

Cyber-Physical-Social Systems: A State-of-the-Art Survey, Challenges and Opportunities

Safe Reinforcement Learning for CPSs via Formal Modeling and Verification

Research on architecture for cyber-physical systems based on multi-view

Cyber-physical System Architecture Design

Weakness Analysis of Cyberspace Configuration Based on Reinforcement Learning

Reinforcement Learning Within the Classical Robotics Stack: A Case Study in Robot Soccer

Deep Reinforcement Learning for Cyber Security

Discover the Hidden Attack Path in Multi-domain Cyberspace Based on Reinforcement Learning