Abstract:Multiphysics phenomena, the coupling effects involving different aspects of physics laws, are pervasive in the real world and can often be encountered when performing everyday household tasks. Intelligent agents which seek to assist or replace human laborers will need to learn to cope with such phenomena in household task settings. To equip the agents with such kind of abilities, the research community needs a simulation environment, which will have the capability to serve as the testbed for the training process of these intelligent agents, to have the ability to support multiphysics coupling effects. Though many mature simulation software for multiphysics simulation have been adopted in industrial production, such techniques have not been applied to robot learning or embodied AI research. To bridge the gap, we propose a novel simulation environment named RFUniverse. This simulator can not only compute rigid and multi-body dynamics, but also multiphysics coupling effects commonly observed in daily life, such as air-solid interaction, fluid-solid interaction, and heat transfer. Because of the unique multiphysics capacities of this simulator, we can benchmark tasks that involve complex dynamics due to multiphysics coupling effects in a simulation environment before deploying to the real world. RFUniverse provides multiple interfaces to let the users interact with the virtual world in various ways, which is helpful and essential for learning, planning, and control. We benchmark three tasks with reinforcement learning, including food cutting, water pushing, and towel catching. We also evaluate butter pushing with a classic planning-control paradigm. This simulator offers an enhancement of physics simulation in terms of the computation of multiphysics coupling effects.

Demonstrating RFUniverse: A Multiphysics Simulation Platform for Embodied AI.

RFUniverse: A Multiphysics Simulation Platform for Embodied AI

RFUniverse: A Physics-based Action-centric Interactive Environment for Everyday Household Tasks

HumRoboSim: an Autonomous Humanoid Robot Simulation System

HUBOT--A Modeling and Simulation Platform Based on PhysX for Multi-link Robot

A Scalable HPC-Based Domain Decomposition Method for Multiphysics Modeling of RF Devices

FastSim: A Modular and Plug-and-Play Simulator for Aerial Robots

An Efficient Domain Decomposition Method in Multi-physics Simulation of Package Systems

Multiphysics Computing of Challenging Antenna Arrays under a Supercomputer Framework

Parallel Multiphysics Simulation for Characterizing Performance Degradation of RF Components

VirtualOffshore: an Interactive 3D Offshore Environment for Embodied Agents

Heter-Sim: Heterogeneous Multi-Agent Systems Simulation by Interactive Data-Driven Optimization

InfiniteWorld: A Unified Scalable Simulation Framework for General Visual-Language Robot Interaction

Multi-physics simulations using a hierarchical interchangeable software interface

ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation

Research of Virtual Testing Systems in Multi-physics Coupling Conditions

U2USim - A UAV Telepresence Simulation Platform with Multi-agent Sensing and Dynamic Environment

Physical Simulation for Multi-agent Multi-machine Tending

Compositional Generative Multiphysics and Multi-component Simulation

BestMan: A Modular Mobile Manipulator Platform for Embodied AI with Unified Simulation-Hardware APIs

Embedded IPC: Fast and Intersection-free Simulation in Reduced Subspace for Robot Manipulation