PhysWM: Physical World Models for Robot Learning
Date Issued
2023
Abstract
Within the last decade machine learning methods have shown remarkable results in pattern recognition tasks and behavior learning. However, when applied to real-world robotics tasks, these approaches have limitations, such as sample inefficiency and limited generalization to out-of-distribution samples. Despite the availability of precise physics in simulation engines, model-based reinforcement learning (RL) resorts to learning an approximation of these dynamics. On the other hand, optimal control approaches often assume a static, complete model of the world, addressing the simulation-reality gap by adding low level controllers. In order to handle these issues, we propose a hybrid simulator consisting of differentiable physics and rendering modules, which employ symbolic representations and reduce the model complexity of neural policies, while retaining gradient computation for model and behavior optimization. Moreover, this reduced parametric representation enables the use of Bayesian inference to estimate the uncertainty over physical parameters. This uncertainty quantification allows us to generate a curriculum of exploration behaviors for continuously improving the world model.
Subjects
differentiable physics
;
neural networks
;
uncertainty quantification
;
robot learning
Publisher
RWTH Aachen
Institution
Type
conference paper
Journal/Edited collection
NeSy 2023: Neural-Symbolic Learning and Reasoning 2023 = CEUR Workshop Proceedings, Band 3432
Page number
11
Secondary publication
Yes
Document version
Published Version
Language
English
File(s)![Thumbnail Image]()
Loading...
Name
Otto et al_PhysWM_2023_published-version.pdf
Size
2.66 MB
Format
Adobe PDF
Checksum
(MD5):8347eb53ed1f8f4f6673c9ce09201aa2