Abstract

Diffusion models have recently gained popularity for policy learning inrobotics due to their ability to capture high-dimensional and multimodaldistributions. However, diffusion policies are inherently stochastic andtypically trained offline, limiting their ability to handle unseen and dynamicconditions where novel constraints not represented in the training data must besatisfied. To overcome this limitation, we propose diffusion predictive controlwith constraints (DPCC), an algorithm for diffusion-based control with explicitstate and action constraints that can deviate from those in the training data.DPCC uses constraint tightening and incorporates model-based projections intothe denoising process of a trained trajectory diffusion model. This allows usto generate constraint-satisfying, dynamically feasible, and goal-reachingtrajectories for predictive control. We show through simulations of a robotmanipulator that DPCC outperforms existing methods in satisfying noveltest-time constraints while maintaining performance on the learned controltask.