Abstract

Reinforcement learning (RL) has made significant progress in various domains,but scaling it to long-horizon tasks with complex decision-making remainschallenging. Skill learning attempts to address this by abstracting actionsinto higher-level behaviors. However, current approaches often fail torecognize semantically similar behaviors as the same skill and use fixed skilllengths, limiting flexibility and generalization. To address this, we proposeDynamic Contrastive Skill Learning (DCSL), a novel framework that redefinesskill representation and learning. DCSL introduces three key ideas:state-transition based skill representation, skill similarity functionlearning, and dynamic skill length adjustment. By focusing on state transitionsand leveraging contrastive learning, DCSL effectively captures the semanticcontext of behaviors and adapts skill lengths to match the appropriate temporalextent of behaviors. Our approach enables more flexible and adaptive skillextraction, particularly in complex or noisy datasets, and demonstratescompetitive performance compared to existing methods in task completion andefficiency.