COLA: Learning Human-Humanoid Coordination for Collaborative Object Carrying

Yushi Du1,2*, Yixuan Li2,3*, Baoxiong Jia2*✉️, Yutang Lin2,4, Pei Zhou1,
Wei Liang3✉️ Yanchao Yang1✉️ Siyuan Huang2✉️
1Department of Electrical and Electronic Engineering, The University of Hong Kong
2State Key Laboratory of General Artificial Intelligence, BIGAI
3School of Computer Science and Technology, Beijing Institute of Technology
4Yuanpei College, Peking University

*indicates equal contributions ✉️indicates corresponding author
COLA provides a proprioception-only policy that enables compliant human-humanoid collaboration for carrying diverse objects across various movement patterns.

Highlights

We present COLA, a proprioception-only reinforcement learning approach that unifies leader and follower behaviors within a single policy. Trained in a closed-loop environment modeling dynamic interactions among humanoid, object, and human, COLA implicitly predicts object motion to enable compliant collaboration and maintain load balance. Experiments in both simulation and real-world scenarios demonstrate effective collaborative carrying across diverse objects and conditions, highlighting COLA’s practical value for human–robot object transportation.

Deployment

Following human pushing/pulling commands to carry heavy packs.
Collaborative carrying with human.
Height tracking with human.
Long horizon test with total moving length of 102.4 meters.
Carrying rod with human.
Pushing cart with human.

Pipeline

image

Our Policy mainly consists of three steps: (i) We train a base whole-body control policy to provide a robust whole-body controller. (ii) In the closed-loop training environment, we train a residual teacher policy on top of the whole-body control policy with privileged information for human-humanoid collaboration. (iii) We distill the knowledge from the teacher policy into a student policy for real-world deployment using behavioral cloning.

Citation

@article{du2025learning,
  title={Learning Human-Humanoid Coordination for Collaborative Object Carrying},
  author={Yushi Du and Yixuan Li and Baoxiong Jia and Yutang Lin and Pei Zhou and Wei Liang and Yanchao Yang and Siyuan Huang},
  journal={arXiv preprint arXiv:2510.14293},
  year={2025}
}

Acknowledgements

📽️ More video demonstrations are coming!
🙏 We are especially grateful to Yuhan Li, Peiyuan Zhi, Le Ma, Peiyang Li for their invaluable help and support during the filming of our demonstration video.