Sirui Xu  
(徐思睿)

Ph.D. @ UIUC

prof_pic.jpg

I am a third-year Ph.D. student in Computer Science at the University of Illinois Urbana-Champaign, advised by Prof. Yuxiong Wang and Prof. Liangyan Gui. Prior to this, I earned my M.S. from University of Illinois Urbana-Champaign and my B.S. from Peking University.

I explore how humans move and how machines can learn to move like us, building models that capture human-like behavior and bring it to life with physical dexterity, agility, and even abilities beyond our own. My focus spans kinematic motion modeling, physics-based animation, and robotic control, with a special interest in human interaction and humanoid loco-manipulation in both simulation and the real world.

I am always opened for discussion and collaboration, drop me an email if you are interested.

News

Aug 2, 2025 One paper accepted at CoRL 2025 and another at TMLR 2025 (details to be announced).
Jun 13, 2025 Invited talk at the Agents in Interaction Workshop, CVPR 2025.
Jun 12, 2025 InterMimic won the Best Presentation Award at the Humanoid Agents Workshop, CVPR 2025
Apr 20, 2025 InterAct is initially released and will be actively maintained and updated. Try using it to scale up your HOI behavior model.
Apr 4, 2025 InterMimic has been selected as a CVPR Highlight Paper.
Mar 25, 2025 The code for InterMimic is initially released in this repo.
Mar 19, 2025 Invited talk at the University of British Columbia and Northeastern University on scalable, physics-driven generation of human-object interactions.
Feb 26, 2025 InterMimic and InterAct have been accepted at CVPR 2025.
Jan 22, 2025 DICE has been accepted at ICLR 2025.
Sep 26, 2024 Our paper, InterDreamer has been accepted at NeurIPS 2024.
Mar 29, 2024 Passed my qualifying exam. I am a whole PhD candidate now!
Mar 28, 2024 Our paper “InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction” is posted on arXiv. Check our project page.
Jan 10, 2024 I will be joining the NVIDIA Seattle Robotics Lab as a PhD research intern in Summer 2024.
Sep 30, 2023 I will be attending ICCV 2023 in person to present our work “InterDiff”. Feel free to come by our poster session at Room “Foyer Sud” 089.
Jul 13, 2023 Our work “InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusion” is accepted at ICCV 2023.
May 24, 2023 Invited talk at Electronic Arts on diverse human motion generation.
Apr 15, 2023 I will be starting my Ph.D. at UIUC (after finishing my MS here).
Jan 20, 2023 Our paper “Stochastic Multi-Person 3D Motion Forecasting” got accepted as a notable-top-25%(spotlight) paper at ICLR 2023.
Jul 8, 2022 Our paper “Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchors” was accepted to ECCV 2022 for an oral presentation. Check our project page for code and documentation.
Mar 15, 2021 I will become a M.S. student at UIUC this fall.

Selected Publications

  1. Dexplore: Scalable Neural Control for Dexterous Manipulation from Reference-Scoped Exploration
    Sirui XuYu-Wei ChaoLiuyu BianArsalan Mousavian, and 3 more authors
    CoRL 2025
  2. 🏆 Highlight
    InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactions
    CVPR 2025
    Best Presentation Award @ Humanoid Agents Workshop, CVPR 2025
  3. InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation
    Sirui XuDongting LiYucheng ZhangXiyan Xu, and 8 more authors
    CVPR 2025
  4. InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction
    Sirui XuZiyin WangYu-Xiong Wang, and Liang-Yan Gui
    NeurIPS 2024
  5. InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusion
    ICCV 2023
  6. 🏆 Spotlight
    Stochastic Multi-Person 3D Motion Forecasting
    Sirui XuYu-Xiong Wang, and Liang-Yan Gui
    ICLR 2023
  7. 🏆 Oral
    Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchors
    Sirui XuYu-Xiong Wang, and Liang-Yan Gui
    ECCV 2022