Li Siyao 李思尧

Siyao recently completed his PhD in MMLab of Nanyang Technological University, Singapore, supervised by Prof. Chen Change Loy and Prof. Ziwei Liu.
He is currently a Research Scientist Intern at Meta Reality Labs in Redmond, USA, where he works on HumanCLAW, a closed-loop framework and benchmark for vision-language models acting through a humanoid body.
From August 2024 to March 2025, he visited the Perceiving Systems Group of Max Planck Institute for Intelligent Systems in Tuebingen, Germany, where he was supervised by Prof. Michael J. Black and worked closely with Yao Feng and Omid Taheri.
Before his PhD, he was a full-time researcher in SenseTime Research, working closely with Quan Wang, Wenxiu Sun and Chao Dong.
His current interests focus on developing intelligent embodied agent to interact with open, dynamic worlds. He is an awardee of 2024 Google PhD Fellowship.

I am currently on the job market and seeking full-time opportunities. Please feel free to contact me if you think my background is a good match.

Google Scholar

Github

Twitter

Youtube

Selected Works

	HumanCLAW: Can Vision-Language Models Act Through a Body? Li Siyao, Jiawei Gu, Shuai Liu, Kairui Hu, Zekun Li, Linjie Li, Chengcheng Tang, Po-Chen Wu, Ivan Shugurov, Lingni Ma, Michael Zollhoefer, Sizhe An, Abhay Mittal, Amy Zhao, Ranjay Krishna, Manling Li, Ziwei Liu, Chuan Guo arXiv preprint, 2026 Project page \| Paper \| Code
	InfiniteDance: Scalable 3D Dance Generation Towards in-the-wild Generalization Ronghui Li, Zhongyuan Hu, Li Siyao, Youliang Zhang, Haozhe Xie, Mingyuan Zhang, Jie Guo, Xiu Li, Ziwei Liu ECCV 2026 Project page \| Paper \| Code
	Half-Physics: Enabling Kinematic 3D Human Model with Physical Interactions Li Siyao, Yao Feng, Omid Taheri, Chen Change Loy, Michael J. Black CVPR 2026, PhysHuman Workshop (oral) Project page \| Paper \| Code \| Demo
	Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompaniment Li Siyao, Tianpei Gu, Zhitao Yang, Zhengyu Lin, Ziwei Liu, Henghui Ding, Lei Yang, Chen Change Loy ICLR 2024 Project page \| Paper \| Code \| Data \| Demo
	Bailando++: 3D Dance GPT with Choreographic Memory Li Siyao, Weijiang Yu, Tianpei Gu, Chunze Lin, Quan Wang, Chen Qian, Chen Change Loy, Ziwei Liu TPAMI 2023 Paper \| PDF (free) \| Code \| Demo
	Deep Geometrized Cartoon Line Inbetweening Li Siyao, Tianpei Gu, Weiye Xiao, Henghui Ding, Ziwei Liu, Chen Change Loy ICCV 2023 Paper \| Code \| Demo
	AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies Li Siyao, Yuhang Li, Bo Li, Chao Dong, Ziwei Liu, Chen Change Loy NeurIPS 2022 (Dataset & Benchmark) Project page \| Paper \| Code \| Demo
	Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memory Li Siyao, Weijiang Yu, Tianpei Gu, Chunze Lin, Quan Wang, Chen Qian, Chen Change Loy, Ziwei Liu CVPR 2022 (Oral, ~4%) Paper \| Code \| Demo
	Deep Animation Video Interpolation in the Wild Li Siyao, Shiyu Zhao, Weijiang Yu, Wenxiu Sun, Dimitris Metaxas, Chen Change Loy, Ziwei Liu CVPR 2021 Paper \| Code \| Data \| Demo
	Enhanced Quadratic Video Interpolation Yihao Liu, Liangbin Xie, Li Siyao, Wenxiu Sun, Yu Qiao, Chao Dong ECCV 2020, AIM Workshop 1st place of ECCV AIM-VTSR 2020 challenge! Link Paper \| Code
	Quadratic Video Interpolation Xiangyu Xu, Li Siyao, Wenxiu Sun, Qian Yin, Ming-Hsuan Yang NeurIPS 2019 (Spotlight, ~15%) 1st place of ICCV AIM-VTSR 2019 challenge! Link Paper \| Code \| Data

Services

Reviewer for CVPR, ICCV, ECCV, NeurIPS, ICML and SIGGRAPH

Awards

AISG Fellowship 2022

Google PhD Fellowship 2024

	HumanCLAW: Can Vision-Language Models Act Through a Body? Li Siyao, Jiawei Gu, Shuai Liu, Kairui Hu, Zekun Li, Linjie Li, Chengcheng Tang, Po-Chen Wu, Ivan Shugurov, Lingni Ma, Michael Zollhoefer, Sizhe An, Abhay Mittal, Amy Zhao, Ranjay Krishna, Manling Li, Ziwei Liu, Chuan Guo arXiv preprint, 2026 Project page \| Paper \| Code
	InfiniteDance: Scalable 3D Dance Generation Towards in-the-wild Generalization Ronghui Li, Zhongyuan Hu, Li Siyao, Youliang Zhang, Haozhe Xie, Mingyuan Zhang, Jie Guo, Xiu Li, Ziwei Liu ECCV 2026 Project page \| Paper \| Code
	Half-Physics: Enabling Kinematic 3D Human Model with Physical Interactions Li Siyao, Yao Feng, Omid Taheri, Chen Change Loy, Michael J. Black CVPR 2026, PhysHuman Workshop (oral) Project page \| Paper \| Code \| Demo
	Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompaniment Li Siyao, Tianpei Gu, Zhitao Yang, Zhengyu Lin, Ziwei Liu, Henghui Ding, Lei Yang, Chen Change Loy ICLR 2024 Project page \| Paper \| Code \| Data \| Demo
	Bailando++: 3D Dance GPT with Choreographic Memory Li Siyao, Weijiang Yu, Tianpei Gu, Chunze Lin, Quan Wang, Chen Qian, Chen Change Loy, Ziwei Liu TPAMI 2023 Paper \| PDF (free) \| Code \| Demo
	Deep Geometrized Cartoon Line Inbetweening Li Siyao, Tianpei Gu, Weiye Xiao, Henghui Ding, Ziwei Liu, Chen Change Loy ICCV 2023 Paper \| Code \| Demo
	AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies Li Siyao, Yuhang Li, Bo Li, Chao Dong, Ziwei Liu, Chen Change Loy NeurIPS 2022 (Dataset & Benchmark) Project page \| Paper \| Code \| Demo
	Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memory Li Siyao, Weijiang Yu, Tianpei Gu, Chunze Lin, Quan Wang, Chen Qian, Chen Change Loy, Ziwei Liu CVPR 2022 (Oral, ~4%) Paper \| Code \| Demo
	Deep Animation Video Interpolation in the Wild Li Siyao, Shiyu Zhao, Weijiang Yu, Wenxiu Sun, Dimitris Metaxas, Chen Change Loy, Ziwei Liu CVPR 2021 Paper \| Code \| Data \| Demo
	Enhanced Quadratic Video Interpolation Yihao Liu, Liangbin Xie, Li Siyao, Wenxiu Sun, Yu Qiao, Chao Dong ECCV 2020, AIM Workshop 1st place of ECCV AIM-VTSR 2020 challenge! Link Paper \| Code
	Quadratic Video Interpolation Xiangyu Xu, Li Siyao, Wenxiu Sun, Qian Yin, Ming-Hsuan Yang NeurIPS 2019 (Spotlight, ~15%) 1st place of ICCV AIM-VTSR 2019 challenge! Link Paper \| Code \| Data