Hang Zhou

Ph.D Principal Architect @ Digital Human and Video Generation Team, AMU, Baidu Inc. zhouhang09@baidu dot com zhouhang@link.cuhk.edu.hk Github    Scholar

About me

I am currently a Principal Architect at AMU, Baidu Inc., serving as the Tech Lead of the Digital Human and Video Generation team. Our work focuses on building omni video foundation models for human videos, with applications including digital humans, human-object interaction, reference-guided video generation/editing, and controllable human video synthesis. We also build large-scale video data engines and production systems that connect research models with real-world applications. Our technologies support Baidu Yijing, Baidu's digital-human livestreaming platform for e-commerce and content creation. Please drop me an email if you are interested in internship or full-time opportunities.

I obtained my Ph.D. degree from Multimedia Lab (MMLab), The Chinese University of Hong Kong (CUHK) in 2021, supervised by Prof. Xiaogang Wang and Prof. Ziwei Liu. I received my bachelor's degree in Acoustics from the School of Physics at Nanjing University (NJU) in 2017. I was recognized as one of Stanford World's Top 2% Scientists in 2025.

News

• [2026] Two papers accepted to CVPR 2026.

• [2025] 3 CVPR 2025, and 1 ICCV 2025 are accepted

• [2024] 2 ECCV 2024, 1 SIGGRAPH Asia 2024, and 1 ICLR 2024 are accepted.

• [2023] 1 ICCV 2023, 1 SIGGRAPH 2023, 1 AAAI 2023, and 1 CVPR 2023 are accepted.

• [2022] 4 ECCV 2022, 3 CVPR 2022, 1 SIGGRAPH 2022, 1 SIGGRAPH Asia 2022, 2 NeurIPS 2022, and 2 AAAI 2022 are accepted.

• [2021-04] One paper accepted to IJCAI 2021.

• [2021-03] Three papers accepted to CVPR 2021.

• [2021-01] One paper accepted to CHI 2021.

• [2020-10] I am among the Top 10% High Score Reviewers of NeurIPS 2020.

• [2020-07] Two papers accepted to ECCV 2020.

• [2020-06] I am awarded Outstanding Reviewer of CVPR 2020.

• [2020-02] One paper accepted to CVPR 2020.

• [2019-07] Two papers accepted to ICCV 2019.

• [2018-11] One paper accepted to AAAI 2019 as Oral.

Publications

*Equal contribition, †Corresponding author

GenHOI: Towards Object-Consistent Hand-Object Interaction with Temporally Balanced and Spatially Selective Object Injection Xuan Huang, Mochu Xiang, Zhelun Shen, Jinbo Wu, Chenming Wu, Chen Zhao, Kaisiyuan Wang, Hang Zhou, Shanshan Liu, Haocheng Feng, Wei He, Jingdong Wang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2026. PDF   Project   Code

CoLoGen: Progressive Learning of Concept-Localization Duality for Unified Image Generation YuXin Song, Yu Lu, Haoyuan Sun, Huanjin Yao, Fanglong Liu, Yifan Sun, Haocheng Feng, Hang Zhou, Jingdong Wang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2026. PDF

ONE-SHOT: Compositional Human-Environment Video Synthesis via Spatial-Decoupled Motion Injection and Hybrid Context Integration Fengyuan Yang, Luying Huang, Jiazhi Guan, Quanwei Yang, Dongwei Pan, Jianglin Fu, Haocheng Feng, Wei He, Kaisiyuan Wang, Hang Zhou, Angela Yao arXiv preprint, 2026. PDF   Project

InterDyad: Interactive Dyadic Speech-to-Video Generation by Querying Intermediate Visual Guidance Dongwei Pan, Longwei Guo, Jiazhi Guan, Luying Huang, Yiding Li, Haojie Liu, Haocheng Feng, Wei He, Kaisiyuan Wang, Hang Zhou arXiv preprint, 2026. PDF   Project

RefAlign: Boosting Video Generation with Representation Alignment for Reference-to-Video Generation Haoran Wang, Jun Li, Zhengkai Jiang, Chenxi Huang, Jiale Liao, Zhongang Cai, Yifan Xing, Hang Zhou, Liang Xiao, Chen Change Loy, Yu Qiao, Dahua Lin, Bo Dai, Ziwei Liu arXiv preprint, 2026. PDF

SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editing Xinyao Zhang, Wenkai Dong, Yuxin Song, Bo Fang, Qi Zhang, Jing Wang, Fan Chen, Hui Zhang, Haocheng Feng, Yu Lu, Hang Zhou, Chun Yuan, Jingdong Wang arXiv preprint, 2026. PDF   Project

MVHOI: Bridge Multi-view Condition to Complex Human-Object Interaction Video Reenactment via 3D Foundation Model Jinguang Tong, Jinbo Wu, Kaisiyuan Wang, Zhelun Shen, Xuan Huang, Mochu Xiang, Xuesong Li, Yingying Li, Haocheng Feng, Chen Zhao, Hang Zhou, Wei He, Chuong Nguyen, Jingdong Wang, Hongdong Li arXiv preprint, 2026. PDF

Cosh-DiT: Co-Speech Gesture Video Synthesis via Hybrid Audio-Visual Diffusion Transformers Yasheng Sun*, Zhiliang Xu*, Hang Zhou, Jiazhi Guan, Quanwei Yang, Kaisiyuan Wang, Borong Liang, Yingying Li, Haocheng Feng, Jingdong Wang, Ziwei Liu, Koike Hideki International Journal of Computer Vision (IJCV) 2026. PDF

AudCast: Audio-Driven Human Video Generation by Cascaded Diffusion Transformers Jiazhi Guan, Kaisiyuan Wang, Zhiliang Xu, Quanwei Yang, Yasheng Sun, Shengyi He, Borong Liang, Yukang Cao, Yingying Li, Haocheng Feng, Errui Ding, Jingdong Wang, Youjian Zhao†, Hang Zhou†, Ziwei Liu† IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2025. PDF   Project

Re-HOLD: Video Hand Object Interaction Reenactment via adaptive Layout-instructed Diffusion Model Yingying Fan, Quanwei Yang, Kaisiyuan Wang, Hang Zhou, Yingying Li, Haocheng Feng, Errui Ding, Yu Wu, Jingdong Wang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2025. PDF   Project

Hallo3 Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer Jiahao Cui, Hui Li, Yun Zhan, Hanlin Shang, Kaihui Cheng, Yuqi Ma, Shan Mu, Hang Zhou, Jingdong Wang, Siyu Zhu IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2025. PDF   Project

Showmaker: Creating high-fidelity 2d human video via fine-grained diffusion modeling Quanwei Yang, Jiazhi Guan, Kaisiyuan Wang, Lingyun Yu, Wenqing Chu, Hang Zhou, ZhiQiang Feng, Haocheng Feng, Errui Ding, Jingdong Wang, Hongtao Xie Advances in Neural Information Processing Systems (NeurIPS) 2024. PDF   Project

TALK-Act: Enhance Textural-Awareness for 2D Speaking Avatar Reenactment with Diffusion Model Jiazhi Guan, Quanwei Yang, Kaisiyuan Wang, Hang Zhou†, Shengyi He, Zhiliang Xu, Haocheng Feng, Errui Ding, Jingdong Wang, Hongtao Xie, Youjian Zhao†, Ziwei Liu SIGGRAPH Asia 2024 Conference Proceedings. PDF   Project

ReSyncer: Rewiring Style-based Generator for Unified Audio-Visually Synced Facial Performer Jiazhi Guan*, Zhiliang Xu*, Hang Zhou†, Kaisiyuan Wang, Shengyi He, Zhanwang Zhang, Borong Liang, Haocheng Feng, Errui Ding, Jingtuo Liu, Jingdong Wang, Youjian Zhao†, Ziwei Liu European Conference on Computer Vision (ECCV) 2024 (Oral Presentation). PDF   Project

3D-Aware Text-driven Talking Avatar Generation Xiuzhe Wu, Yang-Tian Sun, Handi Chen, Hang Zhou, Jingdong Wang, Zhengzhe Liu, Xiaojuan Qi European Conference on Computer Vision (ECCV) 2024. PDF

DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation Jiaxiang Tang, Jiawei Ren, Hang Zhou, Ziwei Liu, Gang Zeng International Conference on Learning Representations (ICLR) 2024 (Oral Presentation). PDF   Project   Code

ReliTalk: Relightable Talking Portrait Generation from a Single Video Haonan Qiu, Zhaoxi Chen, Yuming Jiang, Hang Zhou, Xiangyu Fan, Lei Yang, Wayne Wu, Ziwei Liu International Journal of Computer Vision (IJCV) 2024. PDF   Project   Code

Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinement Jiaxiang Tang, Hang Zhou, Xiaokang Chen, Tianshu Hu, Errui Ding, Jingdong Wang, Gang Zeng International Conference on Computer Vision (ICCV) 2023. PDF   Project   Code

Efficient Video Portrait Reenactment via Grid-based Codebook Kaisiyuan Wang, Hang Zhou†, Qianyi Wu, Jiaxiang Tang, Zhiliang Xu, Borong Liang, Tianshu Hu, Errui Ding, Jingtuo Liu, Ziwei Liu, Jingdong Wang SIGGRAPH 2023 Conference Proceedings. PDF   Project

StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generator Jiazhi Guan*, Zhanwang Zhang*, Hang Zhou†, Tianshu Hu†, Kaisiyuan Wang, Dongliang He, Haocheng Feng, Jingtuo Liu, Errui Ding, Ziwei Liu, Jingdong Wang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2023. PDF   Project

Robust Video Portrait Reenactment via Personalized Representation Quantization Kaisiyuan Wang, Changcheng Liang, Hang Zhou†, Jiaxiang Tang, Qianyi Wu, Dongliang He, Zhibin Hong, Jingtuo Liu, Errui Ding, Ziwei Liu, Jingdong Wang AAAI Conference on Artificial Intelligence (AAAI) 2023. PDF   Project

ReEnFP: Detail-Preserving Face Reconstruction by Encoding Facial Priors Yasheng Sun, Jiangke Lin, Hang Zhou, Zhiliang Xu, Dongliang He, Hideki Koike IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023. PDF   Project

SeCo: Separating Unknown Musical Visual Sounds with Consistency Guidance Xinchi Zhou, Dongzhan Zhou, Wanli Ouyang, Hang Zhou, Di Hu IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023. PDF

Exploiting Visual Context Semantics for Sound Source Localization Xinchi Zhou, Dongzhan Zhou, Di Hu, Hang Zhou, Wanli Ouyang IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023. PDF

Masked Lip-Sync Prediction by Audio-Visual Contextual Exploitation in Transformers Yasheng Sun*, Hang Zhou*, Kaisiyuan Wang, Qianyi Wu, Zhibin Hong, Jingtuo Liu, Errui Ding, Jingdong Wang, Ziwei Liu, Hideki Koike SIGGRAPH Asia 2022 Conference. PDF   Project

Make Your Brief Stroke Real and Stereoscopic: 3D-Aware Simplified Sketch to Portrait Generation Yasheng Sun*, Qianyi Wu*, Hang Zhou*, Kaisiyuan Wang, Tianshu Hu, Chen-Chieh Liao, Dongliang He, Jingtuo Liu, Errui Ding, Jingdong Wang, Shio Miyafuji, Ziwei Liu, Hideki Koike International Conference on Multimodal Interaction (ICMI) 2023 Oral. PDF   Project

Audio-Driven Co-Speech Gesture Video Generation Xian Liu, Qianyi Wu, Hang Zhou, Yuanqi Du, Wayne Wu, Dahua Lin, Ziwei Liu NeurIPS 2022 (Spotlight Presentation). PDF   Project   Code

Delving into sequential patches for DeepFake detection Jiazhi Guan, Hang Zhou, Zhibin Hong, Errui Ding, Jingdong Wang, Chengbin Quan, Youjian Zhao NeurIPS 2022. PDF

StyleSwap: Style-Based Generator Empowers Robust Face Swapping Zhiliang Xu*, Hang Zhou*†, Zhibin Hong, Ziwei Liu, Jiaming Liu, Zhizhi Guo, Junyu Han, Jingtuo Liu, Errui Ding, Jingdong Wang European Conference on Computer Vision (ECCV) 2022. PDF   Project   Code

Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generation Xian Liu, Yinghao Xu, Qianyi Wu, Hang Zhou, Wayne Wu, Bolei Zhou European Conference on Computer Vision (ECCV) 2022 (Oral Presentation). PDF   Project   Code

Joint-Modal Label Denoising for Weakly-Supervised Audio-Visual Video Parsing Haoyue Cheng, Zhaoyang Liu, Hang Zhou, Chen Qian, Wayne Wu, Limin Wang European Conference on Computer Vision (ECCV) 2022. PDF   Code

TokenMix: Rethinking Image Mixing for Data Augmentation in Vision Transformers Jihao Liu, Boxiao Liu, Hang Zhou, Hongsheng Li, Yu Liu European Conference on Computer Vision (ECCV) 2022. PDF   Code

EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model Xinya Ji, Hang Zhou, Kaisiyuan Wang, Qianyi Wu, Wayne Wu, Feng Xu, Xun Cao SIGGRAPH 2022 Conference Proceedings. PDF   Project  Code

Few-Shot Head Swapping in the Wild Changyong Shu, Hemao Wu, Hang Zhou†, Jiaming Liu†, Zhibin Hong, Changxing Ding, Junyu Han, Jingtuo Liu, Errui Ding, Jingdong Wang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022 (Oral Presentation). PDF   Project  Code

Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation Xian Liu, Qianyi Wu, Hang Zhou, Yinghao Xu, Rui Qian, Xinyi Lin, Xiaowei Zhou, Wayne Wu, Bo Dai, and Bolei Zhou IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022. PDF   Project  Code

Expressive Talking Head Generation with Granular Audio-Visual Control Borong Liang*, Yan Pan*, Zhizhi Guo†, Hang Zhou†, Zhibin Hong, Xiaoguang Han, Junyu Han, Jingtuo Liu, Errui Ding, Jingdong Wang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022. PDF

Visual Sound Localization in the Wild by Cross-Modal Interference Erasing Xian Liu*, Rui Qian*, Hang Zhou*, Di Hu, Weiyao Lin, Ziwei Liu, Bolei Zhou, Xiaowei Zhou AAAI Conference on Artificial Intelligence (AAAI) 2022. PDF   Code

SepFusion: Finding Optimal Fusion Structures for Visual Sound Separation Dongzhan Zhou, Xinchi Zhou, Di Hu, Hang Zhou, Lei Bai, Ziwei Liu, Wanli Ouyang. AAAI Conference on Artificial Intelligence (AAAI) 2022. PDF

Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation Hang Zhou, Yasheng Sun, Wayne Wu, Chen Change Loy, Xiaogang Wang, Ziwei Liu IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021. PDF   Project   Code

Visually Informed Binaural Audio Generation without Binaural Audios Xudong Xu*, Hang Zhou*, Ziwei Liu, Bo Dai, Xiaogang Wang, Dahua Lin IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021. PDF   Project   Code

Audio-Driven Emotional Video Portraits Xinya Ji, Hang Zhou, Kaisiyuan Wang, Wayne Wu, Chen Change Loy, Xun Cao, Feng Xu IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021. PDF   Project

Speech2Talking-Face: Inferring and Driving a Face with Synchronized Audio-Visual Representation Yasheng Sun*, Hang Zhou*, Ziwei Liu, Hideki Koike International Joint Conference on Artificial Intelligence (IJCAI) 2021. PDF   Project   Code

PTeacher: a Computer-Aided Personalized Pronunciation Training System with Exaggerated Audio-Visual Corrective Feedback Yaohua Bu*, Tianyi Ma*, Weijun Li, Hang Zhou, Jia Jia, Shengqi Chen, Kaiyuan Xu, Dachuan Shi, Haozhe Wu, Zhihan Yang, Kun Li, Zhiyong Wu, Yuanchun Shi, Xiaobo Lu, Ziwei Liu ACM CHI Conference on Human Factors in Computing Systems (CHI) 2021. PDF   Demo

Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation Hang Zhou*, Xudong Xu*, Dahua Lin, Xiaogang Wang, Ziwei Liu European Conference on Computer Vision (ECCV) 2020. PDF   Project   Code

Discriminability Distillation in Group Representation Learning Manyuan Zhang, Guanglu Song, Hang Zhou, Yu Liu European Conference on Computer Vision (ECCV) 2020. PDF

Rotate-and-Render: Unsupervised Photorealistic Face Rotation from Single-View Images Hang Zhou*, Jihao Liu*, Ziwei Liu, Yu Liu, Xiaogang Wang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2020. PDF   Code

Vision-Infused Deep Audio Inpainting Hang Zhou, Ziwei Liu, Xudong Xu, Ping Luo, Xiaogang Wang International Conference on Computer Vision (ICCV) 2019. PDF   Project   Code

A Graph-based Framework to Bridge Movies and Synopses Yu Xiong, Qingqiu Huang, Lingfeng Guo, Hang Zhou, Bolei Zhou, Dahua Lin International Conference on Computer Vision (ICCV) 2019 (Oral Presentation). PDF   Project   Code

Talking Face Generation by Adversarially Disentangled Audio-Visual Representation Hang Zhou, Yu Liu, Ziwei Liu, Ping Luo, Xiaogang Wang AAAI Conference on Artificial Intelligence (AAAI) 2019 (Oral Presentation). PDF   Project   Code

Industrial Impact

Our human video generation technologies have been deployed in large-scale commercial products and livestreaming scenarios. We support Baidu Yijing, Baidu's digital-human platform, enabling high-fidelity avatar generation, long-form human video synthesis, multi-modal script-driven performance, and real-time livestream interaction. We supported Luo Yonghao's digital-human livestream on Baidu e-commerce; the livestream attracted over 13 million views and achieved more than RMB 55 million GMV (report from QbitAI). Baidu digital-human livestreaming has been used by over 100,000 merchants, with an average GMV increase of 62% and an 80% reduction in livestream operation cost.

Professional Activities

• Organizer of ECCV 2020 SenseHuman Workshop
• Journal Reviewer of IJCV, Transactions on Audio Speech and Language Processing, Neurocomputing, TPAMI, etc.
• Conference Reviewer of ICCV, CVPR, ECCV, ICML, AAAI, NeurIPS, ICLR, Siggraph, etc.

Collaborators

• I am fortunate to have closely collaborated with Xudong Xu, Qianyi Wu, Dr. Wayne Wu, Dr. Yu Liu and Prof. Ping Luo.
• I am also fortunate to have provided help to talented mentees including Xian Liu, Kaisiyuan Wang, Yasheng Sun, Jiaxiang Tang, Xinya Ji, and Jihao Liu.

Teaching Experience

Teaching Assistant of the following courses in The Chinese University of Hong Kong:

• ELEG5491, Introduction to Deep Learning , Spring 2019.

• ELEG5760, Machine Learning for Signal Processing Applications, Fall 2018.

• ENGG2420B, Complex Analysis and Differential Equations for Engineers, Fall 2018.

• ENGG1110, Problem Solving By Programming, Spring 2018.

• ENGG2420B, Complex Analysis and Differential Equations for Engineers, Fall 2017.