Hang Zhou

Ph.D Candidate, Department of Electornic Engineering / Multimedia Lab (MMLab), The Chinese University of Hong Kong (CUHK) hangzcuhk@gmail.com zhouhang@link.cuhk.edu.hk Github   CV   Scholar

About me

I am currently a fourth-year Ph.D. student in Multimedia Lab (MMLab), the Chinese University of Hong Kong. I am supervised by Prof. Xiaogang Wang and Prof. Ziwei Liu. I have closely collaborated with Xudong Xu, Dr. Yu Liu and Prof. Ping Luo. I received my bachelor's degree in Acoustics from the School of Physics at Nanjing University (NJU) in 2017.

My research interests include deep learning and its applications on audio-visual learning and face generation.

News

• [2021-04] One paper accepted to IJCAI 2021.

• [2021-03] Three papers accepted to CVPR 2021!

• [2021-01] One paper accepted to CHI 2021.

• [2020-10] I am among the Top 10% High Score Reviewers of NeurIPS 2020.

• [2020-07] Two papers accepted to ECCV 2020.

• [2020-06] We are organizing ECCV 2020 SenseHuman Workshop.

• [2020-06] I am awarded Outstanding Reviewer of CVPR 2020.

• [2020-02] One paper accepted to CVPR 2020.

• [2019-07] Two papers accepted to ICCV 2019.

• [2018-11] One paper accepted to AAAI 2019 as Oral.

Publications

Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation Hang Zhou, Yasheng Sun, Wayne Wu, Chen Change Loy, Xiaogang Wang, Ziwei Liu IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021. PDF   Project   Code

Visually Informed Binaural Audio Generation without Binaural Audios Xudong Xu*, Hang Zhou*, Ziwei Liu, Bo Dai, Xiaogang Wang, Dahua Lin IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021. PDF   Project   Code

Audio-Driven Emotional Video Portraits Xinya Ji, Hang Zhou, Kaisiyuan Wang, Wayne Wu, Chen Change Loy, Xun Cao, Feng Xu IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021. PDF   Project

Speech2Talking-Face: Inferring and Driving a Face with Synchronized Audio-Visual Representation Yasheng Sun*, Hang Zhou*, Ziwei Liu, Hideki Koike International Joint Conference on Artificial Intelligence (IJCAI) 2021.

PTeacher: a Computer-Aided Personalized Pronunciation Training System with Exaggerated Audio-Visual Corrective Feedback Yaohua Bu*, Tianyi Ma*, Weijun Li, Hang Zhou, Jia Jia, Shengqi Chen, Kaiyuan Xu, Dachuan Shi, Haozhe Wu, Zhihan Yang, Kun Li, Zhiyong Wu, Yuanchun Shi, Xiaobo Lu, Ziwei Liu ACM CHI Conference on Human Factors in Computing Systems (CHI) 2021.

Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation Hang Zhou*, Xudong Xu*, Dahua Lin, Xiaogang Wang, Ziwei Liu European Conference on Computer Vision (ECCV) 2020. PDF   Project   Code

Discriminability Distillation in Group Representation Learning Manyuan Zhang, Guanglu Song, Hang Zhou, Yu Liu European Conference on Computer Vision (ECCV) 2020. PDF

Rotate-and-Render: Unsupervised Photorealistic Face Rotation from Single-View Images Hang Zhou*, Jihao Liu*, Ziwei Liu, Yu Liu, Xiaogang Wang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2020. PDF   Code

Vision-Infused Deep Audio Inpainting Hang Zhou, Ziwei Liu, Xudong Xu, Ping Luo, Xiaogang Wang International Conference on Computer Vision (ICCV) 2019. PDF   Project   Code

A Graph-based Framework to Bridge Movies and Synopses Yu Xiong, Qingqiu Huang, Lingfeng Guo, Hang Zhou, Bolei Zhou, Dahua Lin International Conference on Computer Vision (ICCV) 2019 (Oral Presentation). PDF   Project   Code

ET-GAN: Cross-Language Emotion Transfer Based on Cycle-Consistent Generative Adversarial Networks Xiaoqi Jia*, Jianwei Tai*, Hang Zhou, Yakai Li, Weijuan Zhang, Haichao Du, Qingjia Huang European Conference on Artificial Intelligence (ECAI) 2020 (Oral Presentation).

Talking Face Generation by Adversarially Disentangled Audio-Visual Representation Hang Zhou, Yu Liu, Ziwei Liu, Ping Luo, Xiaogang Wang AAAI Conference on Artificial Intelligence (AAAI) 2019 (Oral Presentation). PDF   Project   Code

Working Experience

• Research assistant at Multimedia Lab (MMLab), CUHK. (Feb. 2017 to May 2017)
  Worked on lip reading.

Professional Activities

• Journal Reviewer of IJCV, Transactions on Audio Speech and Language Processing, Neurocomputing.
• Conference Reviewer of ICCV 2021; CVPR 2020, 2021; ICML 2021; AAAI 2021; NeurIPS 2020; IJCAI-PRICAI 2020, 2021 Demonstrations.

Teaching Experience

Teaching Assistant of the following courses in The Chinese University of Hong Kong:

• ELEG5491, Introduction to Deep Learning , Spring 2019.

• ELEG5760, Machine Learning for Signal Processing Applications, Fall 2018.

• ENGG2420B, Complex Analysis and Differential Equations for Engineers, Fall 2018.

• ENGG1110, Problem Solving By Programming, Spring 2018.

• ENGG2420B, Complex Analysis and Differential Equations for Engineers, Fall 2017.