Xihui Liu

PhD Student, Multimedia Lab (MMLab), The Chinese University of Hong Kong (CUHK) xihui.liu.me@gmail.com xihui-liu@link.cuhk.edu.hk Google Scholar   CV

About me

I am a Ph.D. student from Multimedia Lab (MMLab), the Chinese University of Hong Kong. I am supervised by Prof. Xiaogang Wang and Prof. Hongsheng Li. I received bachelor's degree in Electronic Engineering in Tsinghua University (THU) in 2017. My research interests cover the broad area of computer vision and deep learning, with special emphasis on image synthesis and editing, and multimodal language and vision. I was awarded Adobe Research Fellowship 2020.

News

• I passed my Ph.D. thesis defense and will be a PostDoc at UC Berkeley starting from August 2021.

• One paper accepted by ECCV 2020.

• I am awarded Adobe Research Fellowship 2020.

• One paper accepted by NeurIPS 2019.

• One paper accepted by ICCV 2019.

• One paper accepted by CVPR 2019.

• Two papers accepted by ECCV 2018.

Working Experience

• Research intern at NVIDIA Research. (July 2020 to now)
  Worked on video synthesis with Ming-Yu Liu and Ting-Chun Wang.

• Research intern at Adobe Research. (May 2019 to September 2019)
  Worked on open-vocabulary open-domain image editing with Zhe Lin, Jianming Zhang, Handong Zhao, and Quan Tran.

• Research assistant at Multimedia Lab (MMLab), CUHK. (July 2016 to August 2016)
  Worked on object detection in videos with Kai Kang, supervised by Prof. Xiaogang Wang.

Publications

• Open-Edit: Open-Domain Image Manipulation with Open-Vocabulary Instructions [Video] [Slides] [Code]
  Xihui Liu, Zhe Lin, Jianming Zhang, Handong Zhao, Quan Tran, Xiaogang Wang, Hongsheng Li
  European Conference on Computer Vision (ECCV), 2020.

• Learning to Predict Layout-to-image Conditional Convolutions for Semantic Image Synthesis [Code] [Slides]
  Xihui Liu, Guojun Yin, Jing Shao, Xiaogang Wang, Hongsheng Li
  Thirty-third Conference on Neural Information Processing Systems (NeurIPS), 2019.

• Improving Referring Expression Grounding with Cross-modal Attention-guided Erasing [Code]
  Xihui Liu, Zihao Wang, Jing Shao, Xiaogang Wang, Hongsheng Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.

• Show, Tell and Discriminate: Image Captioning by Self-retrieval with Partially Labeled Data
  Xihui Liu, Hongsheng Li, Jing Shao, Dapeng Chen, Xiaogang Wang
  European Conference on Computer Vision (ECCV), 2018.

• CAMP: Cross-modal Adaptive Message Passing for Text-Image Retrieval [Code]
  Zihao Wang*, Xihui Liu*, Hongsheng Li, Lu Sheng, Junjie Yan, Xiaogang Wang, Jing Shao
  International Conference on Computer Vision (ICCV), 2019.

• Improving Deep Visual Representation for Person Re-identification by Global and Local Image-language Association
  Dapeng Chen, Hongsheng Li, Xihui Liu, Yantao Shen, Jing Shao, Zejian Yuan, Xiaogang Wang
  European Conference on Computer Vision (ECCV), 2018.

• HydraPlus-Net: Attentive Deep Features for Pedestrian Analysis
  Xihui Liu*, Haiyu Zhao*, Maoqing Tian, Lu Sheng, Jing Shao, Shuai Yi, Junjie Yan, Xiaogang Wang
  International Conference on Computer Vision (ICCV), 2017.

• Localization Guided Learning for Pedestrian Attribute Recognition
  Pengze Liu, Xihui Liu, Junjie Yan, Jing Shao,
  British Machine Vision Conference (BMVC), 2018.

• Orientation invariant feature embedding and spatial temporal regularization for vehicle re-identification
  Zhongdao Wang, Luming Tang, Xihui Liu, Zhuliang Yao, Shuai Yi, Jing Shao, Junjie Yan, Shengjin Wang, Hongsheng Li, Xiaogang Wang
  International Conference on Computer Vision (ICCV), 2017.

• Object Detection in Videos With Tubelet Proposal Networks
  Kai Kang, Hongsheng Li, Tong Xiao, Wanli Ouyang, Junjie Yan, Xihui Liu, Xiaogang Wang
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.

Academic Services

Reviewer of the following conferences and journals:

• Outstanding Reviewer for CVPR 2019 and ICLR 2021.

• CVPR, ICCV, ECCV, NeruIPS, ICML, ICLR, AAAI.

• IJCV, TCSVT, NeuroComputing, TMM.

Teaching Experience

Teaching Assistant of the following courses in The Chinese University of Hong Kong:

• ELEG 5491, Introduction to Deep Learning [Course website], Spring 2019.

• ENGG 5202, Pattern Recognition, Fall 2017, Spring 2020.

• ELEG 5760, Machine Learning for Signal Processing Applications, Fall 2018.

• ENGG 2450A, Probability and Statistics for Engineers, Spring 2018, Fall 2020.

• Summer Tutorial, Potential Inspiration in Electronic Engineering, Summer 2018.

• ENGG 2420B, Complex Analyis and Differential Equations for Engineers, Fall 2019.

• ENGG 2740A, Differential Equations for Engineers, Spring 2021.