Shuhuai Ren (任抒怀)

About Me

I am a PhD student (4th year) at Language Computing and Machine Learning Group, MOE Key Laboratory of Computational Linguistics, School of EECS, Peking University, supervised by Prof. Xu Sun.

Before that, I was an undergraduate student in Software Engineering, Huazhong University of Science and Technology under the guidance of Prof. Kun He.

My research interests lie within (1) Vision-Language Foundation Models, (2) Video Understanding and Generation, and (3) Open-Ended Visual Recognition.

News

[2024/04] One paper has been accepted by NAACL 2024.
[2024/02] One paper has been accepted by CVPR 2024.
[2023/10] One paper has been accepted by EMNLP 2023.
[2023/09] Two papers have been accepted by NeurIPS 2023.
[2023/05] One paper has been accepted by ACL 2023.
[2021/08] Three papers have been accepted by EMNLP 2021.
[2021/05] One paper has been accepted by ACL 2021 as oral presentation.
[2019/05] One paper has been accepted by ACL 2019 as oral presentation.
[2019/02] I attended the Artificial Intelligence Winter Camp at The University of California, Berkeley and Stanford University.

Selected Publications (Full List)

Video Understanding and Generation

TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding

Shuhuai Ren*, Linli Yao*, Shicheng Li, Xu Sun, Lu Hou

CVPR 2024

Conference

Paper Code& Model

TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding

Shuhuai Ren, Sishuo Chen, Shicheng Li, Xu Sun, Lu Hou

Findings of EMNLP 2023 (Long Paper)

Conference

Paper Code& Model

FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generation

Yuanxin Liu, Lei Li, Shuhuai Ren, Rundong Gao, Shicheng Li, Sishuo Chen, Xu Sun, Lu Hou

NeurIPS 2023 (Dataset & Benchmark Track)

Conference

Paper Code& Model

Vision-Language Alignment

Prompt Pre-Training with Twenty-Thousand Classes for Open-Vocabulary Visual Recognition

Shuhuai Ren, Aston Zhang, Yi Zhu, Shuai Zhang, Shuai Zheng, Mu Li, Alex Smola, Xu Sun

NeurIPS 2023

Conference

Paper Code& Model

M3IT: A Large-Scale Dataset towards Multi-Modal Multilingual Instruction Tuning

Lei Li, Yuwei Yin, Shicheng Li, Liang Chen, Peiyi Wang, Shuhuai Ren, Mukai Li, Yazheng Yang, Jingjing Xu, Xu Sun, Lingpeng Kong, Qi Liu

Arxiv 2023

Arxiv

Paper Dataset

Delving into the Openness of CLIP

Shuhuai Ren, Lei Li, Xuancheng Ren, Guangxiang Zhao, Xu Sun

Findings of ACL 2023 (Long Paper)

Conference

Paper Code& Model

Learning Relation Alignment for Calibrated Cross-modal Retrieval

Shuhuai Ren, Junyang Lin, Guangxiang Zhao, Rui Men, An Yang, Jingren Zhou, Xu Sun*, Hongxia Yang

ACL 2021 (Long Paper, Oral)

Conference

Paper Code& Model

Generating Natural Language Adversarial Examples through Probability Weighted Word Saliency

Shuhuai Ren, Yihe Deng, Kun He*, Wangxiang Che

ACL 2019 (Long Paper, Oral)

Conference

Paper Code& Model

Selected Awards and Competitions

Peking University (PKU), Sep. 2020 - Jul. 2025 (Expected)

NeurIPS Scholar Award, 2023

The third Prize of Peking University Scholarship, 2020-21

Award for Scientific Research, 2020-22

Huazhong University of Science and Technology (HUST), Sep. 2016 - Jul. 2020

Pacemaker to Merit Student (The highest honor of undergraduate students), 2017-18

National Scholarship of China, 2017-18

Outstanding Graduates of HUST, 2020

Outstanding Undergraduate Thesis, 2020

Baosteel Scholarship, 2019

Hainan Airlines Scholarship, 2016-17

American College Students Mathematical Modeling Competition (MCM/ICM), Honorable Mention, 2018

Academic Service

Reviewer/Program committee for conferences: ICLR (2023), NeurIPS (2023), ACL (2021 Outstanding Reviewer Award-23), EMNLP (2021-23), NAACL (2022-23), ARR (2021-23), COLING (2020, 2022)

Reviewer for journals: TPAMI, IJCV

Teaching assistant: Introduction to Natural Language processing (PKU, 2021 Fall), Artificial Intelligence Frontier and Industry Trends (PKU, 2022 Spring)