Shuhuai Ren (任抒怀)

About Me

I am a PhD student (second year) at Language Computing and Machine Learning Group, MOE Key Laboratory of Computational Linguistics, School of EECS, Peking University, supervised by Prof. Xu Sun.

Before that, I was an undergraduate student in Software Engineering, Huazhong University of Science and Technology under the guidance of Prof. Kun He.

My research interests lie within Multimodal Learning, Large-scale Pre-training and Efficient NLP. I'm also involved in Machine Learning problems like Adversarial Robustness.

News

[2021/08] Three papers have been accepted by EMNLP 2021.
[2021/05] One paper has been accepted by ACL 2021 as oral presentation.
[2019/07] I attended ACL 2019 in Florence, Italy and gave a talk.
[2019/05] One paper has been accepted by ACL 2019 as oral presentation.
[2019/02] I attended the Artificial Intelligence Winter Camp at The University of California, Berkeley and Stanford University.

Selected Publications (Full List)

Rethinking the Openness of CLIP

Shuhuai Ren, Lei Li, Xuancheng Ren, Guangxiang Zhao, Xu Sun

Arxiv 2022

Preprint

Paper

Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification

Shuhuai Ren, Jinchao Zhang, Lei li, Xu Sun*, Jie Zhou

EMNLP 2021 (Long Paper)

Conference

Paper Code& Model

Dynamic Knowledge Distillation for Pre-trained Language Models

Lei Li, Yankai Lin, Shuhuai Ren, Peng Li, Jie Zhou, Xu Sun*

EMNLP 2021 (Long Paper, Oral)

Conference

Paper Code& Model

Learning Relation Alignment for Calibrated Cross-modal Retrieval

Shuhuai Ren, Junyang Lin, Guangxiang Zhao, Rui Men, An Yang, Jingren Zhou, Xu Sun*, Hongxia Yang

ACL 2021 (Long Paper, Oral)

Conference

Paper Code& Model

Generating Natural Language Adversarial Examples through Probability Weighted Word Saliency

Shuhuai Ren, Yihe Deng, Kun He*, Wangxiang Che

ACL 2019 (Long Paper, Oral)

Conference

Paper Code& Model

Education

Ph.D. in Computer Science, Peking University, Beijing, China

2020 - 2025 (expected)

B.Eng. in Software Engineering, Huazhong University of Science and Technology, Wuhan, China

GPA: 3.95/4.00; Rank: 4/180

2016 - 2020

Selected Awards and Competitions

Peking University (PKU), Sep. 2020 - Jul. 2025 (Expected)

The third Prize of Peking University Scholarship, 2020-21

Award for Scientific Research, 2020-21

Huazhong University of Science and Technology (HUST), Sep. 2016 - Jul. 2020

Pacemaker to Merit Student (The highest honor of undergraduate students), 2017-18

National Scholarship of China, 2017-18

Outstanding Graduates of HUST, 2020

Outstanding Undergraduate Thesis, 2020

Baosteel Scholarship, 2019

Hainan Airlines Scholarship, 2016-17

American College Students Mathematical Modeling Competition (MCM/ICM), Honorable Mention, 2018

Academic Service

Reviewer/Program committee: ACL (2021 Outstanding Reviewer Award, 2022), EMNLP (2021), NAACL (2022), ARR (2021, 2022), COLING (2020, 2022)

Teaching assistant: Introduction to Natural Language processing (PKU, 2021 Fall), Artificial Intelligence Frontier and Industry Trends (PKU, 2022 Spring)