Shuhuai Ren (任抒怀)

About Me

I am a PhD student (second year) at Language Computing and Machine Learning Group, MOE Key Laboratory of Computational Linguistics, School of EECS, Peking University, supervised by Prof. Xu Sun.

Before that, I was an undergraduate student in Software Engineering, Huazhong University of Science and Technology under the guidance of Prof. Kun He.

My research interests lie within Multimodal Learning, Large-scale Pre-training and Efficient NLP. I'm also involved in Machine Learning problems like Adversarial Robustness.

News

[2021/08] Three papers have been accepted by EMNLP 2021.
[2021/05] One paper has been accepted by ACL 2021 as oral presentation.
[2019/07] I attended ACL 2019 in Florence, Italy and gave a talk.
[2019/05] One paper has been accepted by ACL 2019 as oral presentation.
[2019/02] I attended the Artificial Intelligence Winter Camp at The University of California, Berkeley and Stanford University.

Selected Publications (Full List)

Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification

Shuhuai Ren, Jinchao Zhang, Lei li, Xu Sun*, Jie Zhou

EMNLP 2021 (Long Paper)

Conference

Paper Code& Model

Dynamic Knowledge Distillation for Pre-trained Language Models

Lei Li, Yankai Lin, Shuhuai Ren, Peng Li, Jie Zhou, Xu Sun*

EMNLP 2021 (Long Paper, Oral)

Conference

Paper Code& Model

Learning Relation Alignment for Calibrated Cross-modal Retrieval

Shuhuai Ren, Junyang Lin, Guangxiang Zhao, Rui Men, An Yang, Jingren Zhou, Xu Sun*, Hongxia Yang

ACL 2021 (Long Paper, Oral)

Conference

Paper Code& Model

Generating Natural Language Adversarial Examples through Probability Weighted Word Saliency

Shuhuai Ren, Yihe Deng, Kun He*, Wangxiang Che

ACL 2019 (Long Paper, Oral)

Conference

Paper Code& Model

Education

Ph.D. in Computer Science, Peking University, Beijing, China

2020 - 2025 (expected)

B.Eng. in Software Engineering, Huazhong University of Science and Technology, Wuhan, China

GPA: 3.95/4.00; Rank: 4/180

2016 - 2020

Selected Awards and Competitions

Peking University (PKU), Sep. 2020 - Jul. 2025 (Expected)

The third Prize of Peking University Scholarship, 2020-21

Award for Scientific Research, 2020-21

Huazhong University of Science and Technology (HUST), Sep. 2016 - Jul. 2020

Pacemaker to Merit Student (The highest honor of undergraduate students), 2017-18

National Scholarship of China, 2017-18

Outstanding Graduates of HUST, 2020

Outstanding Undergraduate Thesis, 2020

Baosteel Scholarship, 2019

Hainan Airlines Scholarship, 2016-17

American College Students Mathematical Modeling Competition (MCM/ICM), Honorable Mention, 2018

Academic Service

Reviewer/Program committee: ACL (2021 Outstanding Reviewer Award, 2022), EMNLP (2021), NAACL (2022), ARR (2021, 2022), COLING (2020, 2022)

Teaching assistant: Introduction to Natural Language processing (PKU, 2021 Fall), Artificial Intelligence Frontier and Industry Trends (PKU, 2022 Spring)