Profile image
Shuhuai Ren (任抒怀)
Ph.D. Student
School of EECS
Peking University

About Me

I am a PhD student (second year) at Language Computing and Machine Learning Group, MOE Key Laboratory of Computational Linguistics, School of EECS, Peking University, supervised by Prof. Xu Sun.

Before that, I was an undergraduate student in Software Engineering, Huazhong University of Science and Technology under the guidance of Prof. Kun He.

My research interests lie within Multimodal Learning, Large-scale Pre-training and Efficient NLP. I'm also involved in Machine Learning problems like Adversarial Robustness.


  • [2021/08] Three papers have been accepted by EMNLP 2021.
  • [2021/05] One paper has been accepted by ACL 2021 as oral presentation.
  • [2019/07] I attended ACL 2019 in Florence, Italy and gave a talk.
  • [2019/05] One paper has been accepted by ACL 2019 as oral presentation.
  • [2019/02] I attended the Artificial Intelligence Winter Camp at The University of California, Berkeley and Stanford University.

Selected Publications (Full List)

Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification
Shuhuai Ren, Jinchao Zhang, Lei li, Xu Sun*, Jie Zhou
EMNLP 2021 (Long Paper)
Paper Code& Model
Dynamic Knowledge Distillation for Pre-trained Language Models
Lei Li, Yankai Lin, Shuhuai Ren, Peng Li, Jie Zhou, Xu Sun*
EMNLP 2021 (Long Paper, Oral)
Paper Code& Model
Learning Relation Alignment for Calibrated Cross-modal Retrieval
Shuhuai Ren, Junyang Lin, Guangxiang Zhao, Rui Men, An Yang, Jingren Zhou, Xu Sun*, Hongxia Yang
ACL 2021 (Long Paper, Oral)
Paper Code& Model
Generating Natural Language Adversarial Examples through Probability Weighted Word Saliency
Shuhuai Ren, Yihe Deng, Kun He*, Wangxiang Che
ACL 2019 (Long Paper, Oral)
Paper Code& Model


Ph.D. in Computer Science, Peking University, Beijing, China
2020 - 2025 (expected)
B.Eng. in Software Engineering, Huazhong University of Science and Technology, Wuhan, China
GPA: 3.95/4.00; Rank: 4/180
2016 - 2020

Selected Awards and Competitions

Peking University (PKU),  Sep. 2020 - Jul. 2025 (Expected)

  • The third Prize of Peking University Scholarship, 2020-21
  • Award for Scientific Research, 2020-21

  • Huazhong University of Science and Technology (HUST),  Sep. 2016 - Jul. 2020

  • Pacemaker to Merit Student (The highest honor of undergraduate students),  2017-18
  • National Scholarship of China,  2017-18
  • Outstanding Graduates of HUST,  2020
  • Outstanding Undergraduate Thesis,  2020
  • Baosteel Scholarship,  2019
  • Hainan Airlines Scholarship,  2016-17
  • American College Students Mathematical Modeling Competition (MCM/ICM), Honorable Mention,  2018
  • Academic Service

  • Reviewer/Program committee: ACL (2021 Outstanding Reviewer Award, 2022), EMNLP (2021), NAACL (2022), ARR (2021, 2022), COLING (2020, 2022)
  • Teaching assistant: Introduction to Natural Language processing (PKU, 2021 Fall), Artificial Intelligence Frontier and Industry Trends (PKU, 2022 Spring)
  • Work Experience

    Research Intern
    Alibaba, DAMO Academy
    Advised by Junyang Lin and Hongxia Yang
    Beijing, China
    Aug. 2020 - Feb. 2021
    Research Intern
    Tencent, WeChat AI (WXG-PRC)
    Advised by Jinchao Zhang
    Beijing, China
    Oct. 2019 - Jun. 2020
    Research Intern
    HUST, John Hopcroft Lab for Data Science
    Advised by Kun He
    Wuhan, China
    Mar. 2018 - Oct. 2019


  • 数据增广、业务处理方法、装置、计算机设备和存储介质 [link]:任抒怀;张金超