publications

* denotes equal contribution and joint lead authorship.

2023

2023

  1. preprint
    Secrets of RLHF in Large Language Models Part I: PPO
    Rui Zheng, Shihan Dou, Songyang Gao, Wei Shen, Binghai Wang, Yan Liu, Senjie Jin, Qin Liu, Limao Xiong, Lu Chen, and others
    2023
  2. preprint
    Improving Generalization of Alignment with Human Preferences through Group Invariant Learning
    Rui Zheng, Wei Shen, Yuan Hua, Wenbin Lai, Shihan Dou, Yuhao Zhou, Zhiheng Xi, Xiao Wang, Haoran Huang, Tao Gui, and others
    2023
  3. ACL
    Characterizing the Impacts of Instances on Robustness
    Rui Zheng, Zhiheng Xi, Qin Liu, Wenbin Lai, Tao Gui, Qi Zhang, Xuanjing Huang, Jin Ma, Ying Shan, and Weifeng Ge
    In Findings of the Association for Computational Linguistics: ACL 2023, Toronto, Canada, July 9-14, 2023 2023
  4. ACL
    Detecting Adversarial Samples through Sharpness of Loss Landscape
    Rui Zheng, Shihan Dou, Yuhao Zhou, Qin Liu, Tao Gui, Qi Zhang, Zhongyu Wei, Xuanjing Huang, and Menghan Zhang
    In Findings of the Association for Computational Linguistics: ACL 2023, Toronto, Canada, July 9-14, 2023 2023

2022

2022

  1. ACL
    Robust Lottery Tickets for Pre-trained Language Models
    Rui Zheng, Bao Rong, Yuhao Zhou, Di Liang, Sirui Wang, Wei Wu, Tao Gui, Qi Zhang, and Xuanjing Huang
    In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022 2022
  2. COLING
    PlugAT: A Plug and Play Module to Defend against Textual Adversarial Attack
    Rui Zheng, Rong Bao, Qin Liu, Tao Gui, Qi Zhang, Xuanjing Huang, Rui Xie, and Wei Wu
    In Proceedings of the 29th International Conference on Computational Linguistics, COLING 2022, Gyeongju, Republic of Korea, October 12-17, 2022 2022