I am a final-year direct-entry PhD student at the Institute of Information Engineering, Chinese Academy of Sciences, jointly supervised by Professors Peng Fu, Zheng Lin, and Weiping Wang. My research focuses on efficient post-training and efficient model architectures for large language models. Previously, I had the privilege of being mentored by Dr. Haifeng Wang.

🔥 News

• 2026.09:  🎉🎉 Three papers are accepted by NIPS 2026.
• 2026.08:  🎉🎉 Two papers are accepted by EMNLP 2026.
• 2026.05:  🎉🎉 One paper is accepted by ACL 2026.
• 2025.08:  🎉🎉 Our Trans-PEFT is selected for the ACL2025 SAC Highlights Award (Top 1.5%).
• 2025.08:  🎉🎉 Two papers are accepted by EMNLP 2025.
• 2025.05:  🎉🎉 Three papers are accepted by ACL 2025.

📝 Selected Publications (Full List)

📄 Technical Reports

• [Baidu Foundation Model Report] ERNIE 5.0 Technical Report

• [Technical Report 2026] EasyVideoR1: Easier RL for Video Understanding

⚡ Efficient Post-Training

• [Preprint] CompassOPD: Cross-Family On-Policy Distillation via Within-Family Likelihood Shifts
  Naibin Gu, Qingyi Si, Chenxu Yang, Chuanyu Qin, Junhao Zhou, Peng Fu, Zheng Lin, Weiping Wang

• [NeurIPS 2026] Co-Evolving Policy Distillation
  Naibin Gu, Chenxu Yang, Qingyi Si, Chuanyu Qin, Dingyu Yao, Peng Fu, Zheng Lin, Weiping Wang, Nan Duan, Jiaqi Wang

• [ACL 2025 Oral] Adapt Once, Thrive with Updates: Transferable Parameter-Efficient Fine-Tuning on Evolving Base Models — 🥇 SAC Highlights Award, Top 1.5%
  Naibin Gu, Peng Fu, Xiyu Liu, Ke Ma, Zheng Lin, Weiping Wang

• [ACL 2025] BeamLoRA: Beam-Constraint Low-Rank Adaptation
  Naibin Gu, Zhenyu Zhang, Xiyu Liu, Peng Fu, Zheng Lin, Shuohuan Wang, Yu Sun, Hua Wu, Weiping Wang, Haifeng Wang

• [EMNLP 2025] CBP-Tuning: Efficient Local Customization for Black-box Large Language Models
  Jiaxuan Zhao^*, Naibin Gu^*, Yuchen Feng, Xiyu Liu, Peng Fu, Zheng Lin, Weiping Wang

• [Findings of ACL 2024] Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning
  Naibin Gu, Peng Fu, Xiyu Liu, Bowen Shen, Zheng Lin, Weiping Wang

• [ACL 2023] A Gradient Control Method for Backdoor Attacks on Parameter-Efficient Tuning
  Naibin Gu, Peng Fu, Xiyu Liu, Zhengxiao Liu, Zheng Lin, Weiping Wang

• [EMNLP 2025] Weights-Rotated Preference Optimization for Large Language Models
  Chenxu Yang, Ruipeng Jia, Mingyu Zheng, Naibin Gu, Zheng Lin, Siyuan Chen, Weichong Yin, Hua Wu, Weiping Wang

🧩 Efficient Model Architectures

• [Findings of EMNLP 2026] CoRe-MoE: Compact Reusable MoE for Continual Multimodal Instruction Tuning
  Runze Liu^*, Naibin Gu^*, Mingxu Ai, Yuqing Li, Peng Fu, Zheng Lin, Weiping Wang

• [Preprint] Mixture of Universal Experts: Scaling Virtual Width via Depth-Width Transformation
  Yilong Chen^*, Naibin Gu^*, Junyuan Shang, Zhenyu Zhang, Yuchen Feng, Jiawei Sheng, Tingwen Liu, Shuohuan Wang, Yu Sun, Hua Wu, Haifeng Wang

• [Preprint] Elastic MoE: Unlocking the Inference-Time Scalability of Mixture-of-Experts
  Naibin Gu, Zhenyu Zhang, Yuchen Feng, Yilong Chen, Peng Fu, Zheng Lin, Shuohuan Wang, Yu Sun, Hua Wu, Weiping Wang, Haifeng Wang

• [EMNLP 2026] Advantageous Parameter Expansion Training Makes Better Large Language Models
  Naibin Gu, Yilong Chen, Zhenyu Zhang, Peng Fu, Zheng Lin, Shuohuan Wang, Yu Sun, Hua Wu, Weiping Wang, Haifeng Wang

• [CVPR 2026] Blink: Dynamic Visual Token Resolution for Enhanced Multimodal Understanding
  Yuchen Feng^*, Zhenyu Zhang^*, Naibin Gu, Yilong Chen, Peng Fu, Zheng Lin, Shuohuan Wang, Yu Sun, Hua Wu, Weiping Wang, Haifeng Wang

• [ACL 2025] DIVE into MoE: Diversity-Enhanced Reconstruction of Large Language Models from Dense into Mixture-of-Experts
  Yuchen Feng^*, Bowen Shen^*, Naibin Gu, Jiaxuan Zhao, Peng Fu, Zheng Lin, Weiping Wang

🤝 Other Collaborative Papers

• [IJCAI 2026] Causal Path Alignment: Anchoring the Optimization Trajectory for Controllable In-Parameter Knowledge Editing
  Xiyu Liu, Zhengxiao Liu, Naibin Gu, Zheng Lin, Weiping Wang

• [AAAI 2025] Relation Also Knows: Rethinking the Recall and Editing of Factual Associations in Auto-Regressive Transformer Language Models
  Xiyu Liu, Zhengxiao Liu, Naibin Gu, Zheng Lin, Wanli Ma, Ji Xiang, Weiping Wang

^* Equal contribution.

📖 Educations

• Sept. 2022 - Now: PhD student, Institute of Information Engineering (IIE), CAS & UCAS.
• Sept. 2018 - Jun. 2022: Bachelor of Computer Science, China Agricultural University.

💻 Internships

• 2025.06 - 2026.01, ERNIE Star Top Talent Research Intern at the NLP Department, Baidu Inc. Mentor: Haifeng Wang and Zhenyu Zhang
• 2024.10 - 2025.05, Research Intern at the NLP Department, Baidu Inc. Mentor: Zhenyu Zhang