Shaoshen Chen

Shaoshen Chen 陈少深
Google Scholar / Github / Email

Hi! I am a Master's student at Tsinghua University, beginning from 2024 Fall, advised by Prof. Haitao Zheng. I am currently interning at the GLM Multimodal Pretraining Team at Zhipu.

I will graduate in 2027 and am actively seeking opportunities.✨

My research interests mainly lie in:

• Long-Context LLMs: Building structured representations and compression methods for efficient long-context inference.
• Multimodal Models: Building, pretraining, and aligning multimodal foundation models for diverse downstream tasks.

Publications

* denotes equal contribution.

• [NeurIPS 2025] AdmTree: Compressing Lengthy Context with Adaptive Semantic Trees. [paper]

  • Yangning Li*, Shaoshen Chen*, Yinghui Li, Yankai Chen, Hai-Tao Zheng, Hui Wang, Wenhao Jiang, Philip S. Yu
    

• [ACL Findings 2025] DAST: Context-aware Compression in LLMs via Dynamic Allocation of Soft Tokens. [paper] [code]

  • Shaoshen Chen*, Yangning Li*, Zishan Xu, Yongqin Zeng, Shunlong Wu, Xinshuo Hu, Zifei Shan, Xin Su, Jiwei Tang, Yinghui Li, Hai-Tao Zheng
    

• [ACL 2024] Towards Real-World Writing Assistance: A Chinese Character Checking Benchmark with Faked and Misspelled Characters. [paper] [code]

  • Yinghui Li*, Zishan Xu*, Shaoshen Chen*, Haojing Huang, Yangning Li, Shirong Ma, Yong Jiang, Zhongli Li, Qingyu Zhou, Hai-Tao Zheng, Ying Shen
    

• [ESWA 2024] Correct Like Humans: Progressive Learning Framework for Chinese Text Error Correction. [paper]

  • Yinghui Li*, Shirong Ma*, Shaoshen Chen*, Haojing Huang, Shulin Huang, Yangning Li, Hai-Tao Zheng, Ying Shen
    

• [SPL 2024] Robust Multi-Prototypes Aware Integration for Zero-Shot Cross-Domain Slot Filling. [paper]

  • Shaoshen Chen, Peijie Huang, Zhanbiao Zhu, Yexing Zhang, Yuhong Xu
    

• [TASLP 2024] ELSF: Entity-Level Slot Filling Framework for Joint Multiple Intent Detection and Slot Filling. [paper]

  • Zhanbiao Zhu, Peijie Huang, Haojing Huang, Yuhong Xu, Piyuan Lin, Leyi Lao, Shaoshen Chen, Haojie Xie, Shangjian Yin
    

🏆 Awards

• 2025 First-class Scholarship, Shenzhen International Graduate School, Tsinghua University
• 2023 National Scholarship in China
• 2022 First-class Scholarship, South China Agricultural University

📖 Educations

• 2024.09 - Present, Tsinghua University, M.S. in Computer Science
• 2020.09 - 2024.06, South China Agricultural University, B.E. in Computer Science