Tao Ji 紀焘

I’m currently an Assistant Professor and Ph.D. advisor at FudanNLP Lab and the English Dept., College of Foreign Languages and Literatures, Fudan University. I was previously a postdoc at FudanNLP Lab, advised by Profs. Xuanjing Huang, Qi Zhang, and Xipeng Qiu. I received my B.S. (2017) and Ph.D. (2023) in Computer Science from East China Normal University, advised by Profs. Yuanbin Wu and Xiaoling Wang.

Research

My research bridges Linguistics and Computer Science, focusing on the architectural design and development of Large Language Models (LLMs). I am particularly interested in ➊ Efficient infrastructure via algorithm-hardware co-design, ➋ Language-centric multimodal in-context learning, and ➌ Native long-context modeling in LLMs.

Openings: I am looking for motivated students and interns who are excited to build linguistics-inspired and/or compute-efficient LLMs. Apply here or reach out directly!

Sep 2025📜

Jul 2025📜

May 2025🎓

May 2025🎓

🎉 Two papers accepted to NeurIPS: one Spotlight (top 1.8%), one D&B Track

🎉 Two papers accepted to ACL: one Oral (top 2.6%), one Main (top 20.3%)

🎉 Congratulations to Yufang Liu on earning her Ph.D.! I had the honor of co-advising her on her AAAI21, EMNLP24, and ACL25 work. I deeply appreciate her self-driven, focused, and proactive approach to research and her well-rounded abilities. She is joining Meituan Research. Best wishes.

🎉 Congratulations to Yanting Liu on completing her Master’s degree! I was delighted to co-advise her on her EMNLP24 work. She is intelligent and hardworking. Though I wish she had pursue a Ph.D., I’m glad to see her moving forward—joining ByteDance to work on multimodal models. Best wishes.

NeurIPS25
Spotlight

Protein Design with Dynamic Protein Vocabulary

Nuowei Liu*, Jiahao Kuang*, Yanting Liu, Changzhi Sun, Tao Ji#, Yuanbin Wu#, Man Lan#

ACL25
Main

Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs

Tao Ji, Bin Guo, Yuanbin Wu, Qipeng Guo, Lixing Shen, Zhan Chen, Xipeng Qiu, Qi Zhang, Tao Gui#

ACL25
Oral

The Role of Visual Modality in Multimodal Mathematical Reasoning: Challenges and Insights

Yufang Liu$*$, Yao Du$*$, Tao Ji#, Jianing Wang, Yang Liu, Yuanbin Wu#, Aimin Zhou#, Mengdi Zhang, Xunliang Cai

EMNLP24
Oral

Investigating and Mitigating Object Hallucinations in Pretrained Vision-Language (CLIP) Models

Yufang Liu$*$, Tao Ji$*$, Changzhi Sun, Yuanbin Wu, Aimin Zhou

EMNLP24
Findings

LongHeads: Multi-Head Attention is Secretly a Long Context Processor

Yi Lu, Xin Zhou, Wei He, Jun Zhao, Tao Ji#, Tao Gui#, Qi Zhang#, Xuanjing Huang

ACL24
Findings

Length Generalization of Causal Transformers without Position Encoding

Jie Wang$*$, Tao Ji$*$, Yuanbin Wu#, Hang Yan, Tao Gui, Qi Zhang, Xuanjing Huang, Xiaoling Wang#

ACL19

Graph-based Dependency Parsing with Graph Neural Networks

Tao Ji, Yuanbin Wu, Man Lan

• 639 Foreign Languages and Literatures Building
  Handan Campus
  220 Handan Road, Shanghai 200433, China

• A5008, No. 2 Interdisciplinary Research Building
  Jiangwan Campus
  2005 Songhu Road, Shanghai 200438, China