avatar

Zujie Liang

To the stars, through hardships.

Bio

My name is Zujie Liang (梁祖杰). I am currently a Senior R&D AI Engineer at Ant Group (FinTech giant in China). Now I am building LLM-based Agents to improve credit business including User Understanding, Knowledge Graph, Recommender System, and Risk Management. I have published 10+ papers at the top international AI conferences such as ICLR, ACL, EMNLP, SIGIR, CIKM. Before that, I obtained my M.S. degree from Sun Yat-Sen University (SYSU) in 2022.

My current research interests🔬 focus on:

  • LLM/VLM Agents: Building useful LLM/VLM Agents that leverage agentic capabilities to solve real-world tasks, including Agentic Memory [A-MEM], Agentic AutoML [I-MCTS], Shopping Agents [iAgent][NTRD], Multimodal Agents [Maria] (Probably one of the earliest attempts at VLM-based agents).

  • LLM Post-training: Exploring post-training, dedicated to efficient knowledge distillation [SLMRec], alleviating the hallucination [CoKE], and enhancing the reasoning capabilities [MultiLingPoT].

  • Long Context Processing: Enhancing the long context capablities of LLMs through sparse attention design [PowerAttention] and context management framework [SEGMENT+].

  • LLM PEFT: Developing practical approaches for effectively continual training [Lottery Prompt] and multi-task learning [HPT].

  • LLM Benchmarking: Benchmarking the performance of LLMs on several KG tasks, including Concept Reasoning [CR-LLM], Historical Analogy [PmP], and Quotation Generation [QUILL].

  • Multimodal Hallucination: Focusing on alleviating the multimodal hallucination caused by modality bias. [LPF][CL-VQA]

I’m always open to discussion or collaboration. Please check my CV for latest update and drop me an E-mail if you’re interested.

News

  • [01/2025] One paper is accepted by ICLR 2025.
  • [09/2024] One paper is accepted by EMNLP 2024.
  • [05/2024] One paper is accepted by Findings of ACL 2024.
  • [08/2023] One paper is accepted by CIKM 2023.
  • [06/2023] Hosted Ant FinTech AI Challenge (AFAC2023) at TIANCHI.
  • [05/2023] One paper about Lottery Prompt Tuning is accepted by ACL 2023.
  • [07/2022] I start my journey at Ant Group.
  • [04/2022] One paper is accepted by ICMR 2022.
  • [08/2021] One paper on recommender dialogue system is accepted by EMNLP 2021.
  • [06/2021] I am offered an ACM SIGIR 2021 Student Travel Grant.
  • [06/2021] I serve as PC Member for NLPCC 2021.
  • [05/2021] One paper on visual knowledge powered conversational agent is accepted by ACL 2021.
  • [03/2021] One paper on De-biased VQA is accepted by SIGIR 2021.
  • [09/2020] One paper on Robust VQA is accepted by EMNLP 2020.

Work Experiences

  • Ant Group,
    Senior R&D AI Engineer, July. 2022 - Present.
  • Alibaba,
    Ads Algorithm Intern, June. 2021 - Sept. 2021.
  • Microsoft,
    Research Intern, Oct. 2020 - June. 2021.
  • Huawei,
    SDE Intern, Jun. 2018 - Sept. 2018.

Publications

LLM/VLM Agents

  • A-MEM: Agentic Memory for LLM Agents
    Wujiang Xu, Zujie Liang, Kai Mei, Hang Gao, Juntao Tan, Yongfeng Zhang
    preprint. [paper][code]

  • I-MCTS: Enhancing Agentic AutoML via Introspective Monte Carlo Tree Search
    Zujie Liang, Feng Wei, Wujiang Xu, Lin Chen, Yuxi Qian, Xinhui Wu
    preprint. [paper][code]

  • InstructAgent: Building User Controllable Recommender via LLM Agent
    Wujiang Xu, Yunxiao Shi, Zujie Liang, Xuying Ning, Kai Mei, Kun Wang, Xi Zhu, Min Xu, Yongfeng Zhang
    preprint. [paper][code]

  • Maria: A Visual Experience Powered Conversational Agent
    Zujie Liang, Huang Hu, Can Xu, Chongyang Tao, Xiubo Geng, Yining Chen, Fan Liang, Daxin Jiang.
    ACL 2021. [paper][slides][code]

  • Learning Neural Templates for Recommender Dialogue System
    Zujie Liang, Huang Hu, Can Xu, Jian Miao, Yingying He, Yining Chen, Xiubo Geng, Fan Liang, Daxin Jiang
    EMNLP 2021. [paper][code]

LLM Post-training

  • SLMRec: Distilling Large Language Models into Small for Sequential Recommendation
    Wujiang Xu, Qitian Wu, Zujie Liang, Jiaojiao Han, Xuying Ning, Yunxiao Shi, Wenfang Lin, Yongfeng Zhang
    ICLR 2025. [paper][code]

  • Teaching Large Language Models to Express Knowledge Boundary from Their Own Signals
    Lida Chen, Zujie Liang, Xintao Wang, Jiaqing Liang, Yanghua Xiao, Feng Wei, Jinglei Chen, Zhenghong Hao, Bing Han, Wei Wang
    preprint. [paper]

  • MultiLingPoT: Enhancing Mathematical Reasoning with Multilingual Program Fine-tuning
    Nianqi Li, Zujie Liang, Siyu Yuan, Jiaqing Liang, Feng Wei, Yanghua Xiao
    preprint. [paper][code]

Long-context LLM

  • PowerAttention: Exponentially Scaling of Receptive Fields for Effective Sparse Attention
    Lida Chen, Dong Xu, Chenxin An, Xintao Wang, Yikai Zhang, Jiangjie Chen, Zujie Liang, Feng Wei, Jiaqing Liang, Yanghua Xiao, Wei Wang
    preprint. [paper][code]

  • Segment+: Long Text Processing with Short-Context Language Models
    Wei Shi, Shuang Li, Kerun Yu, Jinglei Chen, Zujie Liang, Xinhui Wu, Yuxi Qian, Feng Wei, Bo Zheng, Jiaqing Liang, Jiangjie Chen, Yanghua Xiao
    EMNLP 2024. [paper]

LLM PEFT

  • Prompts Can Play Lottery Tickets Well: Achieving Lifelong Learning Information Extraction via Lottery Prompt Tuning
    Zujie Liang, Feng Wei, Jie Yin, Yuxi Qian, Zhenghong Hao, Bing Han.

    ACL 2023. [paper][code]

  • Hierarchical Prompt Tuning for Few-Shot Multi-Task Learning
    Jingping Liu, Tao Chen, Zujie Liang, Haiyun Jiang, Yanghua Xiao, Feng Wei, Yuxi Qian, Zhenghong Hao, Bing Han.
    CIKM 2023. [paper]

LLM Benchmarking

  • CR-LLM: A Dataset and Optimization for Concept Reasoning of Large Language Models
    Nianqi Li, Jingping Liu, Sihang Jiang, Haiyun Jiang, Yanghua Xiao, Jiaqing Liang, Zujie Liang, Feng Wei, Jinglei Chen, Zhenghong Hao, Bing Han
    ACL 2024 (Findings). [paper]

  • Past Meets Present: Creating Historical Analogy with Large Language Models
    Nianqi Li, Siyu Yuan, Jiangjie Chen, Jiaqing Liang, Feng Wei, Zujie Liang, Deqing Yang, Yanghua Xiao
    preprint. [paper]

  • QUILL: Quotation Generation Enhancement of Large Language Models
    Jin Xiao, Bowei Zhang, Qianyu He, Jiaqing Liang, Feng Wei, Jinglei Chen, Zujie Liang, Deqing Yang, Yanghua Xiao
    preprint. [paper]

Multimodal Hallucination

  • LPF: A Language-Prior Feedback Objective Function for De-biased Visual Question Answering
    Zujie Liang, Haifeng Hu, Jiaying Zhu.
    SIGIR 2021. [paper][slides][code]

  • Learning to Contrast the Counterfactual Samples for Robust Visual Question Answering
    Zujie Liang, Weitao Jiang, Haifeng Hu, Jiaying Zhu.
    EMNLP 2020. [paper][slides][code]

Academic Services

  • Reviewer: ARR 2025, ARR 2024, ICLR 2023, EACL 2023, ACL 2022, NLPCC 2022, NLPCC 2021, IJCAI 2021

Miscellanous