avatar

Zujie Liang

To the stars, through hardships.

Bio

My name is Zujie Liang (梁祖杰). I am currently a Senior R&D AI Engineer at Ant Group (FinTech giant in China). Now I am exploring leverage LLM-based Agents to improve credit business and risk management. My recent research focuses on LLM Agents, KG Reasoning, Hallucination Alleviation, PEFT.

Before that, I obtained my M.S. degree from Sun Yat-Sen University (SYSU) in 2022. My previous research broadly lies at the intersection of Natural Language Processing and Computer Vision, with a focus on three areas: 1) multimodal bias reduction; 2) open-ended Conversational AI; 3) flexible/controllable text generation. I was very interested in understanding various human-centric properties of AI models, such as interpretability, generalization, causality, fairness and bias.

I’m always open to discussion or collaboration. Please check my CV for latest update and drop me an E-mail if you’re interested.

News

  • [01/2025] One paper is accepted by ICLR 2025.
  • [09/2024] One paper is accepted by EMNLP 2024.
  • [05/2024] One paper is accepted by Findings of ACL 2024.
  • [08/2023] One paper is accepted by CIKM 2023.
  • [06/2023] Hosted Ant FinTech AI Challenge (AFAC2023) at TIANCHI.
  • [05/2023] One paper about Lottery Prompt Tuning is accepted by ACL 2023.
  • [07/2022] I start my journey at Ant Group.
  • [04/2022] One paper is accepted by ICMR 2022.
  • [08/2021] One paper on recommender dialogue system is accepted by EMNLP 2021.
  • [06/2021] I am offered an ACM SIGIR 2021 Student Travel Grant.
  • [06/2021] I serve as PC Member for NLPCC 2021.
  • [05/2021] One paper on visual knowledge powered conversational agent is accepted by ACL 2021.
  • [03/2021] One paper on De-biased VQA is accepted by SIGIR 2021.
  • [09/2020] One paper on Robust VQA is accepted by EMNLP 2020.

Publications

  • SLMRec: Empowering Small Language Models for Sequential Recommendation
    Wujiang Xu, Qitian Wu, Zujie Liang, Jiaojiao Han, Xuying Ning, Yunxiao Shi, Wenfang Lin, Yongfeng Zhang
    ICLR 2025. [paper]

  • MultiLingPoT: Enhancing Mathematical Reasoning with Multilingual Program Fine-tuning
    Nianqi Li, Zujie Liang, Siyu Yuan, Jiaqing Liang, Feng Wei, Yanghua Xiao
    preprint. [paper]

  • Past Meets Present: Creating Historical Analogy with Large Language Models
    Nianqi Li, Siyu Yuan, Jiangjie Chen, Jiaqing Liang, Feng Wei, Zujie Liang, Deqing Yang, Yanghua Xiao
    preprint. [paper]

  • QUILL: Quotation Generation Enhancement of Large Language Models
    Jin Xiao, Bowei Zhang, Qianyu He, Jiaqing Liang, Feng Wei, Jinglei Chen, Zujie Liang, Deqing Yang, Yanghua Xiao
    preprint. [paper]

  • Segment+: Long Text Processing with Short-Context Language Models
    Wei Shi, Shuang Li, Kerun Yu, Jinglei Chen, Zujie Liang, Xinhui Wu, Yuxi Qian, Feng Wei, Bo Zheng, Jiaqing Liang, Jiangjie Chen, Yanghua Xiao
    EMNLP 2024. [paper]

  • Teaching Large Language Models to Express Knowledge Boundary from Their Own Signals
    Lida Chen, Zujie Liang, Xintao Wang, Jiaqing Liang, Yanghua Xiao, Feng Wei, Jinglei Chen, Zhenghong Hao, Bing Han, Wei Wang
    preprint. [paper]

  • CR-LLM: A Dataset and Optimization for Concept Reasoning of Large Language Models
    Nianqi Li, Jingping Liu, Sihang Jiang, Haiyun Jiang, Yanghua Xiao, Jiaqing Liang, Zujie Liang, Feng Wei, Jinglei Chen, Zhenghong Hao, Bing Han
    ACL 2024 (Findings). [paper]

  • Hierarchical Prompt Tuning for Few-Shot Multi-Task Learning
    Jingping Liu, Tao Chen, Zujie Liang, Haiyun Jiang, Yanghua Xiao, Feng Wei, Yuxi Qian, Zhenghong Hao, Bing Han.
    CIKM 2023. [paper]

  • Prompts Can Play Lottery Tickets Well: Achieving Lifelong Learning Information Extraction via Lottery Prompt Tuning
    Zujie Liang, Feng Wei, Jie Yin, Yuxi Qian, Zhenghong Hao, Bing Han.
    ACL 2023. [paper][code]

  • Maria: A Visual Experience Powered Conversational Agent
    Zujie Liang*, Huang Hu*, Can Xu, Chongyang Tao, Xiubo Geng, Yining Chen, Fan Liang, Daxin Jiang.
    ACL 2021. [paper][slides][code]

  • Learning Neural Templates for Recommender Dialogue System
    Zujie Liang*, Huang Hu*, Can Xu, Jian Miao, Yingying He, Yining Chen, Xiubo Geng, Fan Liang, Daxin Jiang
    EMNLP 2021. [paper][code]

  • LPF: A Language-Prior Feedback Objective Function for De-biased Visual Question Answering
    Zujie Liang, Haifeng Hu, Jiaying Zhu.
    SIGIR 2021. [paper][slides][code]

  • Learning to Contrast the Counterfactual Samples for Robust Visual Question Answering
    Zujie Liang, Weitao Jiang, Haifeng Hu, Jiaying Zhu.
    EMNLP 2020. [paper][slides][code]

  • TransPCC: Towards Deep Point Cloud Compression via Transformers
    Zujie Liang, Fan Liang.
    ICMR 2022. [paper][code]

Work Experiences

  • Ant Group,
    Senior R&D AI Engineer, July. 2022 - Present.
  • Microsoft,
    Research Intern, Oct. 2020 - June. 2021.
  • Alibaba,
    Ads Algorithm Intern, June. 2021 - Sept. 2021.
  • Huawei,
    Software Development Engineear Intern, Jun. 2018 - Sept. 2018.

Academic Services

  • Reviewer: ARR 2024, ICLR 2023, EACL 2023, ACL 2022, NLPCC 2022, NLPCC 2021, IJCAI 2021

Miscellanous