|
Hi, I'm Zheyu! I am a master student in Computational Linguistics at CIS, LMU Munich. Prior to that, I obtained my bachelor's degree in Computer Science and Mathematics from IFI, LMU Munich. I'm also an incoming PhD student at Technical University of Munich, advised by Gjergji Kasneci. I am broadly interested in natural language generation and model robustness and generalization. Email / GitHub / Google Scholar / LinkedIn / Twitter |
|
NewsJan '24 🦞 One paper is accepted to EACL 2024 and I will be in Malta as a student volunteer! Oct '23 🍻 One paper is accepted to BabyLM Challenge @CoNLL 2023! |
Publications |
|
mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language ModelsPeiqin Lin, Chengzhi Hu, Zheyu Zhang, André FT Martins, Hinrich Schütze EACL 2024 Findings paper / code / We evaluated the effectiveness of various mPLMs in measuring language similarity and improved zero-shot cross-lingual transfer performance based on the results. |
|
Baby’s CoThought: Leveraging Large Language Models for Enhanced Reasoning in Compact ModelsZheyu Zhang, Han Yang, Bolei Ma, David Rügamer, Ercong Nie EMNLP 2023 Workshop CoNLL-CMCL Shared Task BabyLM Challenge paper / code / poster / We proposed using LLMs to reconstruct existing data into NLU examples for training compact LMs, demonstrating the effectiveness of synthetic data in small LM training. |
Experience
|
Academic Service
|
|
|