1994-1999, B.Eng., Automation Department, Tsinghua University, Beijing, China

1999-2002, M. Sc., Automation Department, Tsinghua University, Beijing, China

2002-2006, Ph.D., Engineering Department, Cambridge University, Cambridge, U.K.

• Spring   Semester Intelligent Speech Technology

• Autumn Semester Natual Language Processing

• Autumn Semester Lectures on Advanced AI Technology

Selected Publication [Google Scholar]

Speech and Audio Processing

• ASR TDT-KWS: Fast and Accurate Keyword Spotting Using Token-and-duration Transducer
  Yu Xi, Hao Li, Baochen Yang, Haoyu Li, Hainan Xu and Kai Yu
  ICASSP 2024

• Signal Speech Enhancement With Integration of Neural Homomorphic Synthesis and Spectral Masking

Wenbin Jiang and Kai Yu
IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 31, pp. 1758-1770, 2023

• TTS Text-To-Speech With Latent Diffusion
  Zhijun Liu, Yiwei Guo and Kai Yu
  ICASSP 2023

• TTS VQTTS: High-Fidelity Text-to-Speech Synthesis with Self-Supervised VQ Acoustic Feature
  Chenpeng Du, Yiwei Guo, Xie Chen and Kai Yu
  Interspeech 2022

• RAA Towards Duration Robust Weakly Supervised Sound Event Detection
  Heinrich Dinkel, Mengyue Wu and Kai Yu
  IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 29, pp. 887-900, 2021

Natural Language Processing

• LLM SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Research
  Liangtai Sun, Yang Han, Zihan Zhao, Da Ma, Zhennan Shen, Baocai Chen, Lu Chen and Kai Yu
  AAAI 2024

• LLM Large Language Models Are Semi-Parametric Reinforcement Learning Agents.
  Danyang Zhang, Lu Chen, Situo Zhang, Hongshen Xu, Zihan Zhao and Kai Yu
  NeurIPS 2023

• NLP A Heterogeneous Graph to Abstract Syntax Tree Framework for Text-to-SQL
  Ruisheng Cao, Lu Chen, Jieyu Li, Hanchong Zhang, Hongshen Xu, Wangyou Zhang, Kai Yu
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), vol. 45, no. 11, pp. 13796-13813, 2023

NLP OPAL: Ontology-Aware Pretrained Language Model for End-to-End Task-Oriented Dialogue
Zhi Chen, Yuncong Liu, Lu Chen, Su Zhu, Mengyue Wu and Kai Yu
Transactions of the Association for Computational Linguistics (TACL), vol.11, pp. 68-84, 2022

• NLP LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relations
  Ruisheng Cao, Lu Chen, Zhi Chen, Yanbin Zhao, Su Zhu and Kai Yu
  ACL 2021

Multi-modal Interaction

• Avatar DIFFDUB: Person-generic Visual Dubbing Using Inpainting Renderer with Diffusion Auto-encoder
  Tao Liu, Chenpeng Du, Shuai Fan, Feilong Chen and Kai Yu
  ICASSP 2024

• Avatar DAE-Talker: High Fidelity Speech-Driven Talking Face Generation with Diffusion Autoencoder
  Chenpeng Du, Qi Chen, Tianyu He, Xu Tan, Xie Chen, Kai Yu, Sheng Zhao and Jiang Bian
  ACM-MM 2023

• GUI Towards Multi-modal Conversational Agents on Mobile GUI
  Liangtai Sun, Xingyu Chen, Lu Chen, Tianle Dai, Zichen Zhu and Kai Yu
  EMNLP 2022

• GUI TIE: Topological Information Enhanced Structural Reading Comprehension on Web Pages
  Zihan Zhao, Lu Chen, Ruisheng Cao, Hongshen Xu, Xingyu Chen and Kai Yu
  NAACL 2022

Best Paper Award

• EURASIP Speech Communication Best Paper Award

• International Symposium on Chinese Spoken Language Processing Best Paper Award

• ISCA Computer Speech and Language Best Paper Award

• Interspeech Best Paper Award

• IEEE SLT Best Paper Award

• NCMMSC Best Paper Award

National and Provincial Award

• Leading Talents in Scientific and Technological Innovation by Ministry of Science and Technology of China

• Excellent Young Researcher Fund by National Science Foundation of China (NSFC)

• Chinese Patent Excellence Award by China National Intellectual Property Administration

• Professor of Special Appointment (Eastern Scholar) at Shanghai Institutions of Higher Learning by Shanghai Municipal Education Commission

Professional Society Academic Award

• Bamboo Award by China Computer Federation (CCF)

• Distinguished Lecturer of Advanced Disciplines Lectures by China Computer Federation (CCF)

• Second Prize for Scientific and Technological Progress, WuWenJun AI Science and Technology Award by Chinese Association for Artificial Intelligence (CAAI)

• First Prize for Natural Science, WuWenJun AI Science and Technology Award by Chinese Association for Artificial Intelligence (CAAI)

Other Award

• Scientific Chinese (2016) Person of the Year by Scientific Chinese Magazine

Institute of Electrical and Electronics Engineers (IEEE)

• Fellow of IEEE

• Board Member of IEEE Signal Processing Society Conferences Board

• Board Member of IEEE Signal Processing Society Membership Board

• Member of IEEE Speech and Language Processing Technical Committee (2017-2019)

• Associate Editor of IEEE/ACM Transactions on Audio Speech and Language Processing (2019-2024)

• General Chair of ICASSP 2025 Satellite Event in Suzhou

International Speech Communication Association (ISCA)

• Fellow of ISCA

• Program Chair of Interspeech 2020

China Computer Federation (CCF)

• Distinguished Member of CCF

• Member of the 13th Council of CCF

• Director of the Speech, Dialogue and Auditory Processing Technical Committee of CCF

• Standing Committee Member of the Large Model Forum of CCF

Chinese Information Processing Society of China (CIPSC)

• Member of the 9th Council of CIPSC

• Associate Director of the Speech Information Processing Technical Committee of CIPSC

Industry Service

• Director of the National AI Open Innovation Platform on Language Computing, Ministry of Science and Technology of China (MOST)

• Member of the AI Key Technology and Application Evaluation Academic Committee of the Key Laboratory of the Ministry of Industry and Information Technology of China

• Member of the Information System User Interfaces Branch (TC28/SC35) of the National Information Technology Standardization Technical Committee

• Member of the 4th National Computer Science and Technology Terminology Approval Committee

• Director of the Academic and Intellectual Property Working Group of the China Artificial Intelligence Industry Alliance (AIIA)

• Associate Director of the Technical Committee of the Alliance of Intelligent Speech Technology Industry of China

Other Service

• Vice President of the Shanghai Overseas Returned Scholar Association (SORSA)

• Chairman of the AI Branch of SORSA

• Member of the Young Scientists Committee of the World Laureates Forum

Academic Conference Service

• ICASSP

• IEEE SLTC Member

• General Chair of ICASSP 2025 Satellite Event

• Interspeech

• Program Chair, Area Chair (Speech Recognition/Dialogue Systems)

• EUSIPCO

• Area chair (Speech Processing)

• ACL

• (Senior) Area chair/Meta-reviewer/Action Editor of ARR (Dialogue Systems/Spoken Language Technology)

• NAACL

• Area chair/Meta-reviewer/Action Editor of ARR (Dialogue Systems)

• EMNLP

• Area chair/Meta-reviewer/Action Editor of ARR (Dialogue Systems)

• NeurIPS

• Area Chair

• SigDial

• Program Chair

• ICMI

• Program Chair

• NCMMSC

• General Chair, Program Chair

Reviewer Service

• Journal

• IEEE/ACM Transactions on Audio, Speech, and Language Processing

• IEEE Transactions on Pattern Analysis and Machine Intelligence

• IEEE Signal Processing Letters

• IEEE Signal Processing Magazine

• Speech Communication

• Computer Speech and Language

• Journal of Computer Science (Chinese)

• Journal of Automation (Chinese)

• Conference

• ICASSP, Interspeech, IEEE ASRU, IEEE SLT, APSIPA, ISCSLP, NCMMSC

• ACL/NAACL/EACL, EMNLP, SigDial

• AAAI, NeurIPS

• Proposal and Award

• EPSRC, U.K.

• Science and Engineering Research Council, Agency for Science and Technology Research, Singapore

• Israel Science Foundation (ISF), Israel

• Foundation for Polish Science

• Research Grants Council (RGC) of Hong Kong

• National Natural Science Foundation of China

• Ministry of Science and Technology of China

• Ministry of Industry and Information Technology of China

• Ministry of Education of China

• Chinese Academy of Sciences