Faculty

Email:ruhuima@sjtu.edu.cn
Address:电院3号楼229室
Institute:Institute of Scalable Computing
Brief Introduction
Ma Ruhui, Ph.D., is an Associate Professor and Ph.D. Supervisor at the School of Computer Science, Shanghai Jiao Tong University. He is a key member of the State Key Laboratory Cultivation Base (jointly established by the province and ministry), the Shanghai Key Laboratory of Scalable Computing and Systems, and the Shanghai Joint Cloud Computing Laboratory. He has received the Shanghai Technical Invention Award (First Prize) and the Jiangsu Provincial Science and Technology Progress Award (Third Prize). He was honored with the Outstanding Contribution Award at CollaborateCom 2022 and has been supported by the Shanghai Jiao Tong University Postdoctoral Fellowship Program and the IBM Ph.D. Talent Program. Under his supervision, students have won the Second Prize in the National Mathematical Modeling Competition, the First Prize in the Shanghai Mathematical Modeling Competition, and the Second Prize in the Eastern Division of the China University Students Service Outsourcing Innovation and Entrepreneurship Competition. He has also supervised undergraduate students who were recognized as Outstanding Undergraduate Graduates of Shanghai Jiao Tong University (top 1%) and awarded the "Shanghai Jiao Tong University Zhiyuan Honors Ph.D. Program" scholarship. His course, "Restructuring Discrete Computing Teaching for the Electrical and Electronic Disciplines," was awarded the Second Prize in the Shanghai Jiao Tong University Teaching Achievement Awards.
Dr. Ma Ruhui’s research team focuses on the construction and optimization of distributed intelligent computing systems, primarily addressing three closely related and mutually supportive directions:
Direction 1: Distributed Computing (Federated Learning and Distributed Machine Learning Systems)
This direction aims to address collaborative machine learning challenges in the context of data silos and privacy protection. Core research includes the optimization of federated learning algorithms (e.g., personalization, robustness, communication efficiency, knowledge distillation), the design of federated learning frameworks (e.g., cross-domain, blockchain-assisted), and their applications in areas such as recommendation systems, smart agriculture, and intelligent transportation. Research outcomes have been published in top-tier CCF-A conferences (e.g., KDD, ICCV, NeurIPS) and leading journals (e.g., ACM ToIS, ACM RecSys).
Direction 2: Cloud Computing Systems (Serverless and Emerging Computing Paradigms)
This direction explores next-generation cloud computing paradigms centered on serverless computing. Research covers performance bottleneck mitigation in serverless systems (e.g., cold start optimization, I/O acceleration, resource scheduling), novel application architectures (e.g., stream processing, big data analytics, model serving), and integration with technologies such as edge computing and quantum computing. Research outcomes have been systematically published in CCF-A journals (e.g., TACO, TC, TPDS, JSAC) and conferences (e.g., DAC).
Direction 3: Large Models and System Optimization (Inference Optimization and Cross-Disciplinary Applications)
This direction focuses on the practical deployment and system-level support technologies for large models such as Large Language Models (LLMs). Research includes efficient inference of large models (e.g., memory optimization, pipeline parallelism, load balancing on edge devices), domain-specific applications, and the security and optimization of distributed systems supporting large model operations. Research outcomes have been published in CCF-A/B conferences (e.g., ACL, EMNLP, ICCD) and journals (e.g., TACO).
Education
2008–2011, Shanghai Jiao Tong University, Ph.D. in Computer Architecture
Professional Experience
2018–Present, Shanghai Jiao Tong University, Associate Professor
2015–2017, Shanghai Jiao Tong University, Assistant Researcher
2013–2014, McGill University, Postdoctoral Fellow
2011–2015, Shanghai Jiao Tong University, Postdoctoral Fellow
Publications
Complete Publication List: Google Scholar
(I) Representative Publications in Cloud Computing Systems
[1] Lingxiao Jin, Zinuo Cai, Haoxin Wang, Zongpu Zhang, Ruhui Ma, Haibing Guan, Yuan Liu, Rajkumar Buyya, "Ephemera: Accelerating I/O-Intensive Serverless Workloads with a Harvested In-memory File System", ACM Transactions on Architecture and Code Optimization. 2025. (CCF-A, Corresponding Author)
[2] Junhan Liu, Zinuo Cai, Yumou Liu, Hao Li, Zongpu Zhang, Ruhui Ma, Rajkumar Buyya, "SMore: Enhancing GPU Utilization in Deep Learning Clusters by Serverless-based Co-location Scheduling", IEEE Transactions on Parallel and Distributed Systems, 2025. (CCF-A, Corresponding Author)
[3] Lingxiao Jin, Zinuo Cai, Zebin Chen, Hongyu Zhao, Ruhui Ma, "AARC: Automated Affinity-aware Resource Configuration for Serverless Workflows", Design Automation Conference, 2025. (CCF-A, Corresponding Author)
[4] Renjun Zhang, Tianming Zhang, Zinuo Cai, Dongmei Li, Ruhui Ma, Buyya Rajkumar. "MemoriaNova: Optimizing Memory-Aware Model Inference for Edge Computing". ACM Transactions on Architecture and Code Optimization, 2024. (CCF-A, Corresponding Author)
[5] Xinglei Chen, Zinuo Cai, Hanwen Zhang, Ruhui Ma, Rajkumar Buyya. "FasDL: An Efficient Serverless-Based Training Architecture with Communication Optimization and Resource Configuration", IEEE Transactions on Computers, 2024. (CCF-A, Corresponding Author)
(II) Representative Publications in Artificial Intelligence
[1] Peiwen Jiang, Haitong Jiang, Ruhui Ma, Yvonne Jie Chen, Jinhua Cheng, "TST: A Schema-Based Top-Down and Dynamic-Aware Agent of Text-to-Table Tasks", ACL Anthology, 2025. (CCF-A, Corresponding Author)
[2] Yicheng Di, Hongjian Shi, Xiaoming Wang, Ruhui Ma, Yuan Liu, "Federated Recommender System Based on Diffusion Augmentation and Guided Denoising", ACM Transactions on Information Systems, 2025. (CCF-A, Corresponding Author)
[3] Hongjian Shi, Weichu Zheng, Zifei Liu, Ruhui Ma and Haibing Guan, "Automatic Pipeline Parallelism: A Parallel Inference Framework for Deep Learning Applications in 6G Mobile Communication Systems", IEEE Journal on Selected Areas in Communications, 2023. (CCF-A, Corresponding Author)
[4] Jianqing Zhang, Yang Hua, Hao Wang, Tao Song, Zhengui Xue, Ruhui Ma, Haibing Guan, "FedCP: Separating Feature Information for Personalized Federated Learning via Conditional Policy", KDD, 2023. (CCF-A, Corresponding Author)
[5] Jianqing Zhang, Yang Hua, Hao Wang, Tao Song, Zhengui Xue, Ruhui Ma, Jian Cao, Haibing Guan, "GPFL: Simultaneously Learning Global and Personalized Feature Information for Personalized Federated Learning", CVPR, 2023. (CCF-A, Corresponding Author)
Awards
"Key Technologies for Low-Latency Cloud Computing Systems" won the First Prize of the Shanghai Technical Invention Award in 2020.
"ICT Cloud Open Platform Product Based on Converged Architecture and Its Large-Scale Applications" won the Third Prize of the Jiangsu Provincial Science and Technology Progress Award in 2016.
Outstanding Contribution Award, CollaborateCom 2022.
Second Prize of the Shanghai Jiao Tong University Teaching Achievement Award.