About

He is a PhD candidate in Computer Science and Engineering at The Chinese University of Hong Kong, supervised by Associate Professor Ming-Chang Yang. His research focuses on hardware-software co-optimization of computer systems, specifically including large language model inference optimization and high-performance indexing. His research has been published in top-tier conferences such as OSDI, SOSP, and ICML.

Education

PhD in Computer Science and Engineering

The Chinese University of Hong Kong (CUHK): 2020 - 2026 (Expected)

Bachelor of Engineering in Computer Science and Technology

Huazhong University of Science and Technology (HUST): 2016 - 2020

Publications

TileSparse: Arithmetic-Intensity-Aware Sparse Attention for Compute-Bound LLM Decoding

Chao Wang, Pengfei Zuo, Zhangyu Chen, Qihui Zhou, Tsung-Yi Ho, Ming-Chang Yang

ICML'26

SEPH: Scalable, Efficient, and Predictable Hashing on Persistent Memory

Chao Wang, Junliang Hu, Tsun-Yu Yang, Yuhong Liang, Ming-Chang Yang

OSDI'23 (First OSDI paper from CUHK)

Prefill-Decode Aggregation or Disaggregation? Unifying Both for Goodput-Optimized LLM Serving

Chao Wang, Pengfei Zuo, Zhangyu Chen, Yunkai Liang, Zhou Yu, Ming-Chang Yang

Under Review, FAIsys Workshop 2025, ArXiv, 公众号

THash: A High-Performance Tiered Hashing for CXL-Based Tiered Memory Systems

Han Zhao*, Chao Wang* (co-first author), Peiqi Yin, Hua Fan, Wenchao Zhou, James Cheng, Eric Lo, Ming-Chang Yang

Under Review

SparseServe: Unlocking Parallelism for Dynamic Sparse Attention in Long-Context LLM Serving

Qihui Zhou, Peiqi Yin, Pengfei Zuo, Chao Wang, James Cheng

ICS'26

CARINA: An Efficient CXL-Oriented Embedding Serving System for Recommendation Models

Peiqi Yin, Qihui Zhou, Xiao Yan, Chao Wang, Eric Lo, Changji Li, Lan Lu, Hua Fan, Wenchao Zhou, Ming-Chang Yang, James Cheng

SIGMOD'25

Aceso: Achieving Efficient Fault Tolerance in Memory-Disaggregated Key-Value Stores

Zhisheng Hu, Pengfei Zuo, Yizou Chen, Chao Wang, Junliang Hu, Ming-Chang Yang

SOSP'24 (Second SOSP paper from CUHK)

Academic Service

External Reviewer

OSDI'26, Eurosys'26, ICML'26, SoCC'26, HPCA'25, NSDI'25, FAST'24, ATC'24, SIGMOD'24, TOS'24, DAC'20-21, NAS'24, ASP-DAC'24, CODES'20~23, ICCAD'22, RTAS'21

Contact

Email: cwang@cse.cuhk.edu.hk

Department: Computer Science and Engineering

University: The Chinese University of Hong Kong