|
Wang Tuowei「王 拓为」 Hello! I am a second-year Ph.D. student in the Department of Computer Science and Technology at Tsinghua University, advised by associate professor Ju Ren. I hold dual B.S. degrees in Computer Science and Finance, both from Tsinghua University. My research interests include high-performance computing, machine learning system, and large-scale AI4Science system. Feel free to contact me if you have any questions, want to discuss research ideas, or just talk about... life. My Email: wtw23 [AT] mails.tsinghua.edu.cn |
Publications |
|
LeMo: Enabling LEss Token Involvement for MOre Context Fine-tuning
Tuowei Wang,
Xingyu Chen, Kun Li, Ting Cao, Ju Ren, Yaoxue Zhang
We propose LeMo, the first LLM fine-tuning system that explores and exploits a new token-level sparsity mechanism inherent in long-context scenarios, termed Contextual Token Sparsity. |
|
Matryoshka: Optimization of Dynamic Diverse Quantum Chemistry Systems via Elastic Parallelism Transformation
Tuowei Wang,
Kun Li, Donglin Bai, Fusong Ju, Leo Xia, Ting Cao, Ju Ren, Yaoxue Zhang, Mao Yang
We propose Matryoshka, a novel elastically-parallel technique for the efficient execution of quantum chemistry system with dynamic diversity on GPU. |
|
Ripple: Accelerating LLM Inference on Smartphones with Correlation-Aware Neuron Management
Tuowei Wang*,
Ruwen Fan*, Minxing Huang, Zixu Hao, Kun Li, Ting Cao, Youyou Lu, Yaoxue Zhang, Ju Ren
We propose Ripple, a novel approach that accelerates LLM inference on smartphones by optimizing neuron placement in flash memory. |
|
Long Exposure: Accelerating Parameter-Efficient Fine-Tuning for LLMs under Shadowy Sparsity
Tuowei Wang*,
Kun Li*, Zixu Hao, Donglin Bai, Ju Ren, Yaoxue Zhang, Ting Cao, Mao Yang
We propose Long Exposure, an efficient system to accelerate parameter-efficient fine-tuning (PEFT) for LLMs under a nuanced form of sparsity we term Shadowy Sparsity. |
|
GAuV: A Graph-Based Automated Verification Framework for Perfect Semi-Honest Security of Multiparty Computation Protocols
Xingyu Xie, Yifei Li, Wei Zhang,
Tuowei Wang,
Shizhen Xu, Jun Zhu, Yifan Song
|
|
FedINC: An Exemplar-Free Continual Federated Learning Framework with Small Labeled Data
Yongheng Deng, Sheng Yue,
Tuowei Wang,
Guanbo Wang, Ju Ren, Yaoxue Zhang
|
|
Optimizing DNNs With Partially Equivalent Transformations and Automated Corrections
Haojie Wang, Jidong Zhai, Mingyu Gao, Feng Zhang,
Tuowei Wang,
Zixuan Ma, Shizhi Tang, Liyan Zheng, Wen Wang, Kaiyuan Rong, Yuanyong Chen, Zhihao Jia
|
|
EINNET: Optimizing tensor programs with Derivation-Based transformations
Liyan Zheng, Haojie Wang, Jidong Zhai, Muyan Hu, Zixuan Ma,
Tuowei Wang,
Shuhong Huang, Xupeng Miao, Shizhi Tang, Kezhao Huang, Zhihao Jia
|
Competitions |
|
National College Student Information Security Context, First Prize (2023) National College Student Computer System Development Capability Competition, First Prize (2022) |
Awards |
|
Outstanding Graduate of the Department, Tsinghua University (2023) Comprehensive Excellence Scholarship, Tsinghua University (2022) Excellence Scholarship of Sports and Literary, Tsinghua University (2021) Comprehensive Excellence Scholarship, Tsinghua University (2020) Comprehensive Excellence Scholarship, Tsinghua University (2019) |
|
|
