Shun Lu 陆顺

PHD Candidate
Email: lushun901@gmail.com

News

2023.03.31: We are excited to announce that our lightweight software, StarLight, has been released !
2023.02.28: Our paper PA&DA is accepted by CVPR 2023 !
2022.11.19: Our paper PINAT is accepted by AAAI 2023 !
2022.06.15: Our paper ConformerNAS and WA-Transformer are accepted by Interspeech 2022 !
2021.10.16: Our paper DU-DARTS is accepted by BMVC 2021 !
2021.09.29: Our paper TANSP is accepted by NeurIPS 2021 !
2021.05.26: Our team ranked 2nd among all teams in CVPR 2021 NAS Track 2: Performance Prediction Track !
2021.05.26: Our team ranked 2nd among all teams in CVPR 2021 NAS Track 1: Supernet Track !

Biography

Shun Lu holds a Bachelor's degree from Beijing University of Science and Technology (USTB) and I am currently a PhD student at the Institute of Computing Technology (ICT), advised by Yu Hu. My research focuses on the field of computer science, with a particular emphasis on developing algorithms to search for efficient models and compress models. I am passionate about exploring new approaches to these problems and have been fortunate enough to work on several exciting projects during my time at ICT. I am excited to continue my research in this field and to contribute to the advancement of computer science and technology.

My research interests include neural architecture search, model compression, audio separation, speaker verification, and semantic segmentation. Regarding neural architecture search, I am working on developing automated methods to design and optimize neural network architectures. This involves exploring different network topologies and architectures to find the optimal solution for a given task. I believe that this research will have significant impact on the development of artificial intelligence and machine learning, and I am excited to be a part of this exciting field.

Projects

StarLight: An Open-Source AutoML Toolkit for Lightweighting Deep Neural Networks
Shun Lu, Longxing Yang, Zihao Sun, Jilin Mei, Yu Hu*
[Code][Demo][Tutorial]

Selected Publications

PA&DA: Jointly Sampling Path and Data for Consistent NAS
Shun Lu, Yu Hu*, Longxing Yang, Zihao Sun, Jilin Mei, Jianchao Tan, Chengru Song
[CVPR 2023][Paper][Code]

PINAT: A Permutation INvariance Augmented Transformer for NAS Predictor
Shun Lu, Yu Hu*, Peihao Wang, Yan Han, Jianchao Tan, Jixiang Li, Sen Yang, Ji Liu
[AAAI 2023][Paper][Code]

Conformer Space Neural Architecture Search for Multi-Task Audio Separation
Shun Lu^†, Yang Wang^†, Peng Yao^†, Chenxing Li, Jianchao Tan, Feng Deng, Xiaorui Wang, Chengru Song
[Interspeech 2022][Paper]

DU-DARTS: Decreasing the Uncertainty of Differentiable NAS
Shun Lu, Yu Hu*, Longxing Yang, Zihao Sun, Jilin Mei, Yiming Zeng, Xiaowei Li
[BMVC 2021][Paper][Code]

TNASP: A Transformer-based NAS Predictor with a Self-evolution Framework
Shun Lu, Jixiang Li, Jianchao Tan, Sen Yang, Ji Liu
[NeurIPS 2021][Paper]

Searching for BurgerFormer with Micro-Meso-Macro Space Design
Longxing Yang, Yu Hu*, Shun Lu, Zihao Sun, Jilin Mei, Yinhe Han, Xiaowei Li
[ICML 2022][Paper][Code]

AGNAS: Attention-Guided Micro and Macro-Architecture Search
Zihao Sun, Yu Hu*, Shun Lu, Longxing Yang, Jilin Mei, Yinhe Han, Xiaowei Li
[ICML 2022][Paper][Code]

DDSAS: Dynamic and Differentiable Space-Architecture Search
Longxing Yang, Yu Hu*, Shun Lu, Zihao Sun, Jilin Mei, Yiming Zeng, Zhiping Shi, Yinhe Han, Xiaowei Li
[ACML 2021][Paper][Code]

SpeechNAS: Towards Better Trade-off between Latency and Accuracy for Large-Scale Speaker Verification
Wentao Zhu^†, Tianlong Kong^†, Shun Lu, Jixiang Li, Dawei Zhang, Feng Deng, Xiaorui Wang, Sen Yang, Ji Liu
[ASRU 2021][Paper][Code]

DARTS-: Robustly Stepping out of Performance Collapse Without Indicators
Xiangxiang Chu, Xiaoxing Wang, Bo Zhang, Shun Lu, Xiaolin Wei, Junchi Yan
[ICLR 2021][Paper][Code]

STC-NAS: Fast neural architecture search with source-target consistency
Zihao Sun, Yu Hu*, Longxing Yang, Shun Lu, Jilin Mei, Yinhe Han, Xiaowei Li
[Neurocomputing][Paper]

Dynamic coherent diffractive imaging with a physics-driven untrained learning method
Dongyu Yang, Junhao Zhang, Ye Tao, Wenjin Lv, Xinkai Sun, Shun Lu, Hao Chen, Wenhui Xu, Yishi Shi
[Optics Express][Paper]

MixPath: A Unified Approach for One-shot Neural Architecture Search
Xiangxiang Chu, Xudong Li, Shun Lu, Bo Zhang, Jixiang Li
[arXiv 2020][Paper][Code]

Competitions

CVPR 2021 NAS Track 1: Supernet Track, Rank 2nd among all teams from the world.
Shun Lu, Longxing Yang, Jilin Mei
CVPR 2021 NAS Track 2: Performance Prediction Track, Rank 2nd among all teams from the world.
Shun Lu, Jixiang Li, Jianchao Tan

Academic Services

Conference Reviewer

IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2022
European Conference on Computer Vision (ECCV) 2022
International Conference on Computer Vision (ICCV) 2023
International Conference on Machine Learning (ICML) 2022, 2023
Neural Information Processing Systems (NeurIPS) 2022, 2023

Honors and Awards

2023, 中国科学院大学三好学生标兵