Yuyang Qin is an undergraduate in Chu Kochen Honors College, Zhejiang University, majored in automation. His major research insterest is to make robot smarter. Now he is focus on Artificial Intelligence and its collaborative computing system among robot clusters

πŸ”₯ News

  • 2023.09: Β πŸŽ‰πŸŽ‰ Yuyang Qin’s research Distributed Inference and Finetune System on Compressed Model Group and its Transformer-based Golden Model is funded by National Natural Science Foundation of China(NSFC)

πŸ“ Publications

Submitted to MobiCom 2024
sym

Confidant: Customizing Transformer-based LLMs via Collaborative Training on Mobile Devices

Yuhao Chen, Yuxuan Yan, Shuowei Ge, Yuyang Qin , Yue Zheng, Qianqian Yang, Yuanchao Shu, Shibo He, Zhiguo Shi, Jiming Chen

Submitted to ACM MobiCom 2024

  • ​ Used pipeline parallel training to fine-tune LLMs across multiple edge devices on different DNN frameworks.
  • ​ Proposed the inter-device dynamic model partitioning and the novel intra-device multi-processor scheduler.
  • ​ Introduced a hybrid fault tolerance mechanism that consists of both the passive fault tolerance method and a novel proactive fault tolerance method.

While the other three seniors built an Android App with JAVA and deployed it on mobile devices with MNN, I

  • ​ Built the Python version of the pipeline paralleled LLMs fine-tuning.
  • ​ Deployed the system onto edge devices such as NVIDIA Jetson Orin and Nano.
  • ​ Designed and implemented cross-framework adapters to conduct experiments across Jetsons and phones.

Python version of the Project

πŸŽ– Honors and Awards

  • 2023.09 Zichen Scholarship (10/year, Β₯20000)
  • 2023.09 First-class Prize Scholarship,Zhejiang University(1%)
  • 2023.05 First-Class Prize of Smart Robot Competition of Zhejiang University
  • 2019.12 First-Class Prize of CSP-S (Equal to NOIP) 2019

πŸ“– Educations

  • 2021.06 - now, Undergraduate, Chu Kochen Honors College, Zhejiang Univeristy, Hangzhou.
  • 2018.09 - 2021.06, Hangzhou Xuejun High School, Hangzhou.

ζ΅™ICP倇2023047645

Copyright Β© 2019-2024 Yuyang Qin All Rights Reserved.