Yujia Wang

About

I am a Ph.D. candidate in the College of Information Sciences and Technology, Penn State University, fortunate to be advised by Prof. Jinghui Chen . Previously, I obtained my M.S. in Applied Statistics in the Department of Statistics at the Univerisity of Michigan, and my B.S. in Statistics in the College of Mathematics at Sichuan University.

I aim to build the next generation of collaborative intelligence systems. Just as the internet protocol reshaped how information is shared, my research seeks to establish the foundational infrastructure for collaborative learning through advanced optimization theory. My current research focuses on the theoretical foundations and practical methodologies of collaborative and privacy-preserving machine learning and optimization, including:

• Efficient and scalable federated learning in heterogeneous networks
• Generative methodologies in federated and collaborative learning
• Optimization methods tailored for the era of generative AI

News

Publications

Submitted Papers

1. Stragglers Can Contribute More: Uncertainty-Aware Distillation for Asynchronous Federated Learning
   Yujia Wang, Fenglong Ma, and Jinghui Chen
   Submitted.
2. Communication-Computation Parallel Block Coordinate Federated Learning for Large Language Models
   Yujia Wang, Yuanpu Cao, and Jinghui Chen
   Submitted.
3. Federated Learning with Projected Trajectory Regularization
   Tiejin Chen*, Yuanpu Cao*, Yujia Wang*, Cho-Jui Hsieh, and Jinghui Chen
   Submitted.

Conference and Journal Publications

1. AltLoRA: Towards Better Gradient Approximation in Low-Rank Adaptation with Alternating Projections
   Xin Yu, Yujia Wang, Jinghui Chen, and Lingzhou Xue
   In Proceedings of the 39th Annual Conference on Neural Information Processing Systems (NeurIPS), 2025.
   paper
2. JOPA: Explaining Large Language Model's Generation via Joint Prompt Attribution
   Yurui Chang*, Bochuan Cao*, Yujia Wang, Jinghui Chen, and Lu Lin
   In the 63rd Annual Meeting of the Association for Computational Linguistics (ACL Main), 2025.
   paper
3. On the Data Heterogeneity in Adaptive Federated Learning
   Yujia Wang, and Jinghui Chen
   In Transactions on Machine Learning Research (TMLR), 2024.
   paper
4. FADAS: Towards Federated Adaptive Asynchronous Optimization
   Yujia Wang, Shiqiang Wang, Songtao Lu, and Jinghui Chen
   In Proceedings of the 41st International Conference on Machine Learning (ICML), 2024.
   paper
5. Tackling the Data Heterogeneity in Asynchronous Federated Learning with Cached Update Calibration
   Yujia Wang, Yuanpu Cao, Jingcheng Wu, Ruoyu Chen, and Jinghui Chen
   In Proceedings of the 12th International Conference on Learning Representations (ICLR), 2024.
   paper
6. Communication-Efficient Adaptive Federated Learning
   Yujia Wang, Lu Lin, and Jinghui Chen
   In Proceedings of the 39th International Conference on Machine Learning (ICML), 2022.
   paper
7. Communication-Compressed Adaptive Gradient Method for Distributed Nonconvex Optimization
   Yujia Wang, Lu Lin, and Jinghui Chen
   In Proceedings of the 25th International Conference on Artificial Intelligence and Statistics (AISTATS), 2022.
   paper

Workshop Papers & Doctoral Forum

1. Towards Efficient Federated Learning in Heterogeneous Networks
   Yujia Wang
   In SIAM International Conference on Data Mining (SDM Doctoral Forum), 2024.
   
2. Accelerating Adaptive Federated Optimization with Local Gossip Communications
   Yujia Wang, Pei Fang, and Jinghui Chen
   International Workshop on Federated Learning: Recent Advances and New Challenges, NeurIPS 2022.
   

Experiences

Awards & Honors

Services