Zilin Huang

Research Associate
​Department of Civil and Environmental Engineering
University of Wisconsin-Madison
Office: Engineering Hall 1217
Email: zilin.huang@wisc.edu


Hi, thanks for stopping by! :wave:

I am currently a Research Associate at the University of Wisconsin–Madison and a Visiting Research Fellow at Purdue University. I am a founding member of Sky-Lab and a member of the Purdue Autonomous Go-Kart Initiative (PAGKI). I am also affiliated with the Center for Connected and Automated Transportation (CCAT), the Smart Highway Research Center (SHRC), and the Tribal and Rural Autonomous Vehicles for Efficiency, Livability and Safety (TRAVELS) Center. I received my Ph.D. and M.S. degrees from the University of Wisconsin–Madison, focusing on foundation models and human-guided reinforcement learning for autonomous driving, under the supervision of Prof. Sikai (Sky) Chen. Before joining UW–Madison, I worked as a Research Assistant with Prof. Samuel Labi at Purdue University. My work is driven by an interest in translating cutting-edge research into practical, real-world applications. Prior to my Ph.D. studies, I founded two technology companies in China.

📢 I am on the 2026–2027 academic job market and seeking faculty positions.


Research Statement

My research lies at the intersection of Physical AI and human-centered transportation systems. I envision future mobility as a human-robot-society ecosystem, where humans coexist, interact, and collaborate with diverse autonomous agents (e.g., autonomous vehicles, delivery robots, drones, and flying vehicles). These agents must understand complex physical and social environments, reason about their actions, adapt to human preferences and social norms, and remain safe and reliable under open-world uncertainty.

Building on this vision, my research aims to develop Human-centered and trustworthy autonomous (HEART) systems that can safely operate, interact, and continuously improve alongside humans in the physical world. This agenda centers on three questions: 1) How can autonomous agents understand complex physical and social environments and make safe, reliable, and socially aware decisions? 2) How can capabilities learned in simulation or from large-scale pretrained models be transferred and grounded in real physical systems across differences in embodiment, sensing, and hardware? 3) How can autonomous agents achieve safe recursive self-improvement through physical interaction, failure discovery, and real-world feedback?

To address these questions, I integrate VLMs, VLAs, and world models with reinforcement learning, cross-embodiment learning, Sim2Real transfer, closed-loop simulation, and real-world deployment. Ultimately, my goal is to advance safer, more efficient, and human-centered transportation systems where humans and autonomous agents can coexist and collaborate in the physical world.


Recent News View All

May 22, 2026 News thumbnail 🏆 I received the Best Presentation Award at NGTS 2026.
I returned to Purdue University for the 5th Next-Generation Transport Systems Annual Conference and received the Best Presentation Award. Read more →
May 14, 2026 News thumbnail 🌟 I received the College of Engineering Graduate Student Mentoring Award.
I received the College of Engineering Award for Graduate Student Mentorship and Service in recognition of excellence in research leadership. Read more →
May 8, 2026 News thumbnail 🎓 I celebrated my Ph.D. graduation at UW–Madison.
I attended the UW–Madison doctoral hooding ceremony and the College of Engineering and Department of Civil and Environmental Engineering commencement. Read more →
May 1, 2026 News thumbnail 🎓 I received the 2026 CEE Academic Stewardship and Leadership Award.
I received the 2026 Academic Stewardship and Leadership Award from the UW-Madison Department of Civil and Environmental Engineering. Read more →
Apr 10, 2026 News thumbnail 🎓 I successfully defended my Ph.D. dissertation.
I successfully defended my Ph.D. dissertation, Toward Safe, Trustworthy, and Deployable AI for Human-Centered Future Transportation. Read more →
Jun 15, 2025 News thumbnail 🎵 I attended CVPR 2025 in Nashville.
I attended CVPR 2025 in Nashville, where our team presented Talk2Traffic and connected with researchers working in computer vision, autonomous driving, robotics, and AI. Read more →
Mar 20, 2025 News thumbnail 🎉 We received two NVIDIA Academic Grant Program awards valued at $43,800.
We received two NVIDIA grants for transportation AI research, including 20,000 A100 GPU hours for SafetyGPT and two RTX PRO 6000 Blackwell GPUs for EdgeTwin. Read more →
Jan 12, 2025 News thumbnail 👏 I attended the TRB 2025 Annual Meeting.
I attended the TRB 2025 Annual Meeting in Washington, D.C., where our team presented research in poster and lectern sessions. Read more →
Jan 10, 2025 News thumbnail 👏 I was invited to visit Google.
I visited Google's Washington, D.C., office to meet with its research team and discuss potential collaborations. Read more →
Oct 18, 2024 News thumbnail 🎉 Our paper, Traffic expertise meets residual RL: Knowledge-informed model-based residual reinforcement learning for CAV trajectory control, was published in Communications in Transportation Research.

Selected Publications citations 1444
View All

  1. Preprint
    Sim2Real-AD: A Modular Sim-to-Real Framework for Deploying VLM-Guided Reinforcement Learning in Real-World Autonomous Driving 🔥
    Zilin Huang, Zhengyang Wan, Zihao Sheng, Boyue Wang, Junwei You, and Sikai Chen*
    arXiv preprint arXiv:2604.03497 (Preprint) , 2026
  2. Preprint
    DriveVLM-RL: Neuroscience-Inspired Reinforcement Learning with Vision-Language Models for Safe and Deployable Autonomous Driving 🔥
    Zilin Huang, Zihao Sheng, Zhengyang Wan, Yansong Qu, Junwei You, Sicong Jiang, and Sikai Chen*
    arXiv preprint arXiv:2603.18315 (Preprint) , 2026
  3. JICV
    Sky-Drive: A Distributed Multi-Agent Simulation Platform for Human-AI Collaborative and Socially-Aware Future Transportation 🔥
    Zilin Huang+, Zihao Sheng+, Zhengyang Wan+, Yansong Qu, Yuhao Luo, Boyue Wang, Pei Li, Yen-Jung Chen, Jiancong Chen, Keke Long, Jiayi Meng, Yue Leng, and Sikai Chen*
    Journal of Intelligent and Connected Vehicles (JICV) , 2025
  4. ICCV Workshop
    A Survey on Vision-Language-Action Models for Autonomous Driving 🔥
    Sicong Jiang+, Zilin Huang+, Kangan Qian+, Ziang Luo, Tianze Zhu, Yang Zhong, Yihong Tang, Menglin Kong, Yunlong Wang, Siwen Jiao, Hao Ye, Zihao Sheng, Xin Zhao, Tuopu Wen, Zheng Fu, Sikai Chen, Kun Jiang, Diange Yang, Seongjin Choi, and Lijun Sun
    In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshop (ICCV Workshop) , 2025
  5. TR-C
    CurricuVLM: Towards Safe Autonomous Driving via Personalized Safety-Critical Curriculum Learning with Vision-Language Models 🔥
    Zihao Sheng+, Zilin Huang+, Yansong Qu, Yue Leng, Sruthi Bhavanam, and Sikai Chen*
    Transportation Research Part C: Emerging Technologies (TR-C) , 2025
  6. TR-C
    VLM-RL: A Unified Vision Language Models and Reinforcement Learning Framework for Safe Autonomous Driving 🔥
    Zilin Huang+, Zihao Sheng+, Yansong Qu+, Junwei You, and Sikai Chen*
    Transportation Research Part C: Emerging Technologies (TR-C) , 2025
  7. TR-C
    PE-RLHF: Reinforcement Learning with Human Feedback and Physics Knowledge for Safe Autonomous Driving 🔥
    Zilin Huang, Zihao Sheng, and Sikai Chen*
    Transportation Research Part C: Emerging Technologies (TR-C) , 2025
  8. COMMTR
    Human as AI mentor: Enhanced human-in-the-loop reinforcement learning for safe and efficient autonomous driving 🔥
    Zilin Huang, Zihao Sheng, Chengyuan Ma, and Sikai Chen*
    Communications in Transportation Research (COMMTR) , 2024
  9. IEEE-TITS
    Toward C-V2X Enabled Connected Transportation System: RSU-Based Cooperative Localization Framework for Autonomous Vehicles 🔥
    Zilin Huang, Sikai Chen*, Yuzhuang Pian, Zihao Sheng, Soyoung Ahn, and David A Noyce
    IEEE Transactions on Intelligent Transportation Systems (IEEE-TITS) , 2024

Visitor Statistics