About me
I am curretly a research scientist at JPMorgan AI Research. My research interest lies in reinforcement learning, foundation models, and the robustness of machine learning models. Recently, I have been primarily focused on building LLM-powered autonomous agents and multi-modal foundation models for sequential decision-making.
I obtained my Ph.D. degree from the University of Maryland, College Park, where I am fortunate to be advised by Prof. Furong Huang. My Ph.D. research mainly focuses on reinforcement learning (RL) and trustworthy machine learning. Here is my thesis: thesis.
I am open to research collaborations! Here are my CV and my Research Statement.News and Highlights
| [2023.7] |
Our paper about generalist agent has been accepted by ICCV 2023: Paper Link.
|
| [2023.7] |
I am co-organizing the workshop
PerDream: PERception, Decision making and REAsoning through Multimodal foundational modeling in ICCV 2023.
Check out our website: Website.
|
| [2023.1] |
We have 3 papers (1 spotlight, 2 posters) accepted by ICLR 2023!
|
| [2022.11] |
I am co-organizing the first workshop on Reincarnating RL in ICLR 2023.
Check out our website: reincarnating-rl.github.io.
|
| [2022.09] |
We have 3 papers accepted by NeurIPS 2022. Many thanks to my collaborators!
|
| [2022.01] |
Two of our papers have been accepted by ICLR 2022. Please check out our papers on adversarial RL and transfer RL.
|
| [2021.12] | Our paper "Who Is the Strongest Enemy? Towards Optimal and Efficient Evasion Attacks in Deep RL" was honored to get the Best Paper Award of the SafeRL 2021 Workshop! |
| [2021.12] | Presented our papers in the NeurIPS 2021 DeepRL and SafeRL workshops. |
| [2021.06] | Started a research internship at JPMorgan Chase & Co., under the supervision of Dr. Sumitra Ganesh. |
| [2021.01] | Our paper on poisoning RL was accepted by ICLR 2021. |
|
ICLR 2023 |
SMART: Self-supervised Multi-task pretrAining with contRol Transformers. Yanchao Sun, Shuang Ma, Ratnesh Madaan, Rogerio Bonatti, Furong Huang, Ashish Kapoor Spotlight presentation In International Conference on Learning Representations, 2023 Paper Code Models HTML |
|
NeurIPS 2022 |
Efficient Adversarial Training without Attacking: Worst-Case-Aware Robust Reinforcement Learning. Yongyuan Liang*, Yanchao Sun*, Ruijie Zheng, and Furong Huang. (* Equal Contribution) In the 36th Conference on Neural Information Processing Systems, 2022 Paper Code |
|
ICLR 2022 |
Who Is the Strongest Enemy? Towards Optimal and Efficient Evasion Attacks in Deep RL. Yanchao Sun, Ruijie Zheng, Yongyuan Liang, and Furong Huang. In International Conference on Learning Representations, 2022 Best Paper Award in NeurIPS 2021 Workshop of Safe and Robust Control of Uncertain Systems (SafeRL 2021). Paper Code HTML |
|
ICLR 2022 |
Transfer RL across Observation Feature Spaces via Model-Based Regularization. Yanchao Sun, Ruijie Zheng, Xiyao Wang, Andrew Cohen, and Furong Huang. In International Conference on Learning Representations, 2022 Paper Code HTML |
|
ICLR 2021 |
Vulnerability-Aware Poisoning Mechanism for Online RL with Unknown Dynamics. Yanchao Sun, Da Huo, and Furong Huang. In International Conference on Learning Representations, 2021 Paper Code HTML |
|
AAAI 2021 |
TempLe: Learning Template of Transitions for Sample Efficient Multi-task RL. Yanchao Sun, Xiangyu Yin, and Furong Huang. In AAAI Conference on Artificial Intelligence, 2021 Paper Code HTML |