Vulnerability-Aware Poisoning Mechanism for Online RL with Unknown Dynamics

Yanchao Sun1     Da Huo2     Furong Huang1    
1 University of Maryland College Park      2 Shanghai Jiao Tong University
[Paper]  [Code] 


Poisoning attacks on Reinforcement Learning (RL) systems could take advantage of RL algorithm’s vulnerabilities and cause failure of the learning. However, prior works on poisoning RL usually either unrealistically assume the attacker knows the underlying Markov Decision Process (MDP), or directly apply the poisoning methods in supervised learning to RL. In this work, we build a generic poisoning framework for online RL via a comprehensive investigation of heterogeneous poisoning models in RL. Without any prior knowledge of the MDP, we propose a strategic poisoning algorithm called Vulnerability-Aware Adversarial Critic Poison (VA2C-P), which works for on-policy deep RL agents, closing the gap that no poisoning method exists for policy-based RL agents. VA2C-P uses a novel metric, stability radius in RL, that measures the vulnerability of RL algorithms. Experiments on multiple deep RL agents and multiple environments show that our poisoning algorithm successfully prevents agents from learning a good policy or teaches the agents to converge to a target policy, with a limited attacking budget.


Cite This Paper

    title={Vulnerability-Aware Poisoning Mechanism for Online {\{}RL{\}} with Unknown Dynamics},
    author={Yanchao Sun and Da Huo and Furong Huang},
    booktitle={International Conference on Learning Representations},