PSAM 16 Conference Paper Overview
Welcome to the PSAM 16 Conference paper and speaker overview page.
Lead Author: Pavan Kumar Vaddi Co-author(s): Carol Smidts, smidts.1@osu.edu
| Reinforcement Learning based Autonomous Cyber Attack Response in Nuclear Power Plants. |
|---|
| Cyber-attacks on digital industrial control systems (ICSs) are becoming increasingly frequent. Given the rise of digitalization in nuclear power plants (NPPs) and the potentially hazardous consequences of a successful cyber-attack on NPPs and similar safety-critical systems, it is imperative that research should be focused on ICS cyber-attack detection and mitigation. In this paper we explore the use of reinforcement learning (RL) to develop an autonomous cyber-attack response system for NPPs, specifically the digital feedwater control system (DFWCS) of a pressurized water reactor (PWR). The cyber-attacks are modeled as Stackelberg games between the defender i.e., the plant operator and the attacker, with the defender acting as the leader in the games. The system state transition probabilities are defined using probabilistic risk assessment (PRA). The optimal defender strategy is computed using multi-agent Q-learning, where the Stackelberg equilibrium over the current Q-values is used at every update. The advent of digital twins for nuclear power plants enables us to simulate a wide variety of cyber-attacks for as many instances as needed to fully train the RL agent. |
Paper VA167 Preview
Author and Presentation Info
Lead Author Name: Pavan Kumar Vaddi (vaddi.3@osu.edu)
Bio: Mr. PavanKumar Vaddi is a mechanical engineering grad student working in the Reliability and Risk Laboratory headed by Dr. Carol Smidts at The Ohio State University. He received his B.Tech degree in mechanical engineering from IIT Madras in 2017. His research interests include Probabilistic Risk Assessment for ICS cybersecurity and Fault diagnosis in industrial control systems.
Country: United States of America
Company: Ohio State University
Job Title: Student
Bio: Mr. PavanKumar Vaddi is a mechanical engineering grad student working in the Reliability and Risk Laboratory headed by Dr. Carol Smidts at The Ohio State University. He received his B.Tech degree in mechanical engineering from IIT Madras in 2017. His research interests include Probabilistic Risk Assessment for ICS cybersecurity and Fault diagnosis in industrial control systems.
Country: United States of America
Company: Ohio State University
Job Title: Student