Skip to search boxSkip to navigationSkip to main content

Collaborative Attack Sequence Generation Model Based on Multiagent Reinforcement Learning for Intelligent Traffic Signal System

  • Yalun Wu
    ,
  • Yingxiao Xiang
    ,
  • ,
  • Endong Tong
    ,
  • Ye Zhu
    ,
  • Xiaoshu Cui
*Corresponding author for this work
  • Beijing Jiaotong University
    ,
  • CAS - Institute of Information Engineering
    ,
  • University of Brighton
    ,
  • Deakin University
    ,
  • Ltd.
Research Output:
Contribution to journal
Article
Research
Peer-review

Open access

Abstract

<p>Intelligent traffic signal systems, crucial for intelligent transportation systems, have been widely studied and deployed to enhance vehicle traffic efficiency and reduce air pollution. Unfortunately, intelligent traffic signal systems are at risk of data spoofing attack, causing traffic delays, congestion, and even paralysis. In this paper, we reveal a multivehicle collaborative data spoofing attack to intelligent traffic signal systems and propose a collaborative attack sequence generation model based on multiagent reinforcement learning (RL), aiming to explore efficient and stealthy attacks. Specifically, we first model the spoofing attack based on Partially Observable Markov Decision Process (POMDP) at single and multiple intersections. This involves constructing the state space, action space, and defining a reward function for the attack. Then, based on the attack modeling, we propose an automated approach for generating collaborative attack sequences using the Multi-Actor-Attention-Critic (MAAC) algorithm, a mainstream multiagent RL algorithm. Experiments conducted on the multimodal traffic simulation (VISSIM) platform demonstrate a 15% increase in delay time (DT) and a 40% reduction in attack ratio (AR) compared to the single-vehicle attack, confirming the effectiveness and stealthiness of our collaborative attack.</p>

Research Output Information

Output type

Research Output:
Contribution to journal
Article
Research
Peer-review

Original language

English

Article number

4734030

Journal (Volume, Issue Number)

International Journal of Intelligent Systems (Volume 2024, Issue 1)

Publication milestones

  • Published - 2024

Publication status

Published - 2024

ISSN

0884-8173

Publication IDs

  • Scopus: 105003535153

Publication metrics

Metrics

SciVal
FWCI
0.39
Scopus
citations

PlumX, opens in new tab

Captures
4
Mentions
1
Citation count
5

Sustainable Development Goals

  • SDG 11 - Sustainable Cities and Communities
    SDG 11 Sustainable Cities and Communities