David Fernandez, Pedram MohajerAnsari, Cigdem Kokenoz, Amir Salarpour, Bing Li, and Mert D. Pesé, Clemson University
We propose a framework that leverages Large Language Models (LLMs) for adversarial scenario analysis in Autonomous Vehicles (AVs), generating interpretable explanations for anomalies and bridging the gap between detection and semantic understanding. Conventional Deep Neural Networks (DNNs) lack robustness against adversarial perception attacks and provide limited interpretability. To address these limitations, our method uses LLMs to process structured vehicular data encoded in a Domain-Specific Language (DSL), incorporating the Manual on Uniform Traffic Control Devices (MUTCD) as a formal knowledge base. Leveraging zero-shot chain-of-thought (CoT) prompting, the framework distinguishes benign sensor errors from adversarial manipulations through stepwise reasoning. We introduce AutoSec-X, a dataset of 40 MUTCD-based driving scenarios, to evaluate LLM architectures, demonstrating that larger models (e.g., Gemini) exhibit superior domain-specific reasoning, often citing relevant MUTCD sections. Results validate the effectiveness of CoT-augmented LLMs for semantic anomaly analysis in AVs without labeled training data. Future work will extend AutoSec-X and investigate multimodal inputs.
Open Access Media
USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.
author = {David Fernandez and Pedram MohajerAnsari and Cigdem Kokenoz and Amir Salarpour and Bing Li and Mert D. Pes{\'e}},
title = {{WIP}: From Detection to Explanation: Using {LLMs} for Adversarial Scenario Analysis in Vehicles},
booktitle = {3rd USENIX Symposium on Vehicle Security and Privacy (VehicleSec 25)},
year = {2025},
isbn = {978-1-939133-49-6},
address = {Seattle, WA},
pages = {315--324},
url = {https://www.usenix.org/conference/vehiclesec25/presentation/fernandez},
publisher = {USENIX Association},
month = aug
}