dc.contributor.advisor | Li, Jingyue | |
dc.contributor.advisor | Katsikas, Sokratis | |
dc.contributor.advisor | Johnsen, Stig Ole | |
dc.contributor.author | Kaloudi, Nektaria | |
dc.date.accessioned | 2023-04-24T13:07:01Z | |
dc.date.available | 2023-04-24T13:07:01Z | |
dc.date.issued | 2023 | |
dc.identifier.isbn | 978-82-326-5196-2 | |
dc.identifier.issn | 2703-8084 | |
dc.identifier.uri | https://hdl.handle.net/11250/3064543 | |
dc.description.abstract | In a constantly evolving world, various technologies such as artificial intelligence (AI) influence the development of digital transformation through its decision-making capabilities. Cyber-physical systems (CPSs) are becoming more complex, and advanced adversaries are contriving new sophisticated ways to perpetrate their missions. Given the increased complexity of modern systems, cyber risks are getting more difficult to be handled, leading to an expansion of the attack surface. In response, there is a need to improve their safety and security, which are of the utmost importance.
The challenges are twofold: (i) advances in CPSs; and (ii) evolving cyber threat landscape that entails new challenges for risk identification. On the one hand, CPSs are likely to exhibit emergent behaviors, considering the system as a whole, success and failure are increasingly understood as emergent rather than resultant. On the other hand, attack strategies are constantly evolving that affect CPSs, especially when AI can be used as a malicious tool by adversaries, which makes the situation even more challenging. Therefore, sufficient understanding and analysis of potential risks to support relevant operations should be at the forefront to ensure a safe transition to a connected world.
This thesis aims to provide knowledge on the investigation of emergent misbehavior in the context of CPS, with a focus on the reciprocal influence of AI on cyberthreat behaviors. It develops new knowledge, methods, and guidance that provide the set of processes and practices to identify potential risks, as well as suggestions to address them. The thesis provides systematic studies on four sets of aspects:1) investigation of emergent risk concept; 2) new knowledge and a framework for mapping AI offensive capabilities; 3) new knowledge and a taxonomy of machine learning (ML)-based sensor data deception approaches as a particular type of ML-based attack strategy, which targets the sensor data of CPS; and 4) a methodology for safety and security co-analysis targeting CPS to address the ML-based sensor data deception risk. The resulting contributions provide an improved understanding of the changing threats and risks, as well as propose ways for preventing undesirable emergent misbehaviors on CPS. Finally, this thesis discusses research and practical implications and sheds light on avenues for future research. | en_US |
dc.language.iso | eng | en_US |
dc.publisher | NTNU | en_US |
dc.relation.ispartofseries | Doctoral theses at NTNU;2023:114 | |
dc.relation.haspart | Paper 1:
Kaloudi, Nektaria; Li, Jingyue.
Comparison of Risk Analysis Approaches for Analyzing Emergent Misbehavior in Autonomous Systems. I: Proceedings of the 31st European Safety and Reliability Conference. Research Publishing Services 2021 ISBN 978-981-18-2016-8. s. 383-390
https://doi.org/10.3850/978-981-18-2016-8_213-cd | |
dc.relation.haspart | Paper 2:
Li, Jingyue; Zhang, Jin; Kaloudi, Nektaria.
Could We Issue Driving Licenses to Autonomous Vehicles?. Lecture Notes in Computer Science (LNCS) 2018 ;Volum 11094 LNCS. s. 473-480
https://doi.org/10.1007/978-3-319-99229-7_41 | |
dc.relation.haspart | Paper 3:
Kaloudi, Nektaria; Li, Jingyue.
The AI-based cyber threat landscape: A survey. ACM Computing Surveys 2020 ;Volum 53.(1)
https://doi.org/10.1145/3372823 | |
dc.relation.haspart | Paper 4:
Meyer, Torstein; Kaloudi, Nektaria; Li, Jingyue.
A Systematic Literature Review on Malicious Use of Reinforcement Learning. I: Proceeding of the 2021 IEEE/ACM 2nd International Workshop on Engineering and Cybersecurity of Critical Systems (EnCyCriS). IEEE conference proceedings 2021 ISBN 978-1-6654-4553-5. s. 21-28
https://doi.org/10.1109/EnCyCriS52570.2021.00011 | |
dc.relation.haspart | Paper 5:
Nektaria Kaloudi and Jingyue Li.
The ML-based sensor data deception targeting
cyber-physical systems: A review. | |
dc.relation.haspart | Paper 6:
Kaloudi, Nektaria; Li, Jingyue.
AST-SafeSec: Adaptive Stress Testing for Safety and Security Co-Analysis of Cyber-Physical Systems. IEEE Transactions on Information Forensics and Security 2023 ;Volum 18. s. 5567-5579
https://doi.org/10.1109/TIFS.2023.3309160 | |
dc.title | Understanding and Analyzing Emergent Misbehavior on Cyber-Physical Systems. | en_US |
dc.type | Doctoral thesis | en_US |
dc.subject.nsi | VDP::Teknologi: 500::Informasjons- og kommunikasjonsteknologi: 550::Datateknologi: 551 | en_US |
dc.description.localcode | Fulltext not available | en_US |