Runtime Monitoring of Accidents in Driving Recordings with Multi-type Logic in Empirical Models

Jan 1, 2023·
Ziyan An
Xia Wang
Xia Wang
,
Taylor T. Johnson
Jonathan Sprinkle
Jonathan Sprinkle
,
Meiyi Ma
· 1 min read
DOI
Type
Publication
Runtime Verification: 23rd International Conference, RV 2023, Thessaloniki, Greece, October 3–6, 2023, Proceedings
publications

Video capturing devices with limited storage capacity have become increasingly common in recent years. As a result, there is a growing demand for techniques that can effectively analyze and understand these videos. While existing approaches based on data-driven methods have shown promise, they are often constrained by the availability of training data. In this paper, we focus on dashboard camera videos and propose a novel technique for recognizing important events, detecting traffic accidents, and trimming accident video evidence based on anomaly detection results. By leveraging meaningful high-level time-series abstraction and logical reasoning methods with state-of-the-art data-driven techniques, we aim to pinpoint critical evidence of traffic accidents in driving videos captured under various traffic conditions with promising accuracy, continuity, and integrity. Our approach highlights the importance of utilizing a formal system of logic specifications to deduce the relational features extracted from a sequence of video frames and meets the practical limitations of real-time deployment.

Authors
Xia Wang
Authors
PhD student
Xia Wang is a Ph.D. student in Computer Science at Vanderbilt University, where her research focuses on autonomous driving, cyber-physical systems, machine learning, formal methods, and intelligent transportation systems. Her work develops interpretable, safety-aware, and human-centered AI frameworks for autonomous vehicles, including knowledge-integrated end-to-end planning, adaptive cruise control classification, runtime monitoring, and logic-based safety verification. She has contributed to the CIRCLES 100-car open-road experiment and has published research at venues including ICCPS, ITSC, IV, RV, AAMAS, CVPR autopilot workshop and IEEE Control Systems Magazine. Her recent work on NeoAD explores how large-model reasoning, BEV representations, and formal safety robustness can improve autonomous driving planning under diverse and challenging scenarios.
Jonathan Sprinkle
Authors
Professor and Chair of Computer Science
Professor of Computer Science at Vanderbilt University. Research in cyber-physical systems, autonomous vehicles, and domain-specific modeling.
Authors