CPS: Coordinating Actors via Learning for Lagrangian Systems (CALLS)

Oct 1, 2021 · 2 min read

This project improves the ability to build artificial intelligence algorithms for Cyber-Physical Systems (CPS) that incorporate communications technologies by developing methods of learning from simulation environments. The specific application area is connected and automated vehicles (CAV) that drive strategically to reduce stop-and-go traffic. Employing communication between vehicles can improve the efficiency of vehicle control systems to manage traffic compared to vehicles without communication. The research of this project explores the simulation of CAVs and how we can improve their algorithms to reduce traffic congestion, with core technology developments that are applicable to homes, health, and smart and connected communities.

The project includes state and local Government stakeholders and partners which facilitate experimentation in the real-world and demonstration of traffic congestion objectives as well as potentially emission reduction. Tools, technologies, and datasets generated in this project are shared as active resources to support access beyond the life of the project. The project brings a focus on mentorship for undergraduate researchers, in order to broaden participation in computing.

This project develops new reinforcement learning approaches for Lagrangian control that accommodate communication and networking between actuators. A motivating domain that is an application area of the project is CAVs. A major challenge is leveraging a small number of CAVs before those technologies realize full adoption rates. Vehicle and infrastructure communication technologies can be more useful for congestion management when feeding into a group of sparse, coordinated Lagrangian control agents. Validation experiments are conducted using these vehicles on live roadways, and the results are validated using a camera-based testbed that collects detailed traffic data.

This is collaborative research with:

Dan Work (PI, Vanderbilt University)
Jonathan Sprinkle (Vanderbilt University)

This work is supported by the National Science Foundation under award CNS-2135579. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

Related Publications

A Safety-Driven Interpretable Model for Vehicle Control With Impact on Traffic

Xia Wang, Yuwei Yang, Yifan Shangguan, Weiyu Yan, Ziyan An, Matt Bunting, Matthew Nice, Thomas Beckers, Meiyi Ma, Dan Work, Jonathan Sprinkle

IEEE Transactions on Intelligent Transportation Systems · 2025

Design, Preparation, and Execution of the 100-AV Field Test for the CIRCLES Consortium: Methodology and Implementation of the Largest Mobile Traffic Control Experiment to Date

Mostafa Ameli, Sean McQuade, Jonathan W. Lee, Matt Bunting, Matthew Nice, Han Wang, William Barbour, Ryan J. Weightman, Chris Denaro, Ryan Delorenzo, Sharon Hornstein, Jon F. Davis, Dan Timsit, Riley Wagner, Ruotong Xu, Malaika Mahmood, Mikail Mahmood, Maria Laura Delle Monache, Benjamin Seibold, Dan Work, Jonathan Sprinkle, Benedetto Piccoli, Alexandre M. Bayen

IEEE Control Systems · 2025

Reinforcement Learning-Based Oscillation Dampening: Scaling Up Single-Agent Reinforcement Learning Algorithms to a 100-Autonomous-Vehicle Highway Field Operational Test

Kathy Jang, Nathan Lichtlé, Eugene Vinitsky, Adit Shah, Matt Bunting, Matthew Nice, Benedetto Piccoli, Benjamin Seibold, Dan Work, Maria Laura Delle Monache, Jonathan Sprinkle, Jonathan W. Lee, Alexandre M. Bayen

IEEE Control Systems · 2025

Traffic Control via Connected and Automated Vehicles (CAVs): An Open-Road Field Experiment with 100 CAVs

Jonathan W. Lee, Han Wang, Kathy Jang, Nathan Lichtlé, Amaury Hayat, Matt Bunting, Arwa Alanqary, William Barbour, Zhe Fu, Xiaoqian Gong, George Gunter, Sharon Hornstein, Abdul Rahman Kreidieh, Mat-Thew W. Nice, William A. Richardson, Adit Shah, Eugene Vinitsky, Fangyu Wu, Shengquan Xiang, Sulaiman Almatrudi, Fahd Althukair, Rahul Bhadani, Joy Carpio, Raphael Chekroun, Eric Cheng, Maria Teresa Chiri, Fang-Chieh Chou, Ryan Delorenzo, Marsalis Gibson, Derek Gloudemans, Anish Gollakota, Junyi Ji, Alexander Keimer, Nour Khoudari, Malaika Mahmood, Mikail Mahmood, Hossein Nick Zinat Matin, Sean McQuade, Rabie Ramadan, Daniel Urieli, Xia Wang, Yanbing Wang, Rita Xu, Mengsha Yao, Yiling You, Gergely Zachár, Yibo Zhao, Mostafa Ameli, Mirza Najamuddin Baig, Sarah Bhaskaran, Kenneth Butts, Manasi Gowda, Caroline Janssen, John Lee, Liam Pedersen, Riley Wagner, Zimo Zhang, Chang Zhou, Dan Work, Benjamin Seibold, Jonathan Sprinkle, Benedetto Piccoli, Maria Laura Delle Monache, Alexandre M. Bayen

IEEE Control Systems · 2025

Traffic Smoothing Using Explicit Local Controllers: Experimental Evidence for Dissipating Stop-and-go Waves with a Single Automated Vehicle in Dense Traffic

Amaury Hayat, Arwa Alanqary, Rahul Bhadani, Chris Denaro, Ryan J. Weightman, Shengquan Xiang, Jonathan W. Lee, Matt Bunting, Anish Gollakota, Matthew Nice, Derek Gloudemans, Gergely Zachár, Jon F. Davis, Maria Laura Delle Monache, Benjamin Seibold, Alexandre M. Bayen, Jonathan Sprinkle, Dan Work, Benedetto Piccoli

IEEE Control Systems · 2025

and 3 more...

People

Matthew Nice Former PhD Student

No results found

CPS: Coordinating Actors via Learning for Lagrangian Systems (CALLS)

Related Publications

A Safety-Driven Interpretable Model for Vehicle Control With Impact on Traffic

Design, Preparation, and Execution of the 100-AV Field Test for the CIRCLES Consortium: Methodology and Implementation of the Largest Mobile Traffic Control Experiment to Date

Reinforcement Learning-Based Oscillation Dampening: Scaling Up Single-Agent Reinforcement Learning Algorithms to a 100-Autonomous-Vehicle Highway Field Operational Test

Traffic Control via Connected and Automated Vehicles (CAVs): An Open-Road Field Experiment with 100 CAVs

Traffic Smoothing Using Explicit Local Controllers: Experimental Evidence for Dissipating Stop-and-go Waves with a Single Automated Vehicle in Dense Traffic

Interpretable Finite State Machine Controller: A Case Study on Lane Merge Yield Mode

Libpanda Apps: Managing the Deployment and Reuse of a Cyber-Physical System

Reinforcement Learning with Communication Latency with Application to Stop-and-Go Wave Dissipation

Parameter Estimation for Decoding Sensor Signals

Data from the Development Evolution of a Vehicle for Custom Control

Experimental testing of a control barrier function on an automated vehicle in live multi-lane traffic

Intelligent Structuring and Semantic Mapping of Dash Camera Footage and CAN Bus Data

Medium-scale to large-scale implementation of cyber-physical human experiments in live traffic

Model-based Design of NEMA-Compliant Dual-ring-barrier Traffic Signal Controller

Semantic Tagging of CAN and Dash Camera Data from Naturalistic Drives

CAN coach: vehicular control through human cyber-physical systems

Libpanda: A High Performance Library for Vehicle Data Collection

A Meta-Metamodel for Dynamic Constraint Feedback in Modeling Languages

Autonomous vehicles: From vehicular control to traffic control

Quantifying air quality benefits resulting from few autonomous vehicles stabilizing traffic

People

Related News

Research featured at DC Auto Show

Results from experiment on traffic flow

Wanted: Young Engineers with Drive

CAT Vehicle 2015 Demonstration Success

Cat Vehicle demonstration to President Hart

Working closely with Wheelhouse, Tech Launch Arizona

Sprinkle heads NSF CPS Workshop

mHealth featured in UA@Work

I-Corps Best Team Award

AP: Safety is Big Concern for Autonomous Cars