Cooperative Sensing and Efficient Computing

Summary

Traffic surveillance cameras are the eyes of the Intelligent Transportation Systems (ITS). However, they are currently isolated and can only extract information from each of their fixed views. To track vehicles across multiple cameras and help public agencies collect link travel time and speed information, an Edge-empowered Cooperative Multi-camera Sensing (ECoMS) System is proposed. ECoMS system presents a novel algorithmic and edge-server cooperative system construct to push edge computing and multi-camera re-identification workflow serving for traffic sensing based on Internet of Things (IoT) architecture. On the algorithm side, ECoMS system proposes a featherlight edge-based computer vision framework for vehicle detection, tracking, and features selection process in a real-time manner. Then, by only sending the objects’ representations to the server, the high-bandwidth data transmission and the heavy post-processing system can be abandoned. Furthermore, a hierarchical clip-based deep vehicle re-identification framework is proposed and integrated into the ECoMS system, and outperforms other state-of-the-art methods by 4% to 8% on Rank-1 accuracy.

Related Publications

  • Yang, H.F., Cai, J., Liu, C., Ke, R. and Wang, Y., 2023. Cooperative multi-camera vehicle tracking and traffic surveillance with edge artificial intelligence and representation learning. Transportation research part C: emerging technologies, 148, p.103982. https://doi.org/10.1016/j.trc.2022.103982
  • Yang, H.F., Cai, J., Zhu, M., Liu, C. and Wang, Y., 2022. Traffic-informed multi-camera sensing (TIMS) system based on vehicle re-identification. IEEE transactions on intelligent transportation systems, 23(10), pp.17189-17200. https://doi.org/10.1109/TITS.2022.3154368

External Researchers

Thomas Tang (NVIDIA)

Collaborating Agencies