Institut für Kartographie und Geoinformatik Forschung Mobilität
Collective Perception - Data Fusion and Visualisation

Collective Perception - Data Fusion and Visualisation

Leitung:  Sester, Monika
Team:  Yuan, Yunshuang
Jahr:  2020
Förderung:  DFG-Graduiertenkolleg SocialCars
Laufzeit:  2014-2023

The rapid development of data science and machine learning in many research as well as industrial fields has drawn much attention to the fuel of these techniques – the data. In the domain of autonomous driving, the data are mostly collected from different sources which aims to endow the data with more versatility and diversity, and also having a wider coverage in order to get a more complete and accurate perception of the environment. This project aims to improve the reliability and safety of the perception systems for autonomous driving by fusing and analysing the spatiotemporal data from different sensors and different road users that are in the same communication sensor network. In this scenario, the reconstruction of static objects can rely both on asynchronous data from a specific time span of the same sensor as well as the synchronised data from different sensors, the dynamic objects can be tracked based on the later one and auxiliated by the static information obtained. During the fusion process, the accuracies and uncertainties should also be considered and propagated to the final result and then be efficiently visualised in addition to the visualisation of the aggregated environment in order to give the human driver or passenger a correct and precise impression about the current outside-environment so that they can also intervene the driving to fulfil their need without making mistakes.

Veröffentlichungen zum Projekt

  • Yunshuang Yuan, Monika Sester (2024): CoSense3D: an Agent-based Efficient Learning Framework for Collective PerceptionIEEE Intelligent Vehicles Symposium (IV)
    DOI: 10.1109/IV55156.2024.10588865
  • Yuan, Y., Cheng, H., Yang, M. Y., & Sester, M. (2023): Generating Evidential BEV Maps in Continuous Driving SpaceISPRS Journal of Photogrammetry and Remote Sensing, Volume 204, Pages 27-41
    DOI: https://doi.org/10.1016/j.isprsjprs.2023.08.013
    ISSN: ISSN 0924-2716
  • Yuan, Y. and Sester, M. (2021): COMAP: A SYNTHETIC DATASET FOR COLLECTIVE MULTI-AGENT PERCEPTION OF AUTONOMOUS DRIVINGThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
    DOI: 10.5194/isprs-archives-XLIII-B2-2021-255-2021
    arXiv: 255--263
  • Yuan, Y., Cheng, H. & Sester, M. (2022): Keypoints-Based Deep Feature Fusion for Cooperative Vehicle Detection of Autonomous DrivingIEEE Robotics and Automation Letters. 7, 2, S. 3054 - 3061 8 S.