HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Cooperative Visual-Inertial Sensor Fusion: Fundamental Equations

Agostino Martinelli 1 Alessandro Renzaglia 1
1 CHROMA - Robots coopératifs et adaptés à la présence humaine en environnements dynamiques
Inria Grenoble - Rhône-Alpes, CITI - CITI Centre of Innovation in Telecommunications and Integration of services
Abstract : This paper provides a new theoretical and basic result in the framework of cooperative visual-inertial sensor fusion. Specifically, the case of two aerial vehicles is investigated. Each vehicle is equipped with inertial sensors (accelerometer and gyroscope) and with a monocular camera. By using the monocular camera, each vehicle can observe the other vehicle. No additional camera observations (e.g., of external point features in the environment) are considered. First, the entire observable state is analytically derived. This state includes the relative position between the two aerial vehicles (which includes the absolute scale), the relative velocity and the three Euler angles that express the rotation between the two vehicle frames. Then, the basic equations that describe this system are analytically obtained. In other words, both the dynamics of the observable state and all the camera observations are expressed only in terms of the components of the observable state and in terms of the inertial measurements. These are the fundamental equations that fully characterize the problem of fusing visual and inertial data in the cooperative case. The last part of the paper describes the use of these equations to achieve the state estimation through an EKF. In particular, a simple manner to limit communication among the vehicles is discussed. Results obtained through simulations show the performance of the proposed solution, and in particular how it is affected by limiting the communication between the two vehicles.
Complete list of metadata

Cited literature [38 references]  Display  Hide  Download

Contributor : Agostino Martinelli Connect in order to contact the contributor
Submitted on : Wednesday, December 20, 2017 - 2:20:45 PM
Last modification on : Monday, May 16, 2022 - 4:46:03 PM


Files produced by the author(s)


  • HAL Id : hal-01668972, version 1



Agostino Martinelli, Alessandro Renzaglia. Cooperative Visual-Inertial Sensor Fusion: Fundamental Equations. MRS 2017 - The 1st International Symposium on Multi-Robot and Multi-Agent Systems, Dec 2017, Los Angeles, United States. pp.1-8. ⟨hal-01668972⟩



Record views


Files downloads