Skip to Main content Skip to Navigation
Journal articles

Semantic Segmentation with Unsupervised Domain Adaptation Under Varying Weather Conditions for Autonomous Vehicles

Özgür Erkent 1 Christian Laugier 1
1 CHROMA - Robots coopératifs et adaptés à la présence humaine en environnements dynamiques
Inria Grenoble - Rhône-Alpes, CITI - CITI Centre of Innovation in Telecommunications and Integration of services
Abstract : Semantic information provides a valuable source for scene understanding around autonomous vehicles in order to plan their actions and make decisions; however, varying weather conditions reduce the accuracy of the semantic segmentation. We propose a method to adapt to varying weather conditions without supervision, namely without labeled data. We update the parameters of a deep neural network (DNN) model that is pre-trained on the known weather condition (source domain) to adapt it to the new weather conditions (target domain) without forgetting the segmentation in the known weather condition. Furthermore, we don't require the labels from the source domain during adaptation training. The parameters of the DNN are optimized to reduce the distance between the distribution of the features from the images of old and new weather conditions. To measure this distance, we propose three alternatives: W-GAN, GAN and maximum-mean discrepancy (MMD). We evaluate our method on various datasets with varying weather conditions. The results show that the accuracy of the semantic segmentation is improved for varying conditions after adaptation with the proposed method.
Complete list of metadata

Cited literature [43 references]  Display  Hide  Download
Contributor : Ozgur Erkent Connect in order to contact the contributor
Submitted on : Monday, March 9, 2020 - 11:49:47 AM
Last modification on : Thursday, January 20, 2022 - 5:32:58 PM
Long-term archiving on: : Wednesday, June 10, 2020 - 2:12:11 PM


Files produced by the author(s)




Özgür Erkent, Christian Laugier. Semantic Segmentation with Unsupervised Domain Adaptation Under Varying Weather Conditions for Autonomous Vehicles. IEEE Robotics and Automation Letters, IEEE 2020, pp.1-8. ⟨10.1109/LRA.2020.2978666⟩. ⟨hal-02502457⟩



Les métriques sont temporairement indisponibles