Skip to Main content Skip to Navigation
Journal articles

Semantic Segmentation with Unsupervised Domain Adaptation Under Varying Weather Conditions for Autonomous Vehicles

Özgür Erkent 1 Christian Laugier 1
1 CHROMA - Robots coopératifs et adaptés à la présence humaine en environnements dynamiques
Inria Grenoble - Rhône-Alpes, CITI - CITI Centre of Innovation in Telecommunications and Integration of services
Abstract : Semantic information provides a valuable source for scene understanding around autonomous vehicles in order to plan their actions and make decisions; however, varying weather conditions reduce the accuracy of the semantic segmentation. We propose a method to adapt to varying weather conditions without supervision, namely without labeled data. We update the parameters of a deep neural network (DNN) model that is pre-trained on the known weather condition (source domain) to adapt it to the new weather conditions (target domain) without forgetting the segmentation in the known weather condition. Furthermore, we don't require the labels from the source domain during adaptation training. The parameters of the DNN are optimized to reduce the distance between the distribution of the features from the images of old and new weather conditions. To measure this distance, we propose three alternatives: W-GAN, GAN and maximum-mean discrepancy (MMD). We evaluate our method on various datasets with varying weather conditions. The results show that the accuracy of the semantic segmentation is improved for varying conditions after adaptation with the proposed method.
Complete list of metadatas

Cited literature [43 references]  Display  Hide  Download

https://hal.inria.fr/hal-02502457
Contributor : Ozgur Erkent <>
Submitted on : Monday, March 9, 2020 - 11:49:47 AM
Last modification on : Thursday, April 30, 2020 - 10:04:44 PM

File

Erkent-2020-RAL-preprint.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Özgür Erkent, Christian Laugier. Semantic Segmentation with Unsupervised Domain Adaptation Under Varying Weather Conditions for Autonomous Vehicles. IEEE Robotics and Automation Letters, IEEE 2020, pp.1-8. ⟨10.1109/LRA.2020.2978666⟩. ⟨hal-02502457⟩

Share

Metrics

Record views

321

Files downloads

583