Skip to Main content Skip to Navigation
Conference papers

Recognition of Urban Sound Events Using Deep Context-Aware Feature Extractors and Handcrafted Features

Abstract : This paper proposes a method for recognizing audio events in urban environments that combines handcrafted audio features with a deep learning architectural scheme (Convolutional Neural Networks, CNNs), which has been trained to distinguish between different audio context classes. The core idea is to use the CNNs as a method to extract context-aware deep audio features that can offer supplementary feature representations to any soundscape analysis classification task. Towards this end, the CNN is trained on a database of audio samples which are annotated in terms of their respective “scene” (e.g. train, street, park), and then it is combined with handcrafted audio features in an early fusion approach, in order to recognize the audio event of an unknown audio recording. Detailed experimentation proves that the proposed context-aware deep learning scheme, when combined with the typical handcrafted features, leads to a significant performance boosting in terms of classification accuracy. The main contribution of this work is the demonstration that transferring audio contextual knowledge using CNNs as feature extractors can significantly improve the performance of the audio classifier, without need for CNN training (a rather demanding process that requires huge datasets and complex data augmentation procedures).
Document type :
Conference papers
Complete list of metadata

Cited literature [31 references]  Display  Hide  Download
Contributor : Hal Ifip <>
Submitted on : Thursday, November 14, 2019 - 3:50:37 PM
Last modification on : Thursday, November 14, 2019 - 3:56:05 PM
Long-term archiving on: : Saturday, February 15, 2020 - 3:23:50 PM


 Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed until : 2022-01-01

Please log in to resquest access to the document


Distributed under a Creative Commons Attribution 4.0 International License



Theodore Giannakopoulos, Evaggelos Spyrou, Stavros Perantonis. Recognition of Urban Sound Events Using Deep Context-Aware Feature Extractors and Handcrafted Features. 15th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), May 2019, Hersonissos, Greece. pp.184-195, ⟨10.1007/978-3-030-19909-8_16⟩. ⟨hal-02363844⟩



Record views