Audio Content Analysis for Unobtrusive Event Detection in Smart Homes
| Main Authors: | Anastasios Vafeiadis, Konstantinos Votis, Dimitrios Giakoumis, Dimitrios Tzovaras, Liming Chen, Raouf Hamzaoui |
|---|---|
| Format: | info publication-preprint eJournal |
| Terbitan: |
, 2020
|
| Online Access: |
https://zenodo.org/record/3760476 |
Daftar Isi:
- Environmental sound signals are multi-source, heterogeneous, and varying in time. Many systems have been proposed to process such signals for event detec- tion in ambient assisted living applications. Typically, these systems use feature extraction, selection, and classification. However, despite major advances, sev- eral important questions remain unanswered, especially in real-world settings. This paper contributes to the body of knowledge in the field by addressing the following problems for ambient sounds recorded in various real-world kitchen environments: (1) which features and which classifiers are most suitable in the presence of background noise? (2) what is the effect of signal duration on recog- nition accuracy? (3) how do the signal-to-noise-ratio and the distance between the microphone and the audio source affect the recognition accuracy in an en- vironment in which the system was not trained? We show that for systems that use traditional classifiers, it is beneficial to combine gammatone frequency cepstral coefficients and discrete wavelet transform coefficients and to use a gra- dient boosting classifier. For systems based on deep learning, we consider 1D and 2D Convolutional Neural Networks (CNN) using mel-spectrogram energies and mel-spectrograms images as inputs, respectively, and show that the 2D CNN outperforms the 1D CNN. We obtained competitive classification results for two such systems. The first one, which uses a gradient boosting classifier, achieved an F1-Score of 90.2% and a recognition accuracy of 91.7%. The second one, which uses a 2D CNN with mel-spectrogram images, achieved an F1-Score of 92.7% and a recognition accuracy of 96%.