This paper presents a new method able to integrate audio and visual information for scene analysis in a typical surveillance scenario, using only one camera and one monaural microphone. Visual information is analyzed by a standard visual background/foreground (BG/FG) modelling module, enhanced with a novelty detection stage, and coupled with an audio BG/FG modelling scheme. The audiovisual association is performed on-line, by exploiting the concept of synchrony. Experimental tests carrying out classification and clustering of events show all the potentialities of the proposed approach, also in comparison with the results obtained by using the single modalities.

Audio-visual foreground extraction for event characterization / Cristani, Marco; Bicego, Manuele; Murino, Vittorio. - (2006), pp. 116-116. (Intervento presentato al convegno Conference on Computer Vision and Pattern Recognition Workshop, 2006: CVPRW '06) [10.1109/CVPRW.2006.33].

Audio-visual foreground extraction for event characterization

Bicego, Manuele;
2006-01-01

Abstract

This paper presents a new method able to integrate audio and visual information for scene analysis in a typical surveillance scenario, using only one camera and one monaural microphone. Visual information is analyzed by a standard visual background/foreground (BG/FG) modelling module, enhanced with a novelty detection stage, and coupled with an audio BG/FG modelling scheme. The audiovisual association is performed on-line, by exploiting the concept of synchrony. Experimental tests carrying out classification and clustering of events show all the potentialities of the proposed approach, also in comparison with the results obtained by using the single modalities.
2006
0-7695-2646-2
Audio-visual foreground extraction for event characterization / Cristani, Marco; Bicego, Manuele; Murino, Vittorio. - (2006), pp. 116-116. (Intervento presentato al convegno Conference on Computer Vision and Pattern Recognition Workshop, 2006: CVPRW '06) [10.1109/CVPRW.2006.33].
File in questo prodotto:
File Dimensione Formato  
Cristani_M_ContrCongresso_2006_Audio.pdf

accesso aperto

Tipologia: Versione editoriale (versione finale pubblicata)
Licenza: Non specificato
Dimensione 699.52 kB
Formato Adobe PDF
699.52 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11388/263470
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact