Conference paper Open Access

Multi-modal Deep Learning Approach for Flood Detection

Lopez-Fuentes, Laura; van de Weijer, Joost; Bolaños, Marc; Skinnemoen, Harald

In this paper we propose a multi-modal deep learning approach to detect floods in social media posts. Social media posts normally contain some metadata and/or visual information, therefore in order to detect the floods we use this information. The model is based on a Convolutional Neural Network which extracts the visual features and a bidirectional Long Short-Term Memory network to extract the semantic features from the textual metadata. We validate the method on images extracted from Flickr which contain both visual information and metadata and compare the results when using both, visual information only or metadata only. This work has been done in the context of the MediaEval Multimedia Satellite Task.

Files (801.2 kB)
Name Size
801.2 kB Download
All versions This version
Views 106106
Downloads 3131
Data volume 24.8 MB24.8 MB
Unique views 104104
Unique downloads 2828


Cite as