Decoding the Disaster: Multi-Task Geospatial Reasoning with Vision-Language Models and Crowdsourced Imagery for Disaster Mapping
En palabras de los autores
Crowdsourced imagery provides timely, fine-grained, street-level observations for disaster mapping, complementing conventional remote sensing imagery (RSI) during emergency response. However, such imagery is often unstructured, spatially ambiguous, and lacks reliable geographic metadata, making manual geolocalization and interpretation labor-intensive and difficult to scale. This work proposes a multi-task Geospatial Reasoning Disaster mapping framework, namely GRDisaster, to examine the potential of vision-language models (VLMs) in understanding, geolocalizing, and reasoning over crowdsourced disaster imagery. GRDisaster is built on a newly curated benchmark dataset derived from PhotoMappers, comprising 26,340 images organized into human-validated volunteered geographic information (VGI), street-view imagery (SVI), RSI cross-view triplets covering multiple disaster events from 2018 to 2024. The framework combines deterministic and probabilistic cross-view geolocalization with multi-view fusion to associate VGI images with georeferenced SVI and RSI. It introduces two sets of spatial reasoning indicators for cross-view geolocalization validation and disaster damage assessment. These indicators use structural, environmental, and global-scene cues to validate cross-view correspondences and visually observable damage evidence with expert-verified annotations to assess disaster severity, improving the interpretability of VLM outputs. To our knowledge, this study provides the first systematic investigation and unified evaluation framework for examining how VLM-based spatial reasoning can transform crowdsourced disaster imagery into actionable geospatial artificial intelligence (GeoAI) through cross-view geolocalization validation, interpretable spatial reasoning, and damage-aware severity assessment.
En palabras simples Resumen con IA
Los autores construyeron un sistema llamado GRDisaster que utiliza modelos de visión-lenguaje para comprender y ubicar fotos de desastres de fuentes ciudadanas. Crearon un conjunto de datos de 26,340 imágenes de 2018 a 2024, organizadas en tríos de fotos de voluntarios, imágenes de calle y imágenes satelitales. El sistema empareja fotos de voluntarios con ubicaciones conocidas combinando imágenes de calle y satelitales. Utiliza señales estructurales y ambientales para verificar coincidencias de ubicación y evaluar daños visibles con etiquetas verificadas por expertos. Este es el primer estudio sistemático de cómo los modelos de visión-lenguaje pueden convertir imágenes de desastres de fuentes ciudadanas en inteligencia geoespacial útil.
Escrito por Kimi K2.5 usando solo el abstract de arriba. Jev verificó que cada oración esté respaldada por las oraciones del abstract que cita y eliminó las que no. Pasá el cursor por una oración para ver de dónde sale.
Apareció: viernes, 2 de octubre. arXiv. Preprint, todavía sin revisión por pares.