People increasingly use Social Media (SM) platforms such as Twitter and Facebook during disasters and emergencies to post situational updates including reports of injured or dead people, infrastructure damage, requests of urgent needs, and the like. Information on SM comes in many forms, such as textual messages, images, and videos. Several studies have shown the utility of SM information for disaster response and management, which encouraged humanitarian organizations to start incorporating SM data sources into their workflows. However, several challenges prevent these organizations from using SM data for response efforts. These challenges include near-real-time information processing, information overload, information extraction, summarization, and verification of both textual and visual content. We highlight various applications and opportunities of SM multimodal data, latest advancements, current challenges, and future directions for the crisis informatics and other related research fields.

人们在灾难和紧急情况下越来越多地使用诸如Twitter和Facebook之类的社交媒体（SM）平台来发布最新情况，包括受伤或死亡人员的报告，基础设施损坏，紧急需求的请求等。有关SM的信息有多种形式，例如文本消息，图像和视频。多项研究表明，SM信息可用于灾难响应和管理，这鼓励人道主义组织开始将SM数据源纳入其工作流程。但是，一些挑战阻止这些组织将SM数据用于响应工作。这些挑战包括近实时信息处理，信息过载，信息提取，汇总以及文本和视觉内容的验证。危机信息学和其他相关研究领域。