In the context of social media, geolocation inference on news or events has become a very important task. In this paper, we present the GeoWINE (Geolocation-based Wiki-Image-News-Event retrieval) demonstrator, an effective modular system for multimodal retrieval which expects only a single image as input. The GeoWINE system consists of five modules in order to retrieve related information from various sources. The first module is a state-of-the-art model for geolocation estimation of images. The second module performs a geospatial-based query for entity retrieval using the Wikidata knowledge graph. The third module exploits four different image embedding representations, which are used to retrieve most similar entities compared to the input image. The embeddings are derived from the tasks of geolocation estimation, place recognition, ImageNet-based image classification, and their combination. The last two modules perform news and event retrieval from EventRegistry and the Open Event Knowledge Graph (OEKG). GeoWINE provides an intuitive interface for end-users and is insightful for experts for reconfiguration to individual setups. The GeoWINE achieves promising results in entity label prediction for images on Google Landmarks dataset. The demonstrator is publicly available at http://cleopatra.ijs.si/geowine/.

中文翻译：

---

GeoWINE：基于地理位置的Wiki，图像，新闻和事件检索

在社交媒体的背景下，新闻或事件的地理位置推断已成为一项非常重要的任务。在本文中，我们介绍了GeoWINE（基于地理位置的Wiki-Image-News-Event检索）演示程序，这是一种用于多模式检索的有效模块化系统，该系统仅希望将单个图像作为输入。GeoWINE系统由五个模块组成，以便从各种来源检索相关信息。第一个模块是用于图像地理位置定位的最新模型。第二个模块使用Wikidata知识图执行基于地理空间的实体检索查询。第三个模块采用了四种不同的图像嵌入表示，与输入图像相比，它们用于检索最相似的实体。嵌入是从地理位置估计，位置识别，基于ImageNet的图像分类及其组合。最后两个模块从EventRegistry和Open Event Knowledge Graph（OEKG）中执行新闻和事件检索。GeoWINE为最终用户提供了一个直观的界面，并且对于专家进行重新配置以适应各个设置很有见地。在Google Landmarks数据集上的图像的实体标签预测中，GeoWINE取得了可喜的结果。该演示器可从http://cleopatra.ijs.si/geowine/上公开获得。在Google Landmarks数据集上的图像的实体标签预测中，GeoWINE取得了可喜的结果。该演示器可从http://cleopatra.ijs.si/geowine/上公开获得。在Google Landmarks数据集上的图像的实体标签预测中，GeoWINE取得了可喜的结果。该演示器可从http://cleopatra.ijs.si/geowine/上公开获得。