ARTÍCULO
TITULO

A Deep-Learning-Based Multimodal Data Fusion Framework for Urban Region Function Recognition

Mingyang Yu    
Haiqing Xu    
Fangliang Zhou    
Shuai Xu and Hongling Yin    

Resumen

Accurate and efficient classification maps of urban functional zones (UFZs) are crucial to urban planning, management, and decision making. Due to the complex socioeconomic UFZ properties, it is increasingly challenging to identify urban functional zones by using remote-sensing images (RSIs) alone. Point-of-interest (POI) data and remote-sensing image data play important roles in UFZ extraction. However, many existing methods only use a single type of data or simply combine the two, failing to take full advantage of the complementary advantages between them. Therefore, we designed a deep-learning framework that integrates the above two types of data to identify urban functional areas. In the first part of the complementary feature-learning and fusion module, we use a convolutional neural network (CNN) to extract visual features and social features. Specifically, we extract visual features from RSI data, while POI data are converted into a distance heatmap tensor that is input into the CNN with gated attention mechanisms to extract social features. Then, we use a feature fusion module (FFM) with adaptive weights to fuse the two types of features. The second part is the spatial-relationship-modeling module. We designed a new spatial-relationship-learning network based on a vision transformer model with long- and short-distance attention, which can simultaneously learn the global and local spatial relationships of the urban functional zones. Finally, a feature aggregation module (FGM) utilizes the two spatial relationships efficiently. The experimental results show that the proposed model can fully extract visual features, social features, and spatial relationship features from RSIs and POIs for more accurate UFZ recognition.

 Artículos similares

       
 
Li Tan, Jiayi Jiang, Meng Guo and Yujia Zhong    
Land use types other than specialized athletic fields provide a variety of jogging environments, addressing the shortage of urban fitness facilities and promoting urban health as well as sustainability. Currently, there is limited research comparing the ... ver más
Revista: Buildings

 
Julia Mayer, Martin Memmel, Johannes Ruf, Dhruv Patel, Lena Hoff and Sascha Henninger    
Urban tree cadastres, crucial for climate adaptation and urban planning, face challenges in maintaining accuracy and completeness. A transdisciplinary approach in Kaiserslautern, Germany, complements existing incomplete tree data with additional precise ... ver más
Revista: Applied Sciences

 
Ulzhan Bissarinova, Aidana Tleuken, Sofiya Alimukhambetova, Huseyin Atakan Varol and Ferhat Karaca    
This paper introduces a deep learning (DL) tool capable of classifying cities and revealing the features that characterize each city from a visual perspective. The study utilizes city view data captured from satellites and employs a methodology involving... ver más
Revista: Buildings

 
Wei-Ling Hsu, Yi-Jheng Chang, Lin Mou, Juan-Wen Huang and Hsin-Lung Liu    
Historic urban areas are the foundations of urban development. Due to rapid urbanization, the sustainable development of historic urban areas has become challenging for many cities. Elements of tourism and tourism service facilities play an important rol... ver más

 
Alireza Hajiheidari, Mahmoud Reza Delavar and Abbas Rajabifard    
Enriching and updating maps are among the most important tasks of any urban management organization for informed decision making. Urban cadastral map enrichment is a time-consuming and costly process, which needs an expert?s opinion for quality control. ... ver más