ARTÍCULO
TITULO

A Deep-Learning-Based Multimodal Data Fusion Framework for Urban Region Function Recognition

Mingyang Yu    
Haiqing Xu    
Fangliang Zhou    
Shuai Xu and Hongling Yin    

Resumen

Accurate and efficient classification maps of urban functional zones (UFZs) are crucial to urban planning, management, and decision making. Due to the complex socioeconomic UFZ properties, it is increasingly challenging to identify urban functional zones by using remote-sensing images (RSIs) alone. Point-of-interest (POI) data and remote-sensing image data play important roles in UFZ extraction. However, many existing methods only use a single type of data or simply combine the two, failing to take full advantage of the complementary advantages between them. Therefore, we designed a deep-learning framework that integrates the above two types of data to identify urban functional areas. In the first part of the complementary feature-learning and fusion module, we use a convolutional neural network (CNN) to extract visual features and social features. Specifically, we extract visual features from RSI data, while POI data are converted into a distance heatmap tensor that is input into the CNN with gated attention mechanisms to extract social features. Then, we use a feature fusion module (FFM) with adaptive weights to fuse the two types of features. The second part is the spatial-relationship-modeling module. We designed a new spatial-relationship-learning network based on a vision transformer model with long- and short-distance attention, which can simultaneously learn the global and local spatial relationships of the urban functional zones. Finally, a feature aggregation module (FGM) utilizes the two spatial relationships efficiently. The experimental results show that the proposed model can fully extract visual features, social features, and spatial relationship features from RSIs and POIs for more accurate UFZ recognition.

 Artículos similares

       
 
Li Tan, Jiayi Jiang, Meng Guo and Yujia Zhong    
Land use types other than specialized athletic fields provide a variety of jogging environments, addressing the shortage of urban fitness facilities and promoting urban health as well as sustainability. Currently, there is limited research comparing the ... ver más
Revista: Buildings

 
Ulzhan Bissarinova, Aidana Tleuken, Sofiya Alimukhambetova, Huseyin Atakan Varol and Ferhat Karaca    
This paper introduces a deep learning (DL) tool capable of classifying cities and revealing the features that characterize each city from a visual perspective. The study utilizes city view data captured from satellites and employs a methodology involving... ver más
Revista: Buildings

 
Jiawei Zhu, Bo Li, Hao Ouyang, Yuhan Wang and Ziyue Bai    
Walking exercise is a prevalent physical activity in urban areas, with streetscapes playing a significant role in shaping preferences. Understanding this influence is essential for creating urban environments conducive to walking exercise and improving r... ver más
Revista: Buildings

 
Wei-Ling Hsu, Yi-Jheng Chang, Lin Mou, Juan-Wen Huang and Hsin-Lung Liu    
Historic urban areas are the foundations of urban development. Due to rapid urbanization, the sustainable development of historic urban areas has become challenging for many cities. Elements of tourism and tourism service facilities play an important rol... ver más

 
Andreas F. Gkontzis, Sotiris Kotsiantis, Georgios Feretzakis and Vassilios S. Verykios    
Smart cities, leveraging advanced data analytics, predictive models, and digital twin techniques, offer a transformative model for sustainable urban development. Predictive analytics is critical to proactive planning, enabling cities to adapt to evolving... ver más
Revista: Future Internet