Format

Send to

Choose Destination
R Soc Open Sci. 2019 Mar 6;6(3):181375. doi: 10.1098/rsos.181375. eCollection 2019 Mar.

Discovering place-informative scenes and objects using social media photos.

Author information

1
Institute of Remote Sensing and Geographical Information Systems, School of Earth and Space Sciences, Peking University, Beijing 100871, People's Republic of China.
2
Senseable City Laboratory, Massachusetts Institute of Technology, MA 02139, USA.
3
Department of Information Engineering, The Chinese University of Hong Kong, Hong Kong, People's Republic of China.

Abstract

Understanding the visual discrepancy and heterogeneity of different places is of great interest to architectural design, urban design and tourism planning. However, previous studies have been limited by the lack of adequate data and efficient methods to quantify the visual aspects of a place. This work proposes a data-driven framework to explore the place-informative scenes and objects by employing deep convolutional neural network to learn and measure the visual knowledge of place appearance automatically from a massive dataset of photos and imagery. Based on the proposed framework, we compare the visual similarity and visual distinctiveness of 18 cities worldwide using millions of geo-tagged photos obtained from social media. As a result, we identify the visual cues of each city that distinguish that city from others: other than landmarks, a large number of historical architecture, religious sites, unique urban scenes, along with some unusual natural landscapes have been identified as the most place-informative elements. In terms of the city-informative objects, taking vehicles as an example, we find that the taxis, police cars and ambulances are the most place-informative objects. The results of this work are inspiring for various fields-providing insights on what large-scale geo-tagged data can achieve in understanding place formalization and urban design.

KEYWORDS:

city similarity; city streetscape; deep learning; street-level imagery

Supplemental Content

Full text links

Icon for Atypon Icon for PubMed Central
Loading ...
Support Center