[Paper Review] ConnectiCity, augmented perception of the city

Salvatore Iaconesi, Oriana Persico|arXiv (Cornell University)|Jul 18, 2012

Smart Cities and Technologies63 references3 citations

TL;DR

ConnectiCity proposes a framework for augmenting urban perception by layering real-time, user-generated digital narratives over physical city spaces using mobile and ubiquitous technologies. By integrating location-based services, NFC, and mixed reality, the system transforms cities into dynamic, participatory information landscapes, enabling diverse, perception-based interpretations of urban environments through stratified, interactive storytelling layers.

ABSTRACT

As we move through cities in our daily lives, we are in a constant state of transformation of the spaces around us. The form and essence of urban space directly affects people's behavior, describing in their perception what is possible or impossible, allowed or prohibited, suggested or advised against. We are now able to fill and stratify space/time with digital information layers, completely wrapping cities in a membrane of information and of opportunities for interaction and communication. Mobile devices, smartphones, wearables, digital tags, near field communication devices, location based services and mixed/augmented reality have gone much further in this direction, turning the world into an essentially read/write, ubiquitous publishing surface. The usage of mobile devices and ubiquitous technologies alters the understanding of place. In this process, the definition of (urban) landscape powerfully shifts from a definition which is purely administrative (e.g.: the borders of the flower bed in the middle of a roundabout) to one that is multiplied according to all individuals which experience that location; as a lossless sum of their perceptions; as a stratification of interpretations and activities which forms our cognition of space and time. In our research we investigated the possibilities to use the scenario which sees urban spaces progressively filling with multiple layers of real-time, ubiquitous, digital information to conceptualize, design and implement a series of usage scenarios. It is possible to create multiple layers of narratives which traverse the city and which allow us to read them in different ways, according to the different strategies and methodologies enabling us to highlight how cities express points of view on the environment, culture, economy, transports, energy and politics.

Motivation & Objective

• To investigate how urban spaces can be enriched with multiple, real-time digital information layers through ubiquitous technologies.
• To shift the definition of urban landscape from administrative boundaries to a multiplicity of individual perceptions and interpretations.
• To design and implement usage scenarios that enable citizens to experience cities through diverse, dynamic narratives on environment, culture, politics, and more.
• To explore how mobile devices and digital interaction tools reshape the cognitive understanding of place and space.
• To demonstrate how cities can become read/write, participatory surfaces through collective digital storytelling.

Proposed method

• Leveraging mobile devices, smartphones, wearables, and NFC-enabled tags to collect and deliver location-specific digital content.
• Implementing a mixed-reality interface that overlays digital narratives onto physical urban environments in real time.
• Using location-based services to trigger context-aware information delivery based on user proximity to urban landmarks or zones.
• Designing narrative layers that reflect diverse perspectives on urban themes such as violence, emotions, and social movements.
• Integrating user-generated content to create a stratified, perception-based representation of the city as experienced by individuals.
• Applying social network analysis and sentiment tracking to visualize collective urban moods and social dynamics through digital tagging.

Experimental results

Research questions

• RQ1 How can urban spaces be transformed into dynamic, participatory information landscapes through digital augmentation?
• RQ2 In what ways do mobile and ubiquitous technologies alter individuals' cognitive mapping of urban environments?
• RQ3 How can multiple, overlapping narrative layers be designed to reflect diverse perspectives on urban life?
• RQ4 What role do real-time, user-generated digital narratives play in reshaping collective perception of city spaces?
• RQ5 How can augmented reality and location-based services be used to make urban data and social narratives more accessible and interactive?

Key findings

• The integration of mobile and ubiquitous technologies enables cities to become dynamic, read/write surfaces for collective storytelling and perception.
• Urban perception shifts from fixed administrative boundaries to a fluid, individualized, and perception-based understanding of space.
• Multiple narrative layers—such as those on verbal violence, riots, and emotions in Rome—demonstrate how digital augmentation reveals hidden social and cultural dimensions of urban life.
• The system successfully visualized collective urban moods through digital tagging and sentiment analysis, showing real-time emotional stratification across city districts.
• User-generated content and participatory digital tagging created a web of interconnected narratives, forming a 'tribe' of shared urban experiences in Rome.
• The framework proved effective in transforming static urban spaces into interactive, information-rich environments through real-time, context-aware digital overlays.