What is it about?
The relationship between human activity, the built environment, such as homes, offices, and schools, and the surrounding natural environment hide interaction patterns that can be better understood. Today, we examine this relationship through dashboards and data visualization tools as something we see and interpret on a screen rather than something we can experience with our bodies. Experiencing this relationship is vital to understanding the cybernetic and interdependent interactions between human activity and the built and natural environment.
Featured Image
Photo by Mick Haupt on Unsplash
Why is it important?
We created an immersive representation of a building and its surrounding environment through Generative AI. We translated multiple data streams into text using GPT3 and matched them to a human-tagged music database using an artificial intelligence music engine to create an evolving audio and visual stream. The installation offers participants an embodied experience to explore this relationship, perceive more-than-human time scales and experience data through other sensory modalities beyond sight, resulting in a deeper understanding of this relationship as an evolving system.
Perspectives
Read the Original
This page is a summary of: The Human-Built Environment-Natural Environment Relation - An Immersive Multisensory Exploration with 'System of a Sound', March 2023, ACM (Association for Computing Machinery),
DOI: 10.1145/3581754.3584119.
You can read the full text:
Resources
Online demo
Online demo to see and listen to the living soundscape being generated through AI in real-time.
Publication
The article for this work was published at IUI'23 - Intelligent User Interfaces ACM Conference 2023. Human-computer interaction + Artificial Intelligence.
Video
The video describes the installation, which can amplify people's connection to their surroundings by converting and representing real-time data streams into multiple time scales through an immersive audio-visual and gestural experience.
Contributors
The following have contributed to this page