The Bartlett
B-Pro Show 2021
Explore
About the show

unit-code



Close

ARchive

Project details

Programme
Award
  • B-Pro Architectural Computation Silver Medal
  • Alasdair Turner Dissertation Prize

The development and evaluation of an archival system that combines Deep Learning techniques with XR to process and access geo-based temporal 3D scans.

In our age, which is more than ever dynamically archival, digitalisation of our environment and behaviour is the way we teach computers to understand our reality. 3D scanning is an emerging, widely accessible medium, which produces a signalised representation of space and incorporates parameters link to time. This research is focusing on 3D scanning as an archival medium and specifically in the possibilities of combining different techniques to declutter, organise and communicate with a spatio-temporal archive. It aims to develop a conceptual stage of development, identify the key components that it needs to incorporate, build an initial archival system and finally evaluate the performance of all stages. The methodology is divided into two parts: Back and Front end. Here, the former involves the transformation of data into information, through 3D semantic segmentation with deep learning, while the latter involves the transformation of information into knowledge, in terms of communication, through the development of a mobile XR-based system. The case study is a bedroom, but it could be implemented in other contexts such as a museum, a construction site or even a natural environment.

In his book "Time Travel: A History”, James Gleick explores how we think about time and why its directionality has been a matter of discourse for many years now, using philosophy through literature and physics.

Outcome from 3D Semantic Segmentation with the Minkowski Engine

Decluttering data to extract useful information can effectively be done using Deep Learning methodologies, which are able to recognise patterns and perform tasks much quicker than humans.

3D Data Structure

The information of the archival point clouds, XYZ and RGB, is organised based on time step, label and cluster. After the process of 3D semantic segmentation, each point has been assigned a label but there is a need for further segmentation.

AR Interface

After the back-end processing of the system, the space is segmented into individual objects. In order to make conclusions about the diversity, configuration and spatial change over time, an interface for communication is needed.

Visualisation of the 3D Point Cloud Archive

In this research, the collection, processing and interacting with sequential, time-based and geo-specific 3D data is defined as the ARchive.

Share on , LinkedIn or

Close

Index of Works

The Bartlett
B-Pro Show 2021
30 October – November 13
Explore