unit-code
The development and evaluation of an archival system that combines Deep Learning techniques with XR to process and access geo-based temporal 3D scans.
In our age, which is more than ever dynamically archival, digitalisation of our environment and behaviour is the way we teach computers to understand our reality. 3D scanning is an emerging, widely accessible medium, which produces a signalised representation of space and incorporates parameters link to time. This research is focusing on 3D scanning as an archival medium and specifically in the possibilities of combining different techniques to declutter, organise and communicate with a spatio-temporal archive. It aims to develop a conceptual stage of development, identify the key components that it needs to incorporate, build an initial archival system and finally evaluate the performance of all stages. The methodology is divided into two parts: Back and Front end. Here, the former involves the transformation of data into information, through 3D semantic segmentation with deep learning, while the latter involves the transformation of information into knowledge, in terms of communication, through the development of a mobile XR-based system. The case study is a bedroom, but it could be implemented in other contexts such as a museum, a construction site or even a natural environment.
In his book "Time Travel: A History”, James Gleick explores how we think about time and why its directionality has been a matter of discourse for many years now, using philosophy through literature and physics.
Decluttering data to extract useful information can effectively be done using Deep Learning methodologies, which are able to recognise patterns and perform tasks much quicker than humans.
The information of the archival point clouds, XYZ and RGB, is organised based on time step, label and cluster. After the process of 3D semantic segmentation, each point has been assigned a label but there is a need for further segmentation.
After the back-end processing of the system, the space is segmented into individual objects. In order to make conclusions about the diversity, configuration and spatial change over time, an interface for communication is needed.
In this research, the collection, processing and interacting with sequential, time-based and geo-specific 3D data is defined as the ARchive.