Resumen de Augmented reality through various sensory channels and its application to orientation and spatial localization processes
Francisco Miguel Muñoz Montoya
This thesis focuses on exploiting the possibilities of Augmented Reality (AR) based on SLAM (Simultaneous Localization and Mapping) for the assessment of spatial memory. The main objective was to develop new indoor localization techniques in the field of AR, taking advantage of technological advances, and to validate them by building frameworks and applications oriented to the assessment of spatial location ability in adults; and studying perceptual augmentation in the visual and tactile channels.
In this thesis, to fulfill this main objective, a framework was developed for the development of author applications to use in the study of spatial memory taking advantage of AR based on SLAM. Our framework enables using different AR engines or SDKs. There are different interfaces incorporated in the framework through which the different AR modules can be connected. This enables a modular and independent use of the AR engine for developers. The general functioning of the applications developed in this thesis consists of three phases. In a first phase, the supervisor selects the number of virtual objects to be memorized and the virtual objects themselves, which she/he places at desired locations in the environment. In the second phase, the user walks through the environment and memorizes the locations of the virtual objects in the real environment. In the third phase, the user must place the virtual objects in the locations they were in the previous phase. To our knowledge, this is the first work using SLAM-based AR for the assessment of spatial memory, involving physical movement of the user, and considering visual and tactile stimuli.
For the validation, three studies were carried out that focused on studying the feasibility of using the applications in small and large environments, as well as the use of visual and tactile stimuli. The performance of our applications was compared with traditional methods. Subjective variables were also assessed. The first study considered visual stimulus and small environments. This study involved 55 users. Participants were divided into two groups: ARGroup (participants memorized the location of virtual objects in the real world in a memorization phase using AR) and the NoARGroup (participants memorized the location of virtual objects by looking at photographs of the augmented environment using the device). The second study considered visual stimulus and large environments. This study involved 46 young adults. The participants had to go through a two-story building and memorize the position of a total of eight virtual objects. Participants' performance was also evaluated in a verbal object recall task, a pencil and paper spatial orientation task and a map-pointing task. The importance of different spatial strategies for orientation and anxiety levels were also evaluated. The third study compared the performance using visual versus tactile stimuli and used small environments. This study involved 53 subjects. The participants were divided into two groups: Visual, which used visual stimuli, and Tactile, which used tactile stimuli.
The following general conclusions were extracted from the development and the three studies carried out: 1) SLAM-based AR is suitable for developing spatial memory assessment tasks, working in any environment and without the need to add real objects to the environment for registration; 2) The applications developed in this thesis allow task customization and storage of performance variables; 3) These applications have allowed an ecological assessment; 4) These applications and similar tools could be used to assess and train spatial memory as an alternative to traditional methods; 5) Tactile stimuli are valid stimuli that can help the assessment of memory of tactile-spatial associations, but memory of visual-spatial associations is dominant; 6) The applications developed in this thesis and similar tools could help in the diagnosis of spatial memory impairments.
