| Both sides previous revisionPrevious revision | Next revisionBoth sides next revision |
| about [2018/12/12 16:01] – 134.157.85.106 | about [2018/12/12 16:03] – 134.157.85.106 |
|---|
| The project is organized in the following principal research workpackages: | The project is organized in the following principal research workpackages: |
| == WP 1 - Spatial perception and memory using auditory VR exploration == | == WP 1 - Spatial perception and memory using auditory VR exploration == |
| WP 1 will examine the fundamental acoustic, psychoacoustic, and cognitive facets of spatial perception and representation resulting from various presentation means (navigation, tactile maps, etc.). Evaluation methods include quality assessments of mental spatial models (topological organization and conservation of metric relations) which evaluate the stability and accuracy of the mental maps, being directly correlated to the real environment. Results of these studies will be incorporated into WP 2, to be evaluated in detail in WP 4. | The first scientific work package comprises fundamental studies in cognitive science concerning spatial perception and representation resulting from various presentation and exploration means by the blind. These studies investigate the capacities of mental map creation and memory through a series of experiments comparing physical navigation, tactile maps, verbal descriptions, and virtual navigation via auditory simulations of the architectural space. |
| |
| == WP 2 - Real-time room acoustic rendering optimized for spatial understanding == | == WP 2 - Real-time room acoustic rendering optimized for spatial understanding == |
| WP 2 addresses the development of the room acoustic simulation engine. This research task concerns initially the improvement of the previously method (Noisternig, 2008), an Iterative Image Source Method (IISM). This involves, first and foremost, the integration of the IISM into a geometrical scene engine which will allow for the definition of a unified visual and acoustical geometrical model. The open source multiplatform architecture Blender has been previously identified as a good candidate for integration. | The second scientific work package concerns the development of the real-time acoustic rendering engine, the technological heart of the project. To facilitate working in parallel, several variances of the engine are studied relying on different approaches to the rendering engine. The first will be an integration of the current state of the art developments into a functioning prototype, allowing for initial evaluations. As alternate editions of the engine are developed, these can be swapped out seamlessly into the prototype architecture. |
| | |
| The audio rendering will be implemented with the powerful real-time spatialization library Spat~ (Carpentier, 2015). The quality of the simulated room acoustic responses will be further improved through the addition of spatially coherent statistical reverberation models for the later parts of the acoustic response. These statistical models will be developed based on recent works concerning hybrid reverberators (Carpentier, 2014) which combine a high spatial-resolution convolution engine with feedback delay networks; appearing particularly well-suited for pairing with room acoustics simulation software. The model parameterizations will be based on simplified approximations of the room geometry obtained from the unified geometrical visual-acoustic model. WP 2 and WP 3 concern implementations and evaluations that can be carried out in parallel, after the completion of WP 1 | |
| |
| == WP 3 - Virtual Reality prototype for preparatory navigation planning == | == WP 3 - Virtual Reality prototype for preparatory navigation planning == |
| WP 3 involves the development of a proof-of-concept prototype for the informative exploration of virtual acoustic environments. Working in conjunction with a selected user group panel who will remain engaged in the project for the duration, several test cases of interest will be identified for integration into the prototype and evaluations in WP 4. | The third scientific work package addresses the construction of the navigation training prototype and the associate test scenarios. This includes developing the interface of the prototype in collaboration with ergonomic specialists in assistive devices and an established panel of potential users from the visually impaired community. Sites will be identified in collaboration with the user panel and the municipal Conseil régional, Île de France to prioritize accessibility in public spaces. Subsequent architectural-acoustical models will be created and calibrated for the virtual navigation experiences. |
| |
| == WP 4 - Evaluation of training aide in real navigation conditions == | == WP 4 - Evaluation of training aide in real navigation conditions == |
| Evaluations by a recruited panel of visually impaired potential users will establish the degree of benefit of the VR training relative to traditional preparatory means, such as tactile maps and verbal descriptions. Benefits will be quantified with respect to spatial mental model accuracy, speed of navigation, autonomy, success rate to destinations, and level of self-confidence. | The fourth and final scientific work package constitutes the evaluation of the navigation prototype, employing spatial cognition methodologies developed in the first work package and the various iterations of the acoustic rendering engine developed in the second. Evaluations will specifically investigate the extent to which auditory virtual navigations aide in the preparation of indoor navigation in unfamiliar spaces, when compared to more classical methods. These evaluations will be at regular intervals throughout the project. |
| |
| ---- | ---- |
