Research and Design of Mixed Reality

Architecture in Space Habitats

Aditi Singh Mohit Dharmani Sanika Bandekar

Aerospace Engineering
SMEC
VIT Bhopal University

Research and Design of Mixed Reality Architecture in Space

Habitats
 Thesis submitted to the

VIT Bhopal University

in partial fulfillment of the requirements for the

DSN2099 Project Exhibition - II

Submitted by

Aditi Singh Mohit Dharmani Sanika Bandekar

1. 20BAS10063 Aditi Singh
2. 20BAS10074 Mohit Dharmani
3. 20BAS10089 Sanika Bandekar

Under the supervision of

Dr. Prashant G K

Aerospace Engineering, SMEC

VIT Bhopal University, Madhya Pradesh

May, 2021

Page | 1
 Aerospace Engineering, SMEC
VIT Bhopal University

Date: 25/05/2022

Supervisor Certificate

This is to certify that the work presented in the Thesis titled “Research
and Design of Mixed Reality Architecture in Space” is the bonafide
work of “ Aditi Singh Registration number 20BAS10063, Mohit Dharmani
Registration number 20BAS10074, Sanika Bandekar Registration number
20BAS10089” is a record of original research carried out by him/her under
my supervision and guidance in partial fulfillment of the requirements of
the Bachelor of Technology in Aerospace Engineering.

Dr. Prashant G K
Supervisor

Page | 2
 Acknowledgment

We would like to express our gratitude towards Dr. Prashant G K sir for his
constant support and valuable guidance which led to the completion of our
project on the Research and Design of Mixed Reality Architecture in Space
Habitats.

Special thanks to our Vice Chancellor for providing us with this

opportunity to better our minds and skills.

We would also like to acknowledge with appreciation the efforts of our

university VIT Bhopal for giving us a chance to work on such projects.

Aditi Singh Mohit Dharmani Sanika Bandekar

Page | 3
Abstract

Page | 4
As we take the next steps towards establishing a permanent presence off-Earth, the
challenge will be to transition from simply providing systems to offering meaningful
habitats that enable their occupants to thrive. Space agencies are constantly looking
for ways to practice, training ground control and astronauts in environments that are
as close to the real thing as possible and Immersive technologies provide the perfect
means to do this.
This comes after the difficulties that the astronauts have to go through while in space
mainly Struggling with manual control of the vehicle or systems, Disorientation, lack
of eye hand coordination, reduced real time communication, homesickness, post
flight disorientation all of which negatively affect their performance levels. The main
focus of VR and MR technologies is to promote optimal performance, physical and
psychological health conditions, and ensure safety in long duration spaceflight. VR
technology can be used to provide orientation and navigation training for Intra-
Vehicular Activities (IVA) to astronauts, which is already being used by NASA for
its missions.
Mixed Reality can be experienced in a variety of forms depending on the hardware,
which ranges from non-immersive flat screens, to room-based systems such as CAVE
installations, to highly immersive projection based visualizations, to head-mounted
displays. A Cave Automatic Virtual Environment (better known as CAVE) is an
immersive virtual reality environment where projectors are directed to between three
and six of the walls of a room-sized cube to achieve excellent image quality and a
great experience of real time environment and communication.
In this paper we have considered the Bigelow aerospace B330 Space module as part
of our research and have also suggested ways to enhance space exploration by
introducing mixed reality and designing a CAVE system that can be installed in any
space module. Designing such a system comes along with multiple other
requirements like Power requirements and structural iterations and/or additions for
the system’s installation inside the module that will define MR system parameters
and limitations. Along with the management of interference with existing hardware of
the MR System.
A highly immersive system would lead to high levels of presence, engagement, and

Page | 5
thus, would lead to more significant psychological responses. Although there are
many challenges that need to be conquered in order to build such a complex system,
the idea of an immersive space habitat can be gradually adapted and tested
throughout various Technology Readiness Levels (TRL), including space-rated in
upcoming launches. They will become a true partner to humans in new worlds !

Contents

Page | 6
 Description Page No.
Supervisor certificate 02
Acknowledgment 03
Abstract 04
List of Tables
List of Figures
Abbreviations 06
Chapter – 1 Introduction 07
Chapter – 2 Literature review 08
2.1 Motivation of the study 10
2.2 Objective of the work 10
Chapter – 3 Methodology 12
Chapter – 4 Results and Discussions 13
Chapter – 5 Conclusion 16
Chapter – 6 Future scope of the study 17
References 18
List of publications (if any)

Abbreviations:
International Space Station (ISS) Virtual
Reality (VR)
Augmented Reality (AR) Mixed
Reality (MR) Cave
Automatic Virtual Environment (CAVE)
Extravehicular Activity (EVA)
Head Mounted Displays (HMDs)

Chapter - 1

Page | 7
INTRODUCTION

Our exploration of space has provided some of the most iconic and
definitive moments in human history.
As we move further and gain more knowledge, the main question that
arises is what kind of habitat is needed in an environment that is totally alien and
likely to kill you?
In an environment that is comprehensively foreign to all prior human
experience, and where almost any system failure will result in life threatening
consequences, any constructed living space needs to contribute to our adaptation
to the challenges of living off-Earth. Such conditions will also present challenges
unforeseen by mission planners and situations where residents will have to be
resourceful and address problems in unconventional ways. For example, interior
environmental features used on Earth may be unsuitable for different gravity
environments.
Mixed Reality or MR is a blend of physical and digital worlds, unlocking
natural and intuitive 3D human, computer, and environmental interactions. This
new reality is based on advancements in computer vision, graphical processing,
display technologies, input systems, and cloud computing. Mixed Reality can be
experienced in a variety of forms depending on the hardware, which ranges from
non-immersive flat screens, to room-based systems such as CAVE installations,
to highly immersive projection based visualizations, to head-mounted displays.
We can say that Mixed Reality (MR) systems are indeed going to play a
significant role in maintaining the psychological comfort of residents in long
duration space habitats.

Chapter – 2
LITERATURE REVIEW
This [1] paper includes strategies to enhance the experience during long space
flights through the implementation of virtual reality and mixed reality
technologies. It focuses broadly on using Mixed Reality technology for
improving the psychological health and environment, for the following two

Page | 8
scenarios : Firstly for when the astronauts will be on long missions stretching up
to 800-900 days (MARS Missions) and secondly for enhancing the experience of
Space Tourism. The paper describes and contrasts two ways that can help the
astronauts to experience an immersive environment that is either by using
projection based MR technology or by using Head Mounted Displays(HMDs).
For the projection based system this paper presented the possible places within
the core of Bigelow aerospace B330 Bigelow Expandable Activity Module
(BEAM) where in the projectors could be fitted in a sense where they don’t
disturb other equipment or block ways for astronauts.

Fig. 1. B330 design iterations

The HMDs are used extensively for maintenance programs or crew training on
ground. Although using them onboard the spacecraft is not advised. The reason
being, The astronauts are already exposed to radiation and have to work in zero
gravity while in space, and on returning they have reported problems with
eyesight. So usage of projection based systems was preferred over using HMDs.

The paper [2] is also focused on building de-stressing habitats for Astronauts to
cope up with stressful space environments. According to the paper, from a design
standpoint three basic components that bridge between behavior and environment
are identified as the human component, the system component (man-made
technical infrastructure) and the environment (natural context). The paper
suggests ways to overcome the sameness in flight as it focuses on enhancing the
interior architecture – using digital walls/windows, lighting, textures and colors,

Page | 9
for example - and introducing novelty while remaining passive and relatively

autonomous.

Fig. 2. Conceptual design for an Almaz space station utilizing deployable surfaces and
screens for projections.

Such qualities can be somewhere expensive in terms of resources and electricity,

as well as damaging to internal environmental and structural conditions in
extraterrestrial settlements. Thus there is a need for a system that can be easily
installed in any module that won’t interfere with existing infrastructure of the
spacecraft.

Page | 10
2.1 Motivation

In the deep-space setting, where the general reduction of situational stimuli

(especially external cues) is unavoidable, various environmental design features
sufficiently flexible to generate novelty can mitigate the monotony inside the
vehicle. Sameness, repetitive work and never-changing external environments
can lead to the feeling of boredom (an emotional state often described as
emptiness, meaninglessness, lack of interest and disconnection between the body
and the mind), which frequently promotes dangerously risky coping responses.
To date, during actual spaceflight, visuals in MR-based interventions have
required the crewmember to deliberately and actively engage in the experience
(typically delivered through a head-mounted display), which may hinder its
overall efficacy. Hence, our motivation of using mixed reality was to overcome
these problems and create a habitable and permanent environment presence off
earth.

2.2 Objective
In the very long journey time and confined spaces the astronauts have to
go through a series of unique stresses and difficulties during any space
missions. By offering an immersive alternate reality to step into then, VR
and MR technologies could be a lifeline when it comes to keeping
astronauts in sense in any situation during the mission.
For example, Mixed Reality was used for the Orion capsule assembly, and
in the ISS for assembly and operation of ISS Racks and for maintenance
and storage protocols, as a part of the Augmented Reality Application for
Maintenance, Inventory and Storage (ARAMIS) investigation. Certain
space agencies are already using Virtual Reality for maintenance and
crew training for ground operations.

Our objective is to design a MR CAVE system that can be easily installed

in any module to better develop the psychological health of the astronauts
and to enhance the overall long flight experience and help the inhabitants
to:

● To make them feel stimuli of being in the natural environment

Page | 11
● To analyze the architectural design requirements of the selected
spacecraft for arrangement of MR technology ie arrangement of
projectors and screens ( CAVE System)
● With due perspective of placing the projectors in a way that don’t
occupy much space and screens integrated within the walls of
spacecraft or module
● Screen materials characteristics and deployment along with storage
and power requirements
● Finally Designing a CAVE system that can be installed in any type
of module and that the astronauts won’t have to wear the HMDs to
get into the immersive environment

Page | 12
Chapter – 3
METHODOLOGY
● The methodology used to achieve our objective:
● Research and analysis of papers [1] [2] on MR technology in space
● Realized the need for MR technology and to build CAVE systems
in spacecrafts for optimal performance of astronauts
● Here we chose Blender to model our CAVE System.
● In Blender, we designed a basic 3D model of the CAVE system,
placed the projectors, and then edited it in two modes- Solid and
Rendered mode.
● The size of the Screen is approximately 12 meters.
● All of this is just to make the entire space journey more serene and
comfortable!

Page | 13
Chapter – 4
RESULTS AND DISCUSSIONS

Here we have designed a 3D model of the CAVE system that can be

carried into space to help astronauts enhance their space flight experience.
How this system works : The CAVE system will be mounted on the
spacecraft's surface.The spacecraft’s surface will be in blend mode hence the
galaxy below can be seen from within the spacecraft. Apart from the view of the
galaxy, the astronauts can experience real time projections of their family
members which will help them relieve from the stresses like being confined
within small spaces of the spacecraft, lack of communication etc.
This same model can be installed on surfaces of other planets and also be
used to study the environments and terrains of planets that are lined up to be
explored. Let us for instance consider the MARS exploration mission, where the
rovers will have already collected the data and the pictures of the Martian
surface, and this collected data will be then compiled and loaded into the cave
system. Now the crew on the Martian surface as well as the crew in the
spacecraft and
the crew on
earth can all
experience the
Martian
environment.
As the crew on
earth will be
experiencing
the Martian
surface with
the help of the CAVE system it can direct the astronauts accordingly. 1

1 fig. showing side view of the CAVE system in blender in Solid mode

Page | 14
Page | 15
Chapter – 5
Page | 16
CONCLUSION

There are many challenges that need to be addressed in space habitat design for
deep space exploration and commercial application. Till date no CAVE system
has been sent up in space as part of MR technology for both recreational
purposes as well as for technical use. The entire concept of MR technology is
still new and under development, to be implemented soon for actual missions.
The usage of a projection-based system of MR in space habitats can support a
wide range of functions including entertainment, team building, social activities,
preparation for crew operations, assisting with maintenance protocols, etc.
The need for behavioral and performance in-flight support infrastructure,
particularly through meaningful habitat systems has been recognized as critical
by psychologists, designers and mission planners alike.

Chapter – 6
FUTURE SCOPE OF THE STUDY

Page | 17
As we take the next steps towards a permanent presence off-Earth, the task will
be to move from simply providing systems to offering meaningful habitats that
go beyond provisions for mere coping and surviving to those that enable their
occupants to thrive. Even though psychologists, designers and mission planners
have long recognized the importance of an optimal habitat yet it remains elusive.
Technologies of mixed reality and fractals can really help in this.

With the inclusion of MR/VR-based architectural features, the incorporation of

fractal characteristics that represent interventions in space won’t require every
crew member to deliberately and actively engage in the experience which to date,
has typically been delivered through a head-mounted display.

Other MR technologies have yet to be studied as an integral design element of

the habitat. As a result dynamic unobtrusive virtual imagery - particularly
projection-based imagery provides a modified space perception of real spaces. It
also enhances the interior architecture mainly using digital walls/windows,
lighting, textures and colors, for example, and introduces novelty while
remaining passive and relatively autonomous. Implementing such capabilities
means that future space habitats can be anything but sterile, boring and cold!
They will become a true partner to humans in new worlds.

References:
1. Tamalee Basu aOlgaBannovaa and Jorge D.Cambab TamaleeBasu aOlgaBannovaa
and Jorge D.Cambab a. Sasakawa International Center for Space Architecture,
University of Houston, 4800 Calhoun Rd, Houston, TX,77004, USA b. Department
of Computer Graphics Technology, Purdue University, 401 N Grant St, West
Lafayette, IN, 47907, USA “Mixed reality architecture in space habitats” Acta
Astronautica Volume 178, Pages 548-555, January 2021

Page | 18
2. Olga Bannova, Sheryl L Bishop, Sandra Häuplik-Meusburge, Jorge D Camb
“Mixed reality in the design of space habitats”. Astronautics Pages 59-63 , 2020.

3. https://docs.microsoft.com/en-us/windows/mixed-reality/discover/mixed-
reality#:~:text=Mixed%20reality%20is%20a%20blend,input%20systems
%2C%20and%20cloud%20computing.

4. https://en.wikipedia.org/wiki/Cave_automatic_virtual_environment

5. https://upcommons.upc.edu/bitstream/handle/2117/99668/
NovaCave.pdf;jsessionid=65AC1E27D7E514FB40C62F7F68C9EED6?
sequence=1

6. https://www.youtube.com/watch?v=5Br-y6S4pMc

Page | 19