DAYANANDA SAGAR COLLEGE OF ENGINEERING

DEPARTMENT OF TELECOMMUNICATION ENGINEERING

A Technical Seminar Report on

“IMMERSIVE LEARNING USING AUGMENTED REALITY”

Submitted by Under the guidance of

AJITESH DAS Mr. SANTHOSH B
1DS15TE005 ASSISTANT PROFESSOR
8th SEM

1
 DAYANANDA SAGAR COLLEGE OF ENGINEERING
BANGALORE

➢ VISION
To impart quality technical education with a focus on Research and Innovation emphasising on Development of Sustainable and
Inclusive Technology for the benefit of society.
➢ MISSION
• To provide an environment that enhances creativity and Innovation in pursuit of Excellence.
• To nurture teamwork in order to transform individuals as responsible leaders and entrepreneurs.
• To train the students to the changing technical scenario and make them to understand the importance of Sustainable and
Inclusive technologies.

DEPARTMENT OF TELECOMMUNICATION ENGINEERING

➢VISION
To disseminate quality technical education for achieving Academic Excellence through focused research encompassing Mobile, Sensor, and
Telecommunication networks with a thrust on Space Communication and Telecommunication Standards.

➢MISSION
• By disseminating the knowledge of devices, systems, and technologies that are impacting the Telecommunication field.
• By educating students towards multidisciplinary practices of Telecommunication industry and standards for a successful career.
• By inculcating research attitude among graduates through life long learning related to Telecommunication and its allied domain.

2
 PEO’S
• Telecommunication industry, Government organizations and Society by applying skills acquired through formal technical education
and has the ability to pursue higher studies, research in the program domain for attaining a successful career.

• The graduate demonstrates ability to apply Scientific, Mathematical and Electronics and Telecommunication engineering
knowledge with multidisciplinary approach for solving real life problems.

• The graduate possesses temperament of professional attitude, effective communication skills, ability to work and lead a team with
ethics.

• The graduate demonstrates continuous learning to upgrade knowledge of emerging Telecommunication technologies through
training and interaction with professional bodies for sustainable solution to changing scenarios in the technology with a focus on
safety and environmental concern.
PSO’S

• To apply fundamental concepts of electrical and electronic circuits to analyse communication theory and systems.

• To design embedded system based solutions for realizing the real-time communication networks.

• To evaluate the core merits of signal processing and network protocols for Electronics and telecommunication engineering
standards, services and applications.

3
 COURSE OBJECTIVES

• To develop knowledge on recent trends in multidisciplinary fields.

• To develop the skills to use technical resources.
• To develop the skill for oral presentation and prepare technical documents by using modern tools.

COURSE OUTCOMES

• To apply knowledge in the current trends and technologies in the telecommunication engineering domain.

• To use technical resources to study multidisciplinary fields.

• To do the literature survey study on recent trends and technologies in the telecommunication sector.

• To investigate problems after literature survey using various resources.

• To execute the oral presentation on multidisciplinary fields.

• To generate technical document using Latex or MS-Word.

4
 ABSTRACT

The progression of Augmented reality (AR) and holographic projection innovations have an incredible
potential to support and improve instructing and learning process, on the grounds that the 3D pictures
give new viewpoints to the students to get it certain theme effectively and instinctively. An Interactive
Holographic Display is presented, which is expected to facilitate the educators to convey the
information to the students as well as to provide self-learning to the students. This proposed
arrangement is executed utilizing the Augmented Reality method and interlinked with 3D holographic
pyramid display. Through this method the virtual objects can display in slight air like a real item and
makes the holographic impact progressively realistic and intuitive, as the user can interact with the
virtual items utilizing a picture target. It clarifies how the framework is physically acknowledged in
term of hardware equipment setup and programming structure.

5
 INTRODUCTION
➢ The advancement in computer graphics and multimedia technologies have changed the
way human view and interact with the virtual world, such as the augmented reality (AR)
and the hologram display.
➢ The usage of AR display devices, such as smartphones and smart glasses, allow the user to
receive additional information, which is in the form of informative graphics based on his or
her field of view through the device.
➢ The use of holographic pyramid prism can produce the holographic results that displayed
the 3D objects in the real world environment, by letting the user to look at different
perspective of these holograms when viewing from different angles.
➢ 3D images allow the student to understand certain topic easily and intuitively.
➢ The digital content to be shared in a group of people easily without the use of glasses and
wearable devices
➢ Thus, these multimedia technologies have a great potential to support learning and
teaching
6
 EXISTING METHODS
➢ The current AR application is displayed in a small screen of smartphone where not many
information can be displayed on the screen which caused difficulty for the user to view the
content on the screen.
➢ Difficulty for the user to view the content on the screen.
➢ Users also need to always hold their smartphones or tablets and target their devices to an
image target.
➢ Socially separated user experience.
➢ Human-computer interaction difficult and hard to share the digital content.
➢ Recently the application of holographic pyramid is static and support for exhibition
displays only.
➢ Although there is some effort being made to improve the interactivity of holographic
display using hand gestures.

7
 PROPOSED METHOD
➢ Interactive Holographic Display is used to to improve the interactivity in the student’s
learning process.
➢ It is implemented using the AR tracking technique and fused with 3D holographic pyramid
display.
➢ The virtual objects can display in thin air like a real object.
➢ User can also interact and view various 3D objects in just one holographic pyramid by using
a specially designed AR image target – the EduCard.
➢ It consists of animation and also the audio explanation about a certain topic.
➢ Easy for teachers to deliver knowledge to students.
➢ Self-learning to students.
➢ The resources used to build the holographic pyramid are easy to gather and cheap.
8
 WORKFLOW
➢ The users need to place the EduCard – a specially designed AR image target, within the
webcam’s range of view.
➢ If an input marker is detected, the AR tracking technique is used to determine which and
where the virtual object should display in the virtual world according to the EduCard.
➢ The four cameras are setup within the virtual world that represent the front view, back
view, left view and right view of the displayed virtual object
➢ The four cameras’ viewport are rendered onto the four image textures
➢ All the image textures are projected on the screen and then are projected on the
holographic pyramid according to the Pepper’s Ghost technique.

9
 Implementing AR Techniques

➢ The EduCard, which is an image target or AR marker to allow the Vuforia SDK to detect
and track
➢ There are two types of EduCard :
1) Base Card : The base card type contains the basic introduction of a certain topic
2) Extra Content Card : the extra content card type contains a specific content based on the
base topic.
➢ The extra content card type cannot work on its own and is required the base card type to
be presented within the webcam’s range of view and is detected by the SDK.
➢ If there are more than one base card type within the webcam’s range of view, the first
10
base EduCard placed in the range is choosen to be detected
 Holographic Display Configuration

➢ Four cameras are placed in the Unity 3D

scene to render the four viewports of the
virtual object to be projected onto each side
of the pyramid.
➢ The four cameras’ viewport are rendered
onto four render textures
➢ The final output for texture facet rendering
is displayed on the monitor screen
➢ The holographic pyramid is required to set
up in order to display the holographic object
in the real-world environment.
11
12
 Software Development
➢ Idle state :
o A 3D UTM logo is shown floating in the holographic
pyramid.
o This state is ready to detect the present of the EduCard.
o If a base educard is presented in the webcam’s range of view
and is detected by the Vuforia SDK, the system changed its
state into Base Content state.[6]
➢ Base Content state :
o The 3D content of the EduCard is displayed in the
holographic pyramid while the 3D UTM logo is hided.
o The audio explanation about the content is played.
o If the Vuforia SDK lost detect the base EduCard, the system
changed its state back to Idle state.
o If an extra content EduCard that is related to the base
EduCard is detected by Vuforia, the system changed its 13

state into Extra Content state.[7]

➢ Extra Content state :
o The extra 3D content of the EduCard is displayed in the holographic pyramid.
o The audio explanation from the Base Content state is stopped if the audio is not finished
playing
o The audio explanation about the extra content is played.
o If the Vuforia SDK lost detect the base EduCard, the system changed its state back to Idle
state.
o If the Vuforia SDK lost detect the extra content EduCard, the system changed its state
back to Base Content state only if the audio explanation of extra content is finished
playing.
o If another extra content Educard, that is either related to the base EduCard or not, is
presented within the webcam’s range of view, the system continues displayed the content
of the first extra content EduCard.[8]

14
 RESULT
➢ The Interactive Holographic Display is a standalone PC application that integrating
EduCard with augmented reality (AR) tracking and holographic pyramid display.
➢ Placing the “Earth” card together with the “Moon” card, the 3D animation showed that the
moon circulated the Earth with audio explanation.

15
 Advantages Disadvantages
• The holographic technology can supply high- • It has higher production cost compare to 2D
quality images & accurate depth cues viewed projection.
by the human eyes without any special
observation devices
• It is not easily seen in the presence of
fluorescent lighting.
• Holographic technologies can be easily
• It is time consuming to construct images using
combined with other technologies.
3D holograms.
• It is very cost effective solution to make
• Still developing technology
• It delivers enhanced feasibility of objects
• It is expensive to develop the AR technology
including depth.
based projects and to maintain it.
• Simpler interface and intuitive to use.
• Lack of privacy is a concern in AR based
• The AR system is highly interactive in nature applications.
and operates simultaneously with real time
environment.
• It requires basic learning to effectively use AR
compliant devices.
• It enhances perceptions and interactions with
• Small displays can lead to smaller pyramid
the real world.
prism which lead to smaller holographs and
• It reduces line between real world and virtual less space for details.
world.
16
 APPLICATIONS

➢ Holographic optical elements (HOE’s) are used for navigation by airplane pilots. A
holographic image of the cockpit instruments appears to float in front of the windshield.
This allows the pilot to keep his eyes on the runway or the sky while reading the
instruments.
➢ It can be used in immersive and effective learning.
➢ Medical doctors can use three-dimensional holographic CAT scans to make measurements
without invasive surgery.
➢ Holograms are used in advertisements and consumer packaging of products to attract
potential buyers.
➢ Holographic memory is a new optical storage method that can store 1 terabyte (= 1000 GB)
of data in a crystal approximately the size of a sugar cube. In comparison, current methods
of storage include CD’s that hold 650 to 700 MB, DVD’s that store 4.7 GB, and computer
hard drives that hold up to 120 GB. 17
 CONCLUSION
➢ The Interactive Holographic Display is one of the starting point to revolutionize the
holographic application with user interaction using AR tracking technique.
➢ These can improve the enjoyment of the student toward learning and allows them to
actively participate in the classroom.

18
 REFERENCES
[1] Wu, H. K., Lee, S. W. Y., Chang, H. Y., & Liang, J. C. (2013). Current status, opportunities and challenges of
augmented reality in education. Computers & Education, 62, pp. 41-49.
[2] Perozo, J., Lo Leung, M., & Ramírez, E. (2016). HoloMed: A Low-Cost Gesture-Based Holographic. arXiv preprint
arXiv:1607.05812.
[3] Sutter, J. D. (2010). New phone apps seek to 'augment' reality. CNN. Available from:
http://edition.cnn.com/2009/TECH/10/24/tech.augmented.reality.apps/in dex.html?_s=PM:TECH. [7 June 2017].
[4] Muhammad, A. B. A., Ismail, N. A. F., & Sunar, M. S. (2016). Reflective Prism Display Using Pepper’s Ghost
Technique Software Toolkit Plugin for Unity 3D. Jurnal Teknologi (Sciences & Engineering). 78(12–3), pp. 189-196.
[5] Maass, U. (1999). U.S. Patent No. 5,865,519. Washington, DC: U.S. Patent and Trademark Office.
[6] Unity Manual (2017). Camera. Available from: https://docs.unity3d.com/Manual/class-Camera.html. [28 August
2017]
[7] Unity Manual (2017). Prefabs. Available from: https://docs.unity3d.com/Manual/Prefabs.html. [28 August 2017]
[8] Unity Manual (2017). Animator Controller. Available from: https://docs.unity3d.com/Manual/class-
AnimatorController.html. [28 August 2017]

19