BCM3263

AUGMENTED REALITY

MINI PROJECT
(Cardiovascular Instrument Augmented Reality)

Name:
Muhammad Afif bin Ab Rahman

Lecturer’s Name:
Noraniza binti Samat

Course outcome Marks

CO1 /5

CO2 /5

CO3 /5
Table of Contents

Title Page

Introduction 1

Objectives 2

Scope 2

Comparison of existing AR system 3

Flow Chart 5

Content Structure 6

Storyboard 7

Conclusion & Potential of Project 14

References 15

Appendix (Full Coding) 16

Introduction

Augmented Reality is a new technology that created by many company around the world
now. Augmented Reality can be categories in many fields such as education, medicine, science,
tourism, and entertainment. There are rapid development system and project using Augmented
Reality technology especially in medical.

So, I have developed and design an Augmented Reality application which is Cardiovascular
Instruments application. The main objective of developing this application is make the medical
learning more interesting and interactive. Medical student whose taking course that specialize on
heart surgery are the target user if this application. This application is developed by using Unity
and Vuforia.

The users can view the user interface of the application to select which cardiovascular
instruments such as scalpel, forceps, clamp, scissors and others. The user also can view the
instrument image in 3D model. The user can understand more about the instrument by reading the
instrument description which include the short video on tutorial to use the instrument in proper
way.

The user needs to install this Cardiovascular Instrument application. The user need to scan any
each marker that provide in the book then the 3D model of instrument, short video of introduction
to the cardiovascular surgery, description for each instrument and the short video on tutorial to use
the instrument in proper way.

1
Objectives

● To make the medical learning experience more interactive and interesting.

● To give experience for heart surgery student in using Augmented Reality technology which
implemented in Cardiovascular Instrument.
● To enhance new experience and comparison to heart surgery student between with AR
technology or without using AR technology.

Scope

This application mainly focusing on the knowledge of the cardiovascular instrument. These scope
are important to identify fulfill the user satisfaction in using this application. The scopes are:
1. Users :
a. UMP students who lack of knowledge in using the gym equipment.
b. UMP staffs who interest to know about the gym equipment information.
2. Main focus:
a. Information of the cardiovascular instruments
b. Tutorial on using the cardiovascular instruments
3. Target users:
a. Heart surgery students

2
Comparison of existing AR system

1. IKEA Place:
The user can choose their favourite furniture other product that can be pop up in augmented
reality images. So, the user can see the product in different 3D side. This application is
using AR technology to the user gain more and new experience in using this application.
This application gives the user to view the 3D model of all the products provided. There
are some weaknesses in this application which the texture of the product might be different
compared to the real product. The colour of the product also can be different with the real
product. Thus, the application needs to be added some description about the texture of the
product. The colour needs to be more accurate with the actual product.

2. Makeup Genius:
The user can try all the makeup products on themselves by using this app. The user can see
the virtual makeup that look real. The AR technology is needed for this application to
improve the usability for the user. The app identifies your face and then will virtually show
you what you would look like with a certain shade or colour of a specific product. The
disadvantages of this application are the size of the image cannot be resized to see more
clear and specific images. Also, user cannot view the full 3D images of their face. So, the
application may need to be add a functional button that can resize the image for the best
view. Then, the developer need to change 2D images to 3D images for best view to the
user.

3. Ink Hunter:

3
 The user can try the virtual tattoos before inked for real time. There are many designs of
tattoos for any part of our body. AR technology is needed for this application because the
user will be more interesting and attractive to use this application. The user can see the
tattoos in any different angle. The user also can create their own tattoos using photo editor.
The weaknesses of the application are the user cannot change the colour in the apps but
need to edit in the photo editor. The applications not provide any resizable function for the
tattoos image. Thus, the application need addition function of tattoos colour changes. This
application also needs to be adding resizable function of tattoos size.

Flowchart

4
5
Content Structure

6
Storyboard

1. Main Menu of Cardiovascular Instrument

2. Introduction Page

7
3. Cardiovascular Instrument Page

4. Chestspreader Page
5. Clamp Page

8
6. Forceps Page

7. Needle Holder Page

9
8. Retractor Page

9. Scalpel Page

10
10. Scissor Page

11. Parts in Heart Page

11
12
Conclusion & Potential of Project

In conclusion, this project which is Cardiovascular Instrument AR application will attract

the user to use in their learning process. The use of the Augmented Reality technology will give
new experience to user in using this application. This application gives new experience for the user
to view the instruments such as scalpel, forceps, clamps and others by using AR technology.

Moreover, the applications also give more information about the cardiovascular
instruments so the user can gain new knowledge about it. The user need to scan the marker
provided in the book to display the image, description, short video and 3D model of the
cardiovascular instrument.

The potential of this application in future are it will help the user learn about the
cardiovascular instrument effectively.

13
Reference

• Rahman Ashar. (2019, October 31). Tutorial Augmented Reality Video Playback with
Unity and Vuforia [Video file]. Retrieved from

https://www.youtube.com/watch?v=VQJ3lO9DjMk

• MatthewHallberg. (2017, March 28). Lets Make an Augmented Reality App in 6

MINUTES!!!! DONALD TRUMP EDITION [Video file]. Retrieved from

https://www.youtube.com/watch?v=khavGQ7Dy3c

• Mir Imad. (2018, May 28). "Vuforia Play Video Unity | Play Video in AR App | Unity
2017.3 AR Video Vuforia | Augmented Reality [Video file]. Retrieved from

https://www.youtube.com/watch?v=HcQ7MBUw2Qo

• CubicBrain. (2017, November 14). How to create Virtual button with Vuforia AR &
Unity3D [Video file]. Retrieved from

https://www.youtube.com/watch?v=ElmzIq6stNI

• Denys Gamers Tutorial. (2017, December 6). Build User Interface Augmented Reality
Using Unity & Vuforia [Video file]. Retrieved from

https://www.youtube.com/watch?v=n9xXPndegK0

• Daniel Wood. (2015, October 15). Unity Tutorial 4 – How to apply material, shaders and
textures to objects in Unity [Video file]. Retrieved from

https://www.youtube.com/watch?v=MGIBLPIz4oM

• Joystick Lab. (2018, July 20). Day 11 : Augmented Reality (AR) Tutorial : Virtual Button
with Unity and Vuforia [Video file]. Retrieved from

https://www.youtube.com/watch?v=wuzJGO_13E0&t=599s

• Brackeys. (2017, November 29). START MENU in Unity [Video file]. Retrieved from

https://www.youtube.com/watch?v=zc8ac_qUXQY

14
• Denys Gamers Tutorial. (2018, October 13). How To Augmented Reality Video Playback
Unity 2017|2018 & Vuforia [Video file]. Retrieved from

https://www.youtube.com/watch?v=Zof9nsC5iH0&t=646s

• Jason Weimann. (2018, February 8). UGUI Button over Models in Unity3D [Video file].
Retrieved from

https://www.youtube.com/watch?v=tHEG95vrO_Q

15
APPENDIX

16
Full Coding

content.cs

using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.SceneManagement;

public class content : MonoBehaviour

{

public void button(string scenename)

{
SceneManager.LoadScene(scenename);
}

PanelOpener.cs

using System.Collections;
using System.Collections.Generic;
using UnityEngine;

public class PanelOpener : MonoBehaviour

{
public GameObject Panel;

public void OpenPanel()

{
if (Panel != null)
{
bool isActive = Panel.activeSelf;

Panel.SetActive(!isActive);
}
}
}

17
rotateCube.cs

using System.Collections;
using System.Collections.Generic;
using UnityEngine;

public class rotateCube : MonoBehaviour

{
float rotateSpeed = 200;

private void OnMouseDrag()

{
float rotX = Input.GetAxis("Mouse X") * rotateSpeed * Mathf.Deg2Rad;
float rotY = Input.GetAxis("Mouse Y") * rotateSpeed * Mathf.Deg2Rad;

transform.Rotate(Vector3.up, -rotX);
transform.Rotate(Vector3.right, rotY);
}
}

VButtonManager.cs

using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using Vuforia;
using UnityEngine.Video;

public class VButtonManager : MonoBehaviour, IVirtualButtonEventHandler

{

public VideoPlayer player;

public GameObject playButton;
// Start is called before the first frame update
void Start()
{
GetComponent<VirtualButtonBehaviour>().RegisterEventHandler(this);
}

public void OnButtonPressed(VirtualButtonBehaviour vb)

{
player.Play();
playButton.GetComponent<Renderer>().enabled = false;
}

public void OnButtonReleased(VirtualButtonBehaviour vb)

{
player.Pause();
playButton.GetComponent<Renderer>().enabled = true;
}

18
WorldPositionButton.cs
using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.UI;

public class WorldPositionButton : MonoBehaviour

{
[SerializeField]

private Transform targetTransform;

private RectTransform rectTransform;

private Image image;

private void Awake()

{
rectTransform = GetComponent<RectTransform>();
image = GetComponent<Image>();
}

private void Update()

{
var screenPoint = Camera.main.WorldToScreenPoint(targetTransform.position);
rectTransform.position = screenPoint;

var viewportPoint = Camera.main.WorldToViewportPoint(targetTransform.position);

var distanceFromCenter = Vector2.Distance(viewportPoint, Vector2.one * 0.5f);

var show = distanceFromCenter < 0.3f;

image.enabled = show;
}

19
Screenshot of the Cardiovascular Instrument

Main Menu Introduction page

Cardiovascular instrumental page Chestspreader page

20
 Clamp page Forcep page

Needle holder page Retractor page

21
 Scalpel page Scissor page

Parts in heart

22