Prompt for a VERY detailed XR Lesson Script: Safety

in the Manufacturing Environment

https://docs.google.com/document/d/1KDbmHJHHBr3Fg2WthEpco2m9r3hs2Gba/edit

Table of Contents
Prompt 2
1. Learn: 2
1.1 Overall Description supported by by related text, voice, images and videos 2
1.2 Show & Tell: 2
2. Train: 4
2.1 Assessment 4
2.2. The User trains on the procedure 4
3. Preform: 4
Safety in the Manufacturing Environment 5
GPT-4 Generated Lesson Script: Safety in the Manufacturing Environment 5
1. Learn 5
Learn: 1.1 Overall Description supported by related text, voice, images, and videos 5
1.2 Show & Tell: 6
2. Train 7
3. Perform: 7
Prompt
Assume the Persona of AI-based avatar with a digital body in Augmented Reality
that can teach you specific experiential extended reality lessons, called “XR Lessons” with
support of auto generated text, voice, images, videos, 3D objects and environments based on
autogenerated prompt scripts. The Avatar is a friendly AI knowledge Companion. The avatar
can both Tell you and show you things based on the prompt script in Augmented Reality. The
user is using a mobile device, AR glasses or VR device to experience the XR lesson.

Now generate a step-by-step detailed script that the Artificial intelligence avatar controlled
by GPT-4 will enact in its interaction with the user based on an existing virtual reality serious
game platform where the avatar can improve learning, training and performing for the
specific topic.

The Avatar virtual reality serious game script shall be structured in three steps:

1. Learn:
1.1 Overall Description supported by by related text, voice, images and videos
In this part of the script the avatar provides first an overall description of the lesson by
expanding on the lesson overview below. This overall description is supported by related
text, voice, images, and videos. The overall description contains the top things for the specific
lesson below.

1.2 Show & Tell:

In this part of the script the avatar provides to the user with a detailed list of the relevant 3D
Objects for the specific lesson below. This list is presented to the user visually with a
thumbnail image and an annotation for each 3D object as panel.
The user selects the up to 10 3D objects from the panel list.

Subsequently the avatar provides to the user with a list of the relevant Environments for the
specific lesson below. This list is presented to the user visually with a thumbnail image and
an annotation for each environment.

The user selects an environment from the list.

The selected 3D objects and environments are selected and displayed for the user in
augmented reality frame.

The user is asked to place, scale and rotate the 3D objects and environments to the users
satisfaction. Each 3D object has an annotation and often a 3D object has also multiple
components with their own annotations.
Now In this part of the script the avatar provides based on the specific lesson the avatar
shows the user how conduct an important procedure.
The Avatar is using Action Commands enacting the procedure while showing the user how
conduct an important procedure.
Action commands are predefined Avatar animations that include Avatar Movements, Body
Language, and Facial Expressions. Example of Action Commands are:
1. Avatar Action Commands:
2. Pick up an object
3. Pour a liquid
4. Measure a distance
5. Write on a board
6. Assemble parts
7. Use a tool (e.g., hammer, wrench)
8. Operate a machine
9. Calibrate an instrument
10. Perform a first aid procedure
11. Solder a connection
12. Mix chemicals
13. Conduct a test (e.g., soil, water)
14. Observe through a microscope
15. Plant a seed
16. Climb a ladder
17. Analyze data on a computer
18. Record observations
19. Communicate with team members
20. Navigate through a complex environment
21. Lift a heavy object
22. Object Action Commands:
23. Turn a valve
24. Adjust a microscope
25. Connect electrical components
26. Load a sample into a testing device
27. Attach a safety harness
28. Tighten a bolt
29. Secure a joint
30. Open a container
31. Seal a container
32. Replace a filter
33. Inspect a piece of equipment
34. Clean a surface
35. Move an object with a forklift
36. Install a component
37. Remove a component
38. Stack materials
39. Organize inventory
40. Control a drone
 41. Activate a fire extinguisher
42. Dispense a chemical
43. Environment Action Commands:
44. Adjust room lighting
45. Control ventilation
46. Open/close a door
47. Turn on/off equipment
48. Set up a workstation
49. Monitor a security camera
50. Change a room's temperature
51. Activate an alarm system
52. Position a movable barrier
53. Arrange furniture
54. Display information on a screen
55. Control background noise
56. Access a restricted area
57. Secure a room
58. Adjust a conveyor belt speed
59. Operate a crane
60. Control a robotic arm
61. Manage a production line
62. Set up a safety zone

The platform auto generates an animation sequence where the Avatar enacts the procedure
while explaining and interacting with the 3D Objects and environment using the action
commands. We call this that the Avatar “show and tell” the user how to do the procedure.
In the event the Avatar does not have the adequate 3D object or the adequate Action
Command the Avatar will instead show a relevant video or just talk about the specific step of
the procedure.

2. Train:
2.1 Assessment
In this part of the script the avatar the Avatar auto generates multiple choice quizzes and
challenges such as identify an object in the lesson or find an object.
2.2. The User trains on the procedure
In this part of the script the avatar tells the user to instead conduct the procedure himself.
The user must follow the exact steps that the Avatar has enacted in the “show and tell” part
of the procedure. To interact the user can use the pointer to grab and move objects or voice
commands to generate the action commands.

If the user does not remember a step the Avatar will provide support verbally and Visually as
the user requires help.
3. Preform:
In this part of the script the avatar asks the user to instead to perform the procedure himself
without any help inorder to be assessed.

The user must follow the exact steps that the Avatar has enacted in the “show and tell” part
of the procedure. To interact the user can use the pointer to grab and move objects or voice
commands to generate the action commands.

After the completion the avatar provides an assessment with regards to number of correct
steps, number of incorrect steps, unnecessary steps, overall score and time for executing the
specific process or operation.

Now Based on the instructions provided above pleaser Provide a detailed step-by-step
detailed script for this specific Lesson:

Safety in the Manufacturing Environment

Script: Teach users about workplace safety, including the use of personal protective
equipment (PPE), hazard identification, and emergency procedures. ·
Objects: PPE (helmets, goggles, gloves), hazard signs, fire extinguishers, emergency exits,
safety data sheets, machinery.
·Environment: Manufacturing facility or workshop. · Action Commands: Wear PPE, observe
hazards, locate safety equipment, follow emergency procedures.

GPT-4 Generated Lesson Script: Safety in the Manufacturing

Environment

1. Learn
Learn: 1.1 Overall Description

Lesson: Safety in the Manufacturing Environment Objective: Teach users about

workplace safety, including the use of personal protective equipment (PPE), hazard
identification, and emergency procedures.

The AI avatar begins with an overview of the lesson, stating its objectives and
providing a brief summary of the main topics. Images and videos of manufacturing
environments, PPE, and hazards are displayed to support the explanation.

Top things to learn in this lesson:

1. Proper use of personal protective equipment (PPE)

2. Identifying hazards in the workplace
 3. Locating and using safety equipment
4. Understanding and following emergency procedures

1.2 Show & Tell:

List of relevant 3D objects (with thumbnail image and annotation):

1. Helmet - Head protection from falling objects and collisions

2. Goggles - Eye protection from particles, liquids, and chemicals
3. Gloves - Hand protection from cuts, burns, and chemicals
4. Hazard sign - Visual indicator of potential dangers
5. Fire extinguisher - Essential equipment for firefighting
6. Emergency exit - Safe passage in case of emergencies
7. Safety data sheet - Detailed information on hazardous materials
8. Machinery - Common equipment found in manufacturing facilities

List of relevant environments (with thumbnail image and annotation):

1. Manufacturing facility - A typical factory setting with machinery and

equipment
2. Workshop - A smaller-scale work environment for specialized tasks

After the user selects up to 10 3D objects and an environment, the avatar presents the
augmented reality frame for the user to place, scale, and rotate the 3D objects and
environment to their satisfaction. Each 3D object has an annotation, and some objects
may have multiple components with their own annotations.

In this part of the script, the avatar shows the user how to conduct an important
procedure: ensuring safety in the manufacturing environment. The avatar enacts the
procedure while explaining and interacting with the 3D objects and environment using
action commands.

1. Wear PPE: The avatar puts on a helmet, goggles, and gloves, explaining the
importance of each item in protecting against workplace hazards.
2. Observe hazards: The avatar points out hazard signs in the environment,
explaining the meaning of each sign and how to respond accordingly.
3. Locate safety equipment: The avatar identifies the location of fire extinguishers
and emergency exits, emphasizing their importance in case of emergencies.
4. Follow emergency procedures: The avatar demonstrates the steps to take during
an emergency, including activating alarms, using firefighting equipment, and
evacuating the premises.
 5. Train: 2.1 Assessment The avatar generates multiple choice quizzes and
challenges related to the lesson, including identifying objects in the
environment, understanding hazard signs, and recalling emergency procedures.

2. Train

The User trains on the procedure The user is now instructed to perform the procedure
themselves, following the exact steps demonstrated by the avatar. They can interact
with the environment using a pointer to grab and move objects, or voice commands to
generate action commands.

If the user requires help, the avatar provides support through verbal and visual
guidance.

3. Perform:
The avatar asks the user to perform the procedure independently, without
assistance, to be assessed. The user follows the steps demonstrated in the “show
and tell” part of the procedure, interacting with the environment using a pointer to
grab and move objects or voice commands to generate action commands.

Upon completion, the avatar evaluates the user’s performance, providing an

assessment that includes:

1. Number of correct steps

2. Number of incorrect steps
3. Unnecessary steps
4. Overall score
5. Time taken to execute the specific process or operation

This comprehensive evaluation allows the user to gauge their understanding and
application of safety procedures in the manufacturing environment, with the avatar
providing constructive feedback to help the user improve their skills and knowledge.
By following this detailed script, the user can enhance their learning experience and
gain confidence in maintaining safety standards in real-world manufacturing
environments.
815 chars / 110 words
Prompt for a SIMPLE XR Lesson Script: Safety in the
Manufacturing Environment

Table of Contents
Prompt 2
1. Learn: 2
1.1 Overall Description supported by by related text, voice, images and videos 2
1.2 Show & Tell: 2
2. Train: 4
2.1 Assessment 4
2.2. The User trains on the procedure 4
3. Preform: 4
Safety in the Manufacturing Environment 5
GPT-4 Generated Lesson Script: Safety in the Manufacturing Environment 5
1. Learn 5
Learn: 1.1 Overall Description supported by related text, voice, images, and videos 5
1.2 Show & Tell: 6
2. Train 7
3. Perform: 7
Prompt
Assume the Persona of AI-based avatar with a digital body in Augmented Reality
that can teach you specific experiential extended reality lessons, called “XR Lessons” with
support of auto generated text, voice, images, videos, 3D objects and environments based on
autogenerated prompt scripts. The Avatar is a friendly AI knowledge Companion. The avatar
can both Tell you and show you things based on the prompt script in Augmented Reality. The
user is using a mobile device, AR glasses or VR device to experience the XR lesson.

Now generate a step-by-step detailed script that the Artificial intelligence avatar controlled
by GPT-4 will enact in its interaction with the user based on an existing virtual reality serious
game platform where the avatar can improve learning, training and performing for the
specific topic.

The Avatar virtual reality serious game script shall be structured in three steps:

1. Learn:
1.1 Overall Description supported by by related text, voice, images and videos
In this part of the script the avatar provides first an overall description of the lesson by
expanding on the lesson overview below. This overall description is supported by related
text, voice, images, and videos. The overall description contains the top things for the specific
lesson below.

1.2 Show & Tell:

In this part of the script the avatar provides to the user with a detailed list of the relevant 3D
Objects for the specific lesson below. This list is presented to the user visually with a
thumbnail image and an annotation for each 3D object as panel.
The user selects the up to 10 3D objects from the panel list.

Subsequently the avatar provides to the user with a list of the relevant Environments for the
specific lesson below. This list is presented to the user visually with a thumbnail image and
an annotation for each environment.

The user selects an environment from the list.

The selected 3D objects and environments are selected and displayed for the user in
augmented reality frame.

The user is asked to place, scale and rotate the 3D objects and environments to the users
satisfaction. Each 3D object has an annotation and often a 3D object has also multiple
components with their own annotations.
Now In this part of the script the avatar provides based on the specific lesson the avatar
shows the user how conduct an important procedure.
The Avatar is using A
The platform auto generates an animation sequence where the Avatar enacts the procedure
while explaining and interacting with the 3D Objects and environment using the action
commands. We call this that the Avatar “show and tell” the user how to do the procedure.
In the event the Avatar does not have the adequate 3D object or the adequate Action
Command the Avatar will instead show a relevant video or just talk about the specific step of
the procedure.

2. Train:
2.1 Assessment
In this part of the script the avatar the Avatar auto generates multiple choice quizzes and
challenges such as identify an object in the lesson or find an object.
2.2. The User trains on the procedure
In this part of the script the avatar tells the user to instead conduct the procedure himself.
The user must follow the exact steps that the Avatar has enacted in the “show and tell” part
of the procedure. To interact the user can use the pointer to grab and move objects or voice
commands to generate the action commands.

If the user does not remember a step the Avatar will provide support verbally and Visually as
the user requires help.

3. Preform:
In this part of the script the avatar asks the user to instead to perform the procedure himself
without any help inorder to be assessed.

The user must follow the exact steps that the Avatar has enacted in the “show and tell” part
of the procedure. To interact the user can use the pointer to grab and move objects or voice
commands to generate the action commands.

After the completion the avatar provides an assessment with regards to number of correct
steps, number of incorrect steps, unnecessary steps, overall score and time for executing the
specific process or operation.

Now Based on the instructions provided above pleaser Provide a detailed step-by-step
detailed script for this specific Lesson:

Safety in the Manufacturing Environment

Script: Teach users about workplace safety, including the use of personal protective
equipment (PPE), hazard identification, and emergency procedures. ·
Objects: PPE (helmets, goggles, gloves), hazard signs, fire extinguishers, emergency exits,
safety data sheets, machinery.
·Environment: Manufacturing facility or workshop. · Action Commands: Wear PPE, observe
hazards, locate safety equipment, follow emergency procedures.

GPT-4 Generated Lesson Script: Safety in the Manufacturing

Environment

4. Learn
Learn: 1.1 Overall Description

Lesson: Safety in the Manufacturing Environment Objective: Teach users about

workplace safety, including the use of personal protective equipment (PPE), hazard
identification, and emergency procedures.

The AI avatar begins with an overview of the lesson, stating its objectives and
providing a brief summary of the main topics. Images and videos of manufacturing
environments, PPE, and hazards are displayed to support the explanation.

Top things to learn in this lesson:

5. Proper use of personal protective equipment (PPE)

6. Identifying hazards in the workplace
7. Locating and using safety equipment
8. Understanding and following emergency procedures

1.2 Show & Tell:

List of relevant 3D objects (with thumbnail image and annotation):

9. Helmet - Head protection from falling objects and collisions

10.Goggles - Eye protection from particles, liquids, and chemicals
11.Gloves - Hand protection from cuts, burns, and chemicals
12.Hazard sign - Visual indicator of potential dangers
13.Fire extinguisher - Essential equipment for firefighting
14.Emergency exit - Safe passage in case of emergencies
15.Safety data sheet - Detailed information on hazardous materials
16.Machinery - Common equipment found in manufacturing facilities

List of relevant environments (with thumbnail image and annotation):

 3. Manufacturing facility - A typical factory setting with machinery and
equipment
4. Workshop - A smaller-scale work environment for specialized tasks

After the user selects up to 10 3D objects and an environment, the avatar presents the
augmented reality frame for the user to place, scale, and rotate the 3D objects and
environment to their satisfaction. Each 3D object has an annotation, and some objects
may have multiple components with their own annotations.

In this part of the script, the avatar shows the user how to conduct an important
procedure: ensuring safety in the manufacturing environment. The avatar enacts the
procedure while explaining and interacting with the 3D objects and environment using
action commands.

6. Wear PPE: The avatar puts on a helmet, goggles, and gloves, explaining the
importance of each item in protecting against workplace hazards.
7. Observe hazards: The avatar points out hazard signs in the environment,
explaining the meaning of each sign and how to respond accordingly.
8. Locate safety equipment: The avatar identifies the location of fire extinguishers
and emergency exits, emphasizing their importance in case of emergencies.
9. Follow emergency procedures: The avatar demonstrates the steps to take during
an emergency, including activating alarms, using firefighting equipment, and
evacuating the premises.
10.Train: 2.1 Assessment The avatar generates multiple choice quizzes and
challenges related to the lesson, including identifying objects in the
environment, understanding hazard signs, and recalling emergency procedures.

5. Train

The User trains on the procedure The user is now instructed to perform the procedure
themselves, following the exact steps demonstrated by the avatar. They can interact
with the environment using a pointer to grab and move objects, or voice commands to
generate action commands.

If the user requires help, the avatar provides support through verbal and visual
guidance.

6. Perform:
The avatar asks the user to perform the procedure independently, without
assistance, to be assessed. The user follows the steps demonstrated in the “show
 and tell” part of the procedure, interacting with the environment using a pointer to
grab and move objects or voice commands to generate action commands.

Upon completion, the avatar evaluates the user’s performance, providing an

assessment that includes:

6. Number of correct steps

7. Number of incorrect steps
8. Unnecessary steps
9. Overall score
10.Time taken to execute the specific process or operation

This comprehensive evaluation allows the user to gauge their understanding and
application of safety procedures in the manufacturing environment, with the avatar
providing constructive feedback to help the user improve their skills and knowledge.
By following this detailed script, the user can enhance their learning experience and
gain confidence in maintaining safety standards in real-world manufacturing
environments.
815 chars / 110 words