Development of a hyper-realistic 3D digital news anchor with

AI interaction with audience

3D design & graphic UI

Real Time interaction

AI algorithm

Combine all

Mixed Reality

Testing and metodology

3D design & graphic UI
Environment, character, architecture, are transcendental
Obtaining immersive experience

Human-like hyper-realistic character in a hyper-realistic environment

Increase immersion

Enormous amount of resources to develop hyper-realistic characters and environments

Ph.D. Proposal
polito.it
Real Time interaction

Facial expressions the character will perform

Provide the audience the illusion that the character is a real human
Rigged facial expressions
Concatenated with real time text that shows up from the datastore

Real time ray tracing rendering

Real time text data showed up in an input field
Work with motion capture technology
Potent graphic card
Enhances the realism of the character and environment renders

Ph.D. Proposal
polito.it
AI algorithm
interaction between the character and the audience

Natural Language Process (NLP)

Same duties a chatbot has
Covert the audio from the voice of the user, to text, to vectors, “understand” the meaning of the
sentence, back to text and audio again
Same duties a chatbot has

Natural human voice

Voice processor to express it with human-like audio.

Algorithms have to be extremely accurate and secure

Information retrieval
Extraction
Machine translation
Summarization
Auto-text and voice correction
Speech recognition
Ph.D. Proposal
polito.it
Combine all
Combine in one system the prior blocks

The realistic human-like character with real time rendering and facial expressions has
to perform its gestures and body movements according to what the AI system has
provided in its algorithms.

This will be still rendered in unreal engine but with a AI system plug-in written with Python.

Ph.D. Proposal
polito.it
Mixed Reality
Massive MR interaction

HoloLens 2 headset.
Head tracking and real time eye tracking features
IMU and voice commands
Spatial mapping and mixed reality capture

Real time environment tracking

Better project user interaction
AR technology will recognize the wall and, of course, prevents the user to hit against it.

UI and UX
Perfectly tied to the graphics, production, stimuli
Personalization of certain parameters that the users acknowledge as important
Music taste
Texture preferences
Visual preferences
Ph.D. Proposal
polito.it
Testing and metodology
Testing
Gamers
Typical users may not have any previous knowledge in VR, AR, MR or video games

Metodology
Methodology has to be qualitative and descriptive
Testing in users and obtaining their appreciation to the system

Consider a brief psychological study to understand the different responses each

user could manifest and if in reality the user is hyper-im- mersed in a new reality.

The quality of the components, software, the system in gener- al will be crucial
when testing the functionality of the research. A poor development will
mean an unpleasant experience and in consequence a dangerous
result for the research.
Ph.D. Proposal
polito.it