Professional Documents
Culture Documents
Training in Virtual Reality Enables Learning of A Complex Sports Movement
Training in Virtual Reality Enables Learning of A Complex Sports Movement
https://doi.org/10.1007/s10055-022-00679-7
ORIGINAL ARTICLE
Received: 10 January 2022 / Accepted: 4 July 2022 / Published online: 22 July 2022
© The Author(s) 2022
Abstract
Despite the increased use in sports, it is still unclear to what extent VR training tools can be applied for motor learning
of complex movements. Previous VR studies primarily relate to realize performances rather than learning motor skills.
Therefore, the current study compared VR with video training realizing the acquisition of karate technique, the Soto Uke
moving forward in Zenkutsu Dachi, without being accompanied by a trainer or partner. Further analyses showed whether a
less lavished forearm compared to a whole-body visualization in VR is necessary to acquire movements’ basics sufficiently.
Four groups were tested: 2 groups conducted VR training (VR-WB: whole-body visualization, and VR-FA having only
visualized the forearms), the third group passed through a video-based learning method (VB), and the control group (C) had
no intervention. In consultation with karate experts, a scoring system was developed to determine the movements’ quality
divided, into upper- and lower body performance and the fist pose. The three-way ANOVA with repeated measurements,
including the between-subject factor group [VR-WB, VR-FA, VB, C] and the within-subject factors time [pre, post, reten-
tion] and body regions [upper body, lower body, fist pose], shows that all groups improved significantly (except for C) with
the similar course after four training sessions in all body regions. Accordingly, VR training seems to be as effective as video
training, and the transfer from VR-adapted skills into the natural environment was equally sufficient, although presenting
different body visualization types. Further suggestions are made related to the features of future VR training simulations.
Keywords Virtual reality · Motor learning · Head-mounted display · Karate kumite · Combat sports · Body visualization
13
Vol.:(0123456789)
524 Virtual Reality (2023) 27:523–540
process can be supported by adjusting the difficulty level must be explored before its adoption as a suitable training
depending on the users’ skill level (Gray 2017). device (Wood et al. 2021).
Thinking about using VR as a training tool, different The basis of the aforementioned studies helps in under-
types of VR applications have been considered in which standing the possible integration of VR applications into
multiple applications emerge (Huang et al. 2019; Jackson II sports scenarios. Summarizing the content, we see some
2021). A popular system is a head-mounted display (HMD), missing points for presenting a conceptual design regarding
which is smaller and more practical/portable (wearable and sport interventions in VR. In some studies, the transfer of
some even wireless) compared with others, such as the the newly learned skill into the real world is missing. An
CAVE (Neumann et al. 2018). It has reached the commercial improvement of performances was often observable within
market, and the application has been extended to different the VR environment, but the transfer to the real world is
fields such as healthcare and education (Nor et al. 2020). not considered. Although studies exist comparing different
Especially for sports, benefits have been crystallized elicited technologies in supporting the learning progress of complex
through this system because natural locomotion could take motor skills (Burns et al. 2011), a lot has happened regard-
place ensuring an increased immersion (Kallioniemi et al. ing possibilities appearing through new devices and their
2017). software development.
Apart from a few exceptions, for example (Liu et al.
2020), which dealt with both, most of the previous enumer-
2 Background and current issues ated studies examined the execution of motoric tasks. The
natural locomotion realizable within HMD-based VR sce-
Currently, only a few studies compared the quality of visual narios ensures relative natural body movements (taking one
perceptional cues in VR to natural conditions or discussed step forward leads to an adequate positional shifting in VR),
how VR training could be conceptualized to effectively essential considering sports activities. Also crucial for learn-
acquire complex sensorimotor skills in the real world (Harris ing new movements is perceiving the body via kinesthetic,
et al. 2019). To realize a more realistic VR training, different proprioceptive, vestibular, and visual cues (Wong et al.
measurement systems have been included in or combined 2012). Since the participants complete natural movements
with VR applications, for example, eye-tracking (Pastel et al. during the perception of the VR environment with an HMD,
2020a), EEG (Tauscher et al. 2019), and motion capturing they rely on similar feedback to real-world muscle tension
systems realizing the whole-body visualization (WB) (Pastel and stretching, or from the vestibular system, although pos-
et al. 2020b). Those approaches are necessary to expand sible differences should not be ruled out (for example, the
the translation of physical actions into virtual sports per- weight of HMD, 500 g in average). Furthermore, only a few
formances (Neumann et al. 2018). Currently, differences in studies have examined how much of the body must be visu-
perception and the transfer from VR-adapted skills into real- ally presented within VR to ensure adequate performance
world conditions can still be detected (Pastel et al. 2020a). compared to real-world conditions. Pastel et al. (2020a, b)
Therefore, it is necessary to investigate how VR training could show that the WB visualization is not necessary to
recommendations or conceptions should be made leading ensure high performance during the execution of different
to a positive transfer to reality. motoric tasks but emphasized the importance of having at
A few studies focused on the use of VR in sports (for least one body part visualized, which is in line with other
review, see Neumann et al. 2018). Especially, the assump- findings (Kim et al. 2018; Lugrin et al. 2018). However,
tion that the learned skills and experiences can be trans- the body visualization was examined to ensure movement
ferred to real-world conditions has not yet been satisfacto- execution and not test whether different body visualization
rily answered. An improvement after training sessions in types could impact the acquisition of previously experienced
VR could be observed, such as in juggling (Lammfromm movements.
and Gopher 2011), karate (Petri et al. 2019a), throwing In sports training, improving motor skills by visual feed-
darts (Tirp et al. 2015), and baseball batting (Gray 2017). back of the own performance compared to the superlative
Michalski et al. (2019) stated that participants significantly is often preferred since the athletes can detect and correct
improved their real-world table tennis performance when errors (see Rhoads et al. 2014; Vaziri et al. 2006). The
only a VR training was completed. Conclusions of positive authors presented the benefits of visual feedback on motor
transfer effect from VR-adapted skills into real-world can learning in many kinds of sports but also warned against
be drawn indirectly since representative real-world tennis implementing it in the coaches’ learning methods without
was developed, and the authors suggested the potential of hesitations since research findings do not show visual feed-
performance transfer (Le Noury et al. 2021). Although VR back as the most efficient. They also discussed the usage of
simulators are supposed to be for the positive transfer of visual feedback concerning the athletes’ level since minor
adapted skills into the real world, their validity and fidelity improvements in performances could be crucial to become
13
Virtual Reality (2023) 27:523–540 525
the best (Rhoads et al. 2014). When talking about visual technique related to combat sports has been chosen to be
feedback, several forms are considered. It can show the ath- tested. The Soto Uke in Zenkutsu Dachi is a defensive tech-
letes videos of experts’ movement execution or their per- nique from karate kumite and is a complex movement for
formances to acquire a better imagination of basic move- a beginner or someone without martial arts experience. We
ment patterns. In another context, it is often associated with chose this movement to test whether VR or videos can be
the persistent visual feedback of the own body leading to used as a practical learning tool in acquiring skills, since
significantly greater accuracy for visuomotor tasks than the majority did not collect any experience (except the com-
non-persistent ones (Unell et al. 2021). The reason why the bats sports athletes). Furthermore, the movement does not
provision of visual feedback could not be established as a require any jumps or fast rotations that could be harmed by
crucial tool at the current state may be the type of present- the technical hardware components (weight of the HMD).
ing. The athletes were often shown only videos instead of So far, no study emerges from the research dealing with a
being in a fully immersive environment to get feedback on comparison of different degrees of body visualization in the
their performances or better movements’ imagination, where context of movement learning concerning the quality of the
the perspectives can be freely chosen by them to ensure a movement to be learned and draws a comparison between
three-dimensional impression. Here, we see VR as a great a WB and partial visualization. Previous studies only dealt
potential to fulfill such requirements since realistic training with the effect of the visibility of body parts during move-
scenarios could be perceived via the first-person perspective. ment execution and not with movement learning. Likewise,
Currently, the VR applications became more commer- the influence of different observation perspectives or differ-
cial and are available for the majority due to low costs and ent forms of representation of the avatar in a WB visualiza-
practical use. In the next decade, most of the population will tion on movement learning has been investigated, but not the
probably never have their motion capturing system allowing substantial impact of those different visualization types. The
a reliable visualization of the WB. Instead, other hardware predominant body of research concerning motor learning
components tracking one’s body could solve the problem took place in controlled laboratory settings and was driven
of private learning sessions accompanied with WB such as by theoretical-driven examinations by using simple move-
HTC Vive Tracker (HTC Corporation, Taiwan) allowing ment tasks (Farrow and Robertson 2017).
to visualize single body parts or objects. Further questions In the current study, the main goal was to examine
arise regarding how important it is to visualize the WB for whether VR can be used to acquire a special combat tech-
motor learning or which body parts have to be prioritized. nique, the Soto Uke in Zenkutsu Dachi. Four different
Concerning the practical use, the controllers are often used groups were formed: a VR training group perceiving the
for visualization of the forearms for helping the participant whole-body visualization (VR-WB) and one in which only
to orientate themselves in VR scenes or to interact with the forearms were visualized during the intervention (VR-
objects (Lougiakis et al. 2020). The VR use during a new FA), a video training group representing a conventional
skill acquisition could accelerate and support the learning training (VB), and a control group (CG) with no interven-
process and automatically help the participants get used to tion. A comparison of the training groups was made to
it. Besides integrating VR additionally into the training, the determine whether training in VR can lead to adequate
importance of standalone training is increased associated outcome performances compared to a video-based learning
due to rising stress levels and other daily charges (Pan et al. program. Therefore, the study aimed to examine whether
2012). In this context, video-based training could also be learning a combat technique with a VR training tool is as
helpful to enable motor learning compared to VR (Yu et al. successful as adequate video-based training. A secondary
2020), but which of these methods is the more effective aim was whether the visualization of the forearms by using
could not be answered yet sufficiently. Both forms can be the controller is sufficient for adequate learning without
used as an additional training tool that amplifies the pos- any loss of acquisition quality. Due to the high immer-
sibility of motor learning for private uses. People are often sion within the VR scenario and the three-dimensional
reluctant to participate in new sports because they feel inse- presentation of each partial movement, we assume that
cure comparing their performances with those with inter- VR could lead to more efficient learning acquisition than
mediate skills. To accelerate learning progress or clean out video-based learning. Since visual feedback is essential
individual mistakes, VR can generate additional and indi- for motor learning (Park et al. 2018), we assume perceiv-
vidualized feedback that supports motor learning (Thurlings ing the whole body leads to a more remarkable improve-
et al. 2013). ment than those with less visual feedback of their body,
Previous research has examined the use of VR application especially for body parts that are not visually perceivable.
for motor learning and different kind of sports have been Although the learning content is similar between the con-
considered, such as golf (Harris et al. 2020) or squat training ditions (virtual reality and video-based training), it should
(Hülsmann et al. 2019). In the current study, a sport-specific be investigated whether the skills to be learned can be
13
526 Virtual Reality (2023) 27:523–540
3 Methods
13
Virtual Reality (2023) 27:523–540 527
another computer was connected to the previous one to to interact in the virtual reality. Visual Studio 2017 was
run Vicon Shogun (equipped with Intel i7 CPU, 32 GB used for implementing the C# program for Unity3D to
memory, 512 GB SSD, and Nvidia Quadro K2200 4 GB control the studies.
graphic card). To ensure the synchronization with the
individual skeleton to the virtual avatar’s ones, 63 mark- 3.2.3 Participants and experimental setup
ers were placed on the participants’ bodies, which was
included in the group with whole-body visualization. The Eighty-three young sports students (33 females and 50
two controllers of the HTC Vive system were used to vis- males, age 22.92 ± 3.11) participated in this experiment vol-
ualize the forearms for the other virtual reality training untarily with normal or corrected to normal vision, no report
group (see Fig. 3). Two synchronized cameras (GoPro 6 of the eye or neurological impairment. A Power analysis
and Casio Exilim EX-F1, 1920 × 1080 pixels, 60 Hz) were was done (using the software G-Power, version 3.1.9.7) for
used to record the movement from the lateral and frontal the within–between interaction (time and group) by con-
perspective in the pre-, post-, and retention test. sidering the number of participants, the number of groups,
the used statistical method, the number of measurements,
the expected effect (we assumed at least a medium effect
3.2.2 Software size: f = 0.25, since the control group conducted no train-
ing and improved performances after training interven-
To create an environment of high fidelity preventing the tion was expected), and the alpha error probability (0.05),
participants from a conflict between the real-word and the whereas a Power was measured at 0.99 (1 − β error prob-
virtual environment, the virtual room was created with ability). The participants gave their written consent after
Blender (version 2.79) using the scales and the textures fully understanding the aim and the procedure of the study.
of the objects in the real world. The test room was also 48.2% of participants had already gained VR experience,
used during the experiment for all other training groups but none of them possessed their own VR application. VR
(video-based and control group). The created virtual envi- experience was noted down when the participants had either
ronment was then imported into Unity3D (version 2019.1), taken part in at least one VR study or had ever participated
and the SteamVR (version 2.5.0) was used to enable users in a VR gaming session. We classified the VR experiences
13
528 Virtual Reality (2023) 27:523–540
as marginal since more than just participation is needed laterally with sufficient distance to capture the whole move-
for being schooled within virtual environments, which ment. After the observation, the participants were asked
is unlikely when it could not be used at home. Sixty-one to reconstruct the observed movement as best as they can.
percentage of participants regularly played video games They should start with the right leg and stop when the left
(M = 7.87 h per week, SD = 7.80). Even among the partici- leg’s step was completed (in total, two steps had to be taken
pants who have gained game experiences, there are large forward). The tests were conducted in the laboratory, so a
deviations within the weekly hours (VR-WB: 2.73 ± 6.20; transfer from virtual training into a real-world setting could
VR-FA: 6.18 ± 9.58; VB: 4.10 ± 5.76; C: 6.14 ± 6.34). Most be investigated after the interventions.
participants did not report owning a VR device for private
uses (VR-WB: 100%; VR-FA: 90.9%; VB: 100%; C: 95.2%).
In addition, no experiences regarding combat sports, in gen- 3.2.6 Intervention
eral, have been made by 40% in VR-WB, 32% in VR-FA,
70% in VB, and 38% in C. Taking a closer look at this var- An overview of the content of each training session is pre-
ied distribution of prior experiences, it turned out that more sented in Table 1. Different requirements of the VR tool
people in VR-WB, VR-FA, and C participated in the judo were set up, such as autodidactic learning without an exter-
course at the university, which we did not count to combat nal trainer, home-based training, and mainly visual informa-
experiences, since it is made for beginners, and contains tion processing took place within the learning sessions. The
other demanded technical components. The division into three-dimensional observation from different perspectives
groups was prioritized by ensuring the same VR experi- (also free chosen), the additional information of technical
ences crystallized through the ownership of VR devices for details and auditive signals, the controlled attention steering
private uses and the combat level, which was also the same minimizing the distractors within the VR scenes can emerge
for all groups. as possible advantages to support the learning process. For
the forearm group (VR-FA), there were some limitations
3.2.4 Procedure regarding the fist pose’s learning process due to the static
posture of the controller. This part was skipped, and they just
Before starting the experiment, each participant had to read regarded the fist pose to imagine the correct posture. Those
or sign the participant information, the consent form, and limitations were considered through the whole intervention
a self-created questionnaire about possible pre-experiences phase; further restrictions did not take place. Generally, the
in VR or combat sport. Participation was canceled if pre- units were split into observation and executions phases. Dif-
experiences in karate kumite or other combat sport existed ferent execution velocities were chosen during the phases
for at least six months. An overview of the procedure is to introduce the participants to the movement to be learned
shown in Fig. 2. In the VR part of the study, the HMD was as comfortably as possible. Before starting with the new
calibrated by the investigator using the official built-in cali- unit, the main contents from the previously conducted unity
bration protocol from SteamVR. For the group that visually were repeated within 5 min. During the sessions, a board
perceived the whole body during the interventions, a subject with additional information in written form about the correct
calibration including the attachment of the markers on the execution of the sub-movement was displayed to provide
motion suit took place before starting the VR scenario. The another form of details. Each session lasted approximately
investigator explained the study’s procedure and measured between 15 and 20 min. Although the participants received
the subjects’ interpupillary distance to ensure a clear visual additional information about the key points of movement via
input from the HMD. The participants could look and walk written notes on a virtual board, they did not get individual
around in the VR scene during this 1-min adjustment phase. feedback about their movement which is comparable to other
After the adjustment phase, the formal study started. Before studies in which the participants’ level still improved (Petri
starting the tests and interventions, the participants were et al. 2019a, b, c). Table 1 shows the learning contents of
instructed to warm up for at least 5 min. each training session and the methods that have been used.
The groups differentiated in the following points:
3.2.5 Pre‑test, post‑test, and retention test
Group 1 (VR-WB)
The participants were instructed to observe the movement on For this group, the whole body was visualized in VR by
the monitor three times. Two cameras were placed at fixed wearing the motion suit that allows synchronizing the
locations (distance, high, inclination angle) that remained participants’ motion with the avatar’s body, including
the same during the whole study to ensure valid and reli- finger tracking (see Fig. 3). To avoid differences in per-
able data for the video analysis. The perspective of the first ceiving the body proportions, we chose between female
camera was in the front, and the second one was placed and male avatar skin surfaces. During the intervention,
13
Virtual Reality (2023) 27:523–540 529
13
530 Virtual Reality (2023) 27:523–540
Table 1 (continued)
Intervention Content Method
the participants perceived the WB, which can be used to movement that should be completed. Starting different
adjust their movements in the virtual mirror. movements was realized through public arrays, in which
Group 2 (VR-FA) the different movements could be chosen by clicking on
The training for this group also took place in the virtual them. To get an impression of the participants’ view, dif-
room. The participants were equipped with the Vive- ferent scenes are presented in Fig. 4.
Controllers, which enabled the body’s forearm’s visu-
alization (see Fig. 3). 3.2.8 Data analysis and statistics
Group 3 (video-based, VB)
This group trained by video-based acquisition. The par- The movement quality was compared by using the obtained
ticipants were placed in front of a monitor where the scores of the expert’s rating system. The rating system was
movements from different perspectives and speeds were constructed by two experts having many years of experience
presented. The learning content was equally compared and graduation of the second and the fourth Dan (Deutscher
with the training sessions in VR (see Tab. 1). Karate Verband e.V.). The scoring system consisted of 42
Group 4 (control group, C) items, whereas 8 different items described the movement of
the upper and 8 items described the movement execution
This group underwent no intervention and just con- level of the lower body. Although the upper body, the lower
ducted the pre-, post-, and retention test. body and the fist movement consist of 8 criteria, each of
them was multiplied by a factor emphasizing the importance
of the learning progress for beginners (less important = 0.5,
3.2.7 Proposed VR application important = 1, very important = 1.5). Since both movements
were rated two times, more scores could be collected [in
The supervisor guided the current VR application by fol- total 32 items]. Five items were reporting the quality of the
lowing a protocol. There was no User Interface in which starting movement in the hip-width stance. To analyze the
the participants could choose between, for example, smooth transition of the upper- and lower body movements,
perspective, avatar’s movements, speed, etc. The pro- another 5 items were developed. The raters were instructed
cess should be standardized for all groups, and no delay by the experts and were aware of the distribution of points.
should occur within each training session. Therefore, the A maximum of 2 points per item was possible to give, and
supervisor guided each participant by activating specific specific rules had to be considered of the raters depend-
visual cues by simply clicking (for example, colored lines ing on the positioned markers on participants’ bodies. The
indicating the next position that should be taken) or by raters were not informed about the time point (pre-, post-,
verbally instructing the number of repetitions for each or retention test) the video was captured. Their ratings were
13
Virtual Reality (2023) 27:523–540 531
made independently from each other. To measure the qual- and Li 2016). The lowest ICC 0.787 within the fist pose was
ity of ratings between the raters, the intraclass correlations calculated, which is still acceptable.
coefficient (ICC) was calculated using the definition created After testing for acceptable ICC values, we used the
by Koo and Li (2016). We calculated the ICCs for the upper mean between the two raters for further statistical analysis.
(0.924) and lower body (0.882) movements and the fist pose Before starting the inferential statistics, we first checked
(0.825) separately. In addition, the ICC for the total score whether there are differences between the starting level of
was determined. An ICC of 0.877 turned out to be an accept- all participants being in the different intervention groups
able value for using the data for statistical analysis (Koo [VR-WB, VR-FA, VB, C] and whether there were statisti-
cal outliers by using Bland–Altman boxplots. The starting
13
532 Virtual Reality (2023) 27:523–540
level is determined through the means of the scoring sys- VR-WB and VR-FA were compared additionally, since the
tem of the two raters. We used a one-way ANOVA for less visualization in the VR-FA group could lead to a loss
independent samples by using all groups’ total points of in movement acquisition, especially for the lower body
movement quality. The analyses resulted in no significant part. If no sphericity was given, the Greenhouse–Geisser
differences between the groups after they had conducted correction was used for all calculations. In addition, we
the pretest (p > 0.05). This was strengthened since the box- conducted a multilevel linear regression with the points
plots within each group (and all participants together) did (not using the percentage) as the dependent and group and
not show any significant outliers. time as independent variables.
Two main questions were considered during the data Other factors such as enjoyment during the training ses-
analysis. The first one thematizes the comparison between sions are considered to crystallize further advantages evoked
the groups in their improvements caused by the different through the different intervention types. After each training
interventions. Therefore, we conducted a mixed ANOVA session, the participants had to state how much they felt
with repeated measurements with the between-subject motivated (from 1 to 10, whereas 1 = does not apply at all
factor group [VR-WB, VR-FA, VB, C] and the within- and 10 = fully applies). Therefore, multivariate ANOVAs
subject factors time [pre-, post-, and retention test] and were conducted to reveal possible differences between the
the body regions [upper body, lower body, fist pose]. groups [VR-WB, VR-FA, VB, C] and training sessions [T1,
We also calculated with the total score (the sum of the T2, T3, T4].
body regions) to get a better impression of performance
improvements. Since each body region includes a differ-
ent number of possible points because of the difference in 4 Results
the maximum achievable score caused by the previously
explained weighting factors (upper body = 26 points, lower 4.1 Comparison of the groups
body = 32 points, begin of the movement = 11 points, and
smooth transition = 10 points, fist movement = 17 points), First, we concentrated on the effectiveness of learning for
we used the percentages of the achieved points being able each group by observing the total score (sum of all body
to compare them and to make further statements on move- regions). All groups that experienced an intervention
ment acquisition’s quality. In total, a maximum score of improved over the time from pre to post (see Fig. 1). The C
96 points could be reached by the participant. For the total remained unchanged. There were no significant differences
score, we conducted an additional two-way ANOVA with between the post and retention for all groups (see Table 2).
the between-subject factor group [VR-WB, VR-FA, VB, C] After observing the total score, we were interested in
and the within-subject factor time [pre-, post-, and reten- whether this occurred for all body regions since different
tion test]. To examine the body visualization, the groups visualization types between the groups might harm the
13
Virtual Reality (2023) 27:523–540 533
Video-based (VB) Upper body % 39.75 ± 10.88 71.50 ± 8.45 73.55 ± 11.56
Points 10.34 ± 2.83 18.59 ± 2.20 19.12 ± 3.01
Lower body % 44.75 ± 14.60 67.58 ± 16.42 66.88 ± 13.64
Points 14.32 ± 4.67 21.63 ± 5.25 21.40 ± 4.36
Fist pose % 64.45 ± 12.59 75.45 ± 13.44 75.12 ± 10.97
Points 10.96 ± 2.14 12.83 ± 2.28 12.77 ± 1.86
Total % 44.05 ± 6.22 70.85 ± 7.29 70.85 ± 6.29
Points 42.29 ± 5.97 68.02 ± 7.00 68.02 ± 6.04
Whole-body visualization (VR-WB) Upper body % 37.68 ± 11.98 70.95 ± 11.76 66.55 ± 12.96
Points 9.80 ± 3.11 18.45 ± 3.01 17.03 ± 3.37
Lower body % 51.75 ± 9.39 72.28 ± 11.61 68.15 ± 9.66
Points 16.56 ± 3.00 23.13 ± 3.72 21.81 ± 3.01
Fist pose % 69.70 ± 17.63 72.45 ± 10.65 67.98 ± 11.72
Points 11.85 ± 3.00 12.32 ± 1.81 11.56 ± 1.99
Total % 48.83 ± 6.00 71.43 ± 6.46 68.20 ± 6.12
Points 46.88 ± 5.76 68.57 ± 6.20 65.47 ± 5.88
Forearms-visualization (VR-FA) Upper body % 45.30 ± 16.32 71.02 ± 12.95 70.25 ± 15.13
Points 11.78 ± 4.24 18.47 ± 3.37 18.27 ± 3.93
Lower body % 47.30 ± 13.47 68.86 ± 14.69 68.32 ± 19.77
Points 15.14 ± 4.31 22.04 ± 4.70 21.86 ± 5.43
Fist pose % 61.18 ± 18.29 64.36 ± 14.12 65.84 ± 16.97
Points 10.40 ± 3.11 10.94 ± 2.40 11.19 ± 2.88
Total % 45.93 ± 8.70 68.64 ± 7.44 68.36 ± 10.20
Points 44.09 ± 8.35 65.89 ± 7.14 65.63 ± 9.79
Control (C) Upper body % 38.52 ± 14.80 42.31 ± 11.85 41.14 ± 12.87
Points 10.02 ± 3.85 11.00 ± 3.08 10.70 ± 3.35
Lower body % 49.52 ± 9.28 47.57 ± 8.65 50.57 ± 10.18
Points 15.85 ± 2.97 15.22 ± 2.77 16.18 ± 3.26
Fist pose % 50.21 ± 12.43 55.29 ± 10.76 52.17 ± 15.42
Points 8.54 ± 2.11 9.40 ± 1.83 8.87 ± 2.62
Total % 44.38 ± 7.46 46.24 ± 6.56 46.10 ± 7.59
Points 42.60 ± 7.16 44.39 ± 6.30 44.26 ± 7.29
Factor Significance Post-hoc comparisons
The values represent the percentage of the completed performance for each body region within each group over the time. Effect sizes were calcu-
lated by using Cohen’s f (0.1–0.25 = small effect, 0.25 < 0.4 moderate effect, > 0.40 large effect)
13
534 Virtual Reality (2023) 27:523–540
that this increase cannot be seen between the post and reten-
tion (Fig. 7).
4.3 Enjoyment
13
Virtual Reality (2023) 27:523–540 535
Fig. 6 The differences from the percentage of performances from the following to the last testing time (pre-, post-, and retention test). The
dashed line indicates no learning effect; consequently, each positive value covers learning progress
13
536 Virtual Reality (2023) 27:523–540
Fig. 7 Distribution of the points (the total number) for the independ- improvement over the time indicated by the reference line (minimum
ent variables Group and Time and the reference line. Similar results and maximum performance). The differences between the perfor-
are observable regarding to the previous presented results. In (a), the mance quality consist only between the pre and the other time points
distribution of the points only differs between the training groups (post and retention)
(VB, VR-WB, VR-FA) and the group that had not trained (C). b The
It consisted of partial movements of the upper and lower could not be imitated at the same level as the other groups
body, as well as the fist pose. As participants with no prior since the controller had to be held permanently in the hands
knowledge of the technique or combat sports, in general, that harm the finger movements. In VB, no auditive feedback
were tested, emphasis was placed on the basic elements of for remaining the vertical height could be provided during
the movement. To ensure a reliable and objective scoring the first lesson in which the ZD (lower body movement)
system, the ICC between the two instructed raters was cal- was presented. The performance was compared separately
culated. Mainly, each group (except the C) passed through within the VR groups to investigate the influence of the dif-
the same developed intervention. This related to the proce- ferent body visualization types on learning. To make further
dure of the study, for example, the split between the partial statements whether a WB visualization is necessary to gain
movements, the repetitions of each movement, the perspec- each movement’s components, a closer look was obtained
tives (except in VR where also a freely selectable was ena- on comparing between the VR-WB and VR-FA.
bled), the given feedback via written information, and the Generally, it has been crystallized that the VR interven-
possibility to observe their performance in a mirror. A few tion can compete with the more used and established video
restrictions occurred for the VR-FA group since no visual training since no significant differences were found between
feedback was given of all body parts. Besides, the fist pose the groups (VR-WB, VR-FA, VB). All groups improved
13
Virtual Reality (2023) 27:523–540 537
significantly from pre- to the post-test, and the level of to be visualized in VR to achieve satisfactory performance,
improvement could keep up, indicated by no significant dif- which is in line with previous findings (Lugrin et al. 2018;
ference between the post- and retention tests. Positive trans- Pastel et al. 2020b). The VR-FA group could keep up with
fer of VR-adapted skills into real world could be found pre- the fist pose’s performance and revealed similar progress in
viously in football (Huang et al. 2015), rowing (Hoffmann the lower body performance compared to VR-WB or VB,
et al. 2014), table tennis (Liu et al. 2020) and further, but not although the participants of this group did not receive visual
reported in combat sports (Petri et al. 2019c). Nevertheless, feedback of the whole body during the intervention (expect
we have to reject the first hypothesis, in which we assumed the forearms, see Fig. 3). This suggests that the controller’s
higher learning for the VR training groups than the VB. posture has no adverse effect on acquiring hand posture in
Being in an immersive virtual room while an avatar pre- this context. The lack of lower limb visualization also did
sents various movements seems to be an attractive learning not decrease the learning of the lower body movement. The
situation, especially when the perspective of observation question is whether this also applies for a high-level train-
could be freely chosen to the individual needs. Different ing constructed for experts, in which details have been per-
perspectives could improve movement depending on the fected, and more visual feedback is needed. Based on this
point of observations, as previous studies have shown (Hül- result, we can currently assume that WB is unnecessary,
smann et al. 2019). It is assumable that gathering impres- especially when learning a new technique including basic
sions in a virtual scene is promising since other studies also skills acquisition. In addition, the VR-FA reported a higher
report higher vividness, interactivity, telepresence, and sat- enjoyment during the training sessions, and less effort had
isfaction for media consumption in VR instead of perceiv- to be made as only the calibration of the two controllers
ing on a 2-D screen (Kim and Ko 2019). Nevertheless, no took place. Considering the upper body movement improve-
effect between the VR training groups and the VB could be ments, there is a learning restriction detectable elicited by
determined, which is not in line with other studies in which the controller. Although no significant differences appeared
VR training seems to be more effective than video train- between all intervention groups, VR-FA’s dispersion showed
ing (Vignais et al. 2015). This may result from ensuring no learning effect for some individuals. Other studies also
comparability between the intervention since the learning claimed the interaction and embodiment relating to the usage
contents had to be kept the same within the different learn- of handheld controllers (Lougiakis et al. 2020). Especially
ing methods. A further possibility could be the unfamiliar in positioning tasks in which interactions with other objects
surroundings, which caused a higher cognitive load, leading have been tested, the controller seemed to be an adequate
to higher distraction, and therefore, reducing the learning method to complete tasks with high precision. The authors
outcome (Makransky et al. 2019). This suggests that simply also stated that visualizing the hand generated the strong-
being in a three-dimensional virtual environment does not est sense of ownership and was the preferred representation
necessarily support learning in a way that is not realizable chosen by the participants.
in video-based training. To use VR as a more efficient learn- The construction of the training intervention has fol-
ing method, a higher range of possible advantages must be lowed some guidelines, which have been summarized and
integrated to maximize the learning progress. It is essential further recommended (Fischer and Paul 2020). The authors
to discuss these advantages and how they can be integrated mainly described the optimal video training design, but the
into the VR sessions, which was done previously (Checa same goals are transferable to VR training interventions.
and Bustillo 2020). Their expressed goals are to improve the understanding of
Although the type of learning (split into partial move- the interrelationships between the actions and functions of
ments, number of repetitions, chosen perspectives, speed of sporting techniques through movement analyses concern-
motion, etc.) remained the same over the different groups, ing kinematic factors (e.g., joint angles, trajectories, etc.)
there were some added features within the VR interven- (Fischer and Paul 2020). Also, the optimizing of athletic
tion. Besides, the participants got auditive feedback if they training by becoming aware of discrepancies between the
exceeded the vertical line when they moved forward. The actual execution of movement and its internal representation.
auditive feedback can enhance interaction performance and The generation of the target values was realized through the
also compensate the missed haptic (Rausch et al. 2012). virtual avatar or the athlete who was presented during the
Except for those, no differences between the interventions video training. To strengthen the internal representation
existed. Thus, the range of advantages that VR can provide of the optimal technique, the avatar/athlete demonstrated
was not fully integrated, explaining the same course of each partial movement with less speed and key points of the
improvement over time. movements were frozen, so the participants had a higher
Since no significant differences between the VR train- chance to compare their performance with the optimum. At
ing groups accompanied by different body visualization this point, it would be helpful to integrate external feed-
types could be detected, the WB does not necessarily have back from the trainer/avatar to provide the actual value of
13
538 Virtual Reality (2023) 27:523–540
participants’ movement, which just relied on their judgment. method. Since the content of the training intervention did not
Especially at the beginning of learning a new movement, significantly differ, the benefits in VR could not yet be fully
slowing down can bring an advantage; however, to com- shown. That’s why the performance outcome was quite simi-
pensate for this, the movement’s presentation in real time is lar between the groups. Those benefits should be clarified in
indispensable (O and Hall 2009). Therefore, we decided to future research to maximize the learning progress within VR
slow down the movements’ speed at the beginning (avatar/ learning sessions. The outcome of the current study shows
athletes’ movements and own execution) and increased it that it is not more effective than just being in an immersive
each training session. virtual environment for learning a high-skilled movement.
Often reported benefits of VR learning sessions are For revealing all advantages, VR could elicit in the future,
higher motivation (reflected in presence feeling), interest, more features have to be included, such as real-time feed-
and fun (Makransky et al. 2019; Parong and Mayer 2018). back of the own performance, interaction with an avatar, or
High motivation could be observed over the training units other feedback sources such as auditive ones. Furthermore,
for all groups, but no difference between the VR groups and the results suggest that it is not necessary to visualize the
the VB is detectable. The verbal feedback of the partici- whole body. Single body limbs could be visualized via sim-
pants for the VR training scenarios was quite positive. They ple sensors without using elaborated technical components.
reported having much fun, and it was perceived as an excit- Of course, if possible, other tracking methods like the Vive
ing and thrilling experience. Sometimes, time was needed Tracker could be used to visualize the hands or feet, which
to get used to the new surroundings, since only two percent should be sufficient to enable feedback of one’s position in
owned a VR device for private uses, 48.2% indicated pre- the virtual scene and revealing additional feedback of body
experiences in participation of other VR studies. limbs’ positions. Within the learning process, different
learning types should be considered in future research since
this study focused on the key elements’ visual perception.
6 Limitation Besides, the transfer effect was just measured in the
execution, not to a reaction of a real attack conducted by
The current study hosts some missing points concerning an enemy. To prepare for the defense in the best possible
the usage of VR in a learning scenario. To maintain the way, the training should have included attacks from the
comparability, the interventions were similarly constructed virtual avatar, where haptic feedback could be provided by
for each group to determine the impact of a high immersed using vibrotactile feedback of the controller to simulate hits.
virtual environment on acquisition. For example, an inter- Another exciting idea is to develop an autonomous learning
active avatar that reacts to the participants individually was scenario in which the participants can decide, for example,
not integrated. Furthermore, no feedback of the current state how often the demonstration of a single movement should
during the intervention was given, and the participants could be repeated, the variability of speed, or frozen moments.
only correct their movements by their sensation. Besides, it
should keep in mind that not all athletes prefer the visual Acknowledgements The study was financed by the German Research
Foundation (DFG) under Grant WI 1456/22-1.
demonstration of a movement to acquire the basic elements.
Auditive feedback has been retained in general, and differ- Funding Open Access funding enabled and organized by Projekt
ent learning types should be considered. Although the par- DEAL.
ticipants received an auditive signal when they exceeded a
certain height, it cannot be spoken of detailed auditory feed- Availability of data and material Yes.
back like verbal instructions given by the avatar or realistic
sounds during its movement. This study does not answer Code availability Yes.
what kind of feedback is most effective to acquire motor
skills sufficiently. Its complexity is well discussed (Thurl- Declarations
ings et al. 2013), and further research, especially in VR due
Conflict of interest The authors declare that they have no conflict of
to the favorable situation to enable any feedback, should be interest.
followed.
Ethics approval The approval of the Ethics Committee of the Otto-von-
Guericke University at the Medical Faculty and University of Hospital
Magdeburg was obtained under the number 132/6.
7 Conclusion
Consent of participate Available.
We conclude that VR is a suitable tool to acquire sport-spe-
cific techniques, especially for beginners. We also detected Consent of publication All authors agreed for the publication process.
high interest and motivation to a not yet experienced training
13
Virtual Reality (2023) 27:523–540 539
Open Access This article is licensed under a Creative Commons Attri- multimedia interactive model and virtual reality technology.
bution 4.0 International License, which permits use, sharing, adapta- Multimed Tools Appl. https://d oi.o rg/1 0.1 007/s 11042-0 19-7 298-9
tion, distribution and reproduction in any medium or format, as long Hülsmann F, Frank C, Senna I, Ernst MO, Schack T, Botsch M (2019)
as you give appropriate credit to the original author(s) and the source, Superimposed skilled performance in a virtual mirror improves
provide a link to the Creative Commons licence, and indicate if changes motor performance and cognitive representation of a full body
were made. The images or other third party material in this article are motor action. Front Robot AI. https://doi.org/10.3389/frobt.2019.
included in the article's Creative Commons licence, unless indicated 00043
otherwise in a credit line to the material. If material is not included in Jackson T II (2021) Immersive virtual reality in sports. In: Tomei L,
the article's Creative Commons licence and your intended use is not Russell D (eds) Implementing augmented reality into immersive
permitted by statutory regulation or exceeds the permitted use, you will virtual learning environments. IGI Global, Hershey, pp 135–150
need to obtain permission directly from the copyright holder. To view a Kallioniemi P, Mäkelä V, Saarinen S, Turunen M, Winter Y, Istudor
copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. A (2017) User experience and immersion of interactive omnidi-
rectional videos in CAVE systems and head-mounted displays.
In: Bernhaupt R, Dalvi G, Joshi A, Balkrishan DK, O’Neill J,
Winckler M (eds) Human–computer interaction—INTERACT
2017. Springer, Cham, pp 299–318
References Khan MS, Charissis V, Sakellariou S (2019) Exploring the develop-
ment requirements for virtual reality gait analysis. MTI 3:24.
Ahir K, Govani K, Gajera R, Shah M (2020) Application on vir- https://doi.org/10.3390/mti3020024
tual reality for enhanced education learning, military train- Kim D, Ko YJ (2019) The impact of virtual reality (VR) technology on
ing and sports. Augment Hum Res. https://doi.org/10.1007/ sport spectators’ flow experience and satisfaction. Comput Hum
s41133-019-0025-2 Behav 93:346–356. https://doi.org/10.1016/j.chb.2018.12.040
Burns A-M, Kulpa R, Durny A, Spanlang B, Slater M, Multon F (2011) Kim A, Kretch KS, Zhou Z, Finley JM (2018) The quality of visual
Using virtual humans and computer animations to learn complex information about the lower extremities influences visuomotor
motor skills: a case study in karate. BIO Web Conf 1:12. https:// coordination during virtual obstacle negotiation. J Neurophysiol
doi.org/10.1051/bioconf/20110100012 120:839–847. https://doi.org/10.1152/jn.00931.2017
Checa D, Bustillo A (2020) Advantages and limits of virtual reality Koo TK, Li MY (2016) A guideline of selecting and reporting intra-
in learning processes: Briviesca in the fifteenth century. Virtual class correlation coefficients for reliability research. J Chiropr
Real 24:151–161. https://doi.org/10.1007/s10055-019-00389-7 Med 15:155–163. https://doi.org/10.1016/j.jcm.2016.02.012
Cohen J (1988) Statistical power analysis for the behavioral sciences, Lammfromm R, Gopher D (2011) Transfer of skill from a virtual
2nd edn. Lawrence Erlbaum Associates, Hove, London reality trainer to real juggling. BIO Web Conf 1:54. https://doi.
Farley OR, Spencer K, Baudinet L (2020) Virtual reality in sports org/10.1051/bioconf/20110100054
coaching, skill acquisition and application to surfing: a review. Le Noury P, Buszard T, Reid M, Farrow D (2021) Examining the
JHSE. https://doi.org/10.14198/JHSE.2020.153.06 representativeness of a virtual reality environment for simula-
Farrow D, Robertson S (2017) Development of a skill acquisition tion of tennis performance. J Sports Sci 39:412–420. https://doi.
periodisation framework for high-performance sport. Sports Med org/10.1080/02640414.2020.1823618
47:1043–1054. https://doi.org/10.1007/s40279-016-0646-2 Liu H, Wang Z, Mousas C, Kao D (2020) Virtual reality racket
Faure C, Limballe A, Bideau B, Kulpa R (2020) Virtual reality to sports: virtual drills for exercise and training. In: 2020 IEEE
assess and train team ball sports performance: a scoping review. international symposium on mixed and augmented reality
J Sports Sci 38:192–205. https://d oi.o rg/1 0.1 080/0 26404 14.2 019. (ISMAR). IEEE, pp 566–576
1689807 Lougiakis C, Katifori A, Roussou M, Ioannidis I-P (2020) Effects
Fischer B, Paul A (2020) Lehren und Lernen mit und in digitalen of virtual hand representation on interaction and embodiment
medien im sport, vol 18. Springer Fachmedien Wiesbaden, in HMD-based virtual environments using controllers. In: 2020
Wiesbaden IEEE conference on virtual reality and 3D user interfaces (VR).
Fox J, Arena D, Bailenson JN (2009) Virtual reality. J Media Psychol IEEE, pp 510–518
21:95–113. https://doi.org/10.1027/1864-1105.21.3.95 Lugrin J-L, Ertl M, Krop P, Klupfel R, Stierstorfer S, Weisz B, Ruck
Gray R (2017) Transfer of training from virtual to real baseball batting. M, Schmitt J, Schmidt N, Latoschik ME (2018) Any “body”
Front Psychol 8:2183. https://doi.org/10.3389/fpsyg.2017.02183 there? Avatar visibility effects in a virtual reality game. In: 2018
Harris DJ, Buckingham G, Wilson MR, Vine SJ (2019) Virtually the IEEE conference on virtual reality and 3D user interfaces (VR).
same? How impaired sensory information in virtual reality may IEEE, pp 17–24
disrupt vision for action. Exp Brain Res 237:2761–2766. https:// Makransky G, Terkildsen TS, Mayer RE (2019) Adding immersive
doi.org/10.1007/s00221-019-05642-8 virtual reality to a science lab simulation causes more presence
Harris DJ, Buckingham G, Wilson MR, Brookes J, Mushtaq F, Mon- but less learning. Learn Instr 60:225–236. https://doi.org/10.
Williams M, Vine SJ (2020) The effect of a virtual reality environ- 1016/j.learninstruc.2017.12.007
ment on gaze behaviour and motor skill learning. Psychol Sport Michalski SC, Szpak A, Saredakis D, Ross TJ, Billinghurst M,
Exerc 50:101721. https://doi.org/10.1016/j.psychsport.2020. Loetscher T (2019) Getting your game on: using virtual reality
101721 to improve real table tennis skills. PLoS ONE 14:e0222351.
Hoffmann CP, Filippeschi A, Ruffaldi E, Bardy BG (2014) Energy https://doi.org/10.1371/journal.pone.0222351
management using virtual reality improves 2000-m rowing per- Mueller F, Stevens G, Thorogood A, O’Brien S, Wulf V (2007)
formance. J Sports Sci 32:501–509. https://d oi.o rg/1 0.1 080/0 2640 Sports over a distance. Pers Ubiquit Comput 11:633–645.
414.2013.835435 https://doi.org/10.1007/s00779-006-0133-0
Huang Y, Churches L, Reilly B (2015) A case study on virtual reality Neumann DL, Moffitt RL, Thomas PR, Loveday K, Watling DP,
American football training. In: Proceedings of the 2015 virtual Lombard CL, Antonova S, Tremeer MA (2018) A system-
reality international conference. ACM, New York, pp 1–5 atic review of the application of interactive virtual reality
Huang C, Zhang Y, Zhu C, Zhang C, Meng H (2019) Chinese sports to sport. Virtual Real 22:183–198. https://d oi.o rg/1 0.1 007/
basketball teaching tactics training system combined with s10055-017-0320-5
13
540 Virtual Reality (2023) 27:523–540
Nor NN, Sunar MS, Kapi AY (2020) User experience of gamified vir- Tauscher J-P, Schottky FW, Grogorick S, Bittner PM, Mustafa M, Mag-
tual reality (VR) in sport: a review. In: Santos H, Pereira GV, nor M (2019) Immersive EEG: evaluating electroencephalography
Budde M, Lopes SF, Nikolic P (eds) Science and technologies for in virtual reality. In: 2019 IEEE conference on virtual reality and
smart cities, vol 323. Springer, Cham, pp 440–449 3D user interfaces (VR). IEEE, pp 1794–1800
O J, Hall C (2009) A quantitative analysis of athletes’ voluntary use Thurlings M, Vermeulen M, Bastiaens T, Stijnen S (2013) Understand-
of slow motion, real time, and fast motion images. J Appl Sport ing feedback: a learning theory perspective. Educ Res Rev 9:1–15.
Psychol 21:15–30. https://doi.org/10.1080/10413200802541892 https://doi.org/10.1016/j.edurev.2012.11.004
Pan LA, Cheng XC, Du QL (2012) Study of table tennis training sys- Tirp J, Steingröver C, Wattie N (2015) Virtual realities as optimal
tem. AMR 472–475:3117–3120. https://doi.org/10.4028/www. learning environments in sport—a transfer study of virtual and
scientific.net/AMR.472-475.3117 real dart throwing. Psychol Test Assess Model 2015:57–69.
Park SH, Casamento-Moran A, Singer ML, Ernster AE, Yacoubi B, https://doi.org/10.3389/fpsyg.2017.02183
Humbert IA, Christou EA (2018) Integration of visual feedback Unell A, Eisenstat ZM, Braun A, Gandhi A, Gilad-Gutnick S, Ben-
and motor learning: corticospinal vs. corticobulbar pathway. Hum Ami S, Sinha P (2021) Influence of visual feedback persistence
Mov Sci 58:88–96. https://doi.org/10.1016/j.humov.2018.01.002 on visuo-motor skill improvement. Sci Rep 11:17347. https://doi.
Parong J, Mayer RE (2018) Learning science in immersive virtual real- org/10.1038/s41598-021-96876-6
ity. J Educ Psychol 110:785–797. https://doi.org/10.1037/edu00 Vaziri S, Diedrichsen J, Shadmehr R (2006) Why does the brain pre-
00241 dict sensory consequences of oculomotor commands? Optimal
Pastel S, Chen C-H, Martin L, Naujoks M, Petri K, Witte K (2020a) integration of the predicted and the actual sensory feedback. J
Comparison of gaze accuracy and precision in real-world Neurosci 26:4188–4197. https://doi.org/10.1523/JNEUROSCI.
and virtual reality. Virtual Real. https:// d oi. o rg/ 1 0. 1 007/ 4747-05.2006
s10055-020-00449-3 Vignais N, Kulpa R, Brault S, Presse D, Bideau B (2015) Which tech-
Pastel S, Chen C-H, Petri K, Witte K (2020b) Effects of body visualiza- nology to investigate visual perception in sport: video vs. virtual
tion on performance in head-mounted display virtual reality. PLoS reality. Hum Mov Sci 39:12–26. https://doi.org/10.1016/j.humov.
ONE 15:e0239226. https://d oi.o rg/1 0.1 371/j ourna l.p one.0 23922 6 2014.10.006
Petri K, Bandow N, Masik S, Witte K (2019a) Improvement of early Wichmann W-D, Seer U (2005) Richtig karate, 3rd edn. BLV Sportp-
recognition of attacks in karate kumite due to training in virtual raxis Top, München
reality. Sportarea 4:294–308. https://doi.org/10.25299/sportarea. Wong JD, Kistemaker DA, Chin A, Gribble PL (2012) Can propriocep-
2019.vol4(2).3370 tive training improve motor learning? J Neurophysiol 108:3313–
Petri K, Masik S, Danneberg M, Emmermacher P, Witte K (2019b) 3321. https://doi.org/10.1152/jn.00122.2012
Possibilities to use a virtual opponent for enhancements of reac- Wood G, Wright DJ, Harris D, Pal A, Franklin ZC, Vine SJ (2021)
tions and perception of young karate athletes. Int J Comput Sci Testing the construct validity of a soccer-specific virtual real-
Sport 18:20–33. https://doi.org/10.2478/ijcss-2019-0011 ity simulator using novice, academy, and professional soc-
Petri K, Emmermacher P, Danneberg M, Masik S, Eckardt F, Weichelt cer players. Virtual Real 25:43–51. https://doi.org/10.1007/
S, Bandow N, Witte K (2019c) Training using virtual reality s10055-020-00441-x
improves response behavior in karate kumite. Sports Eng. https:// Yu C-H, Wu C-C, Wang J-S, Chen H-Y, Lin Y-T (2020) Learning
doi.org/10.1007/s12283-019-0299-0 tennis through video-based reflective learning by using motion-
Rhoads M, Da Matta GB, Pulos S (2014) A meta-analysis of visual tracking sensors. J Educ Technol Soc 23:64–77
feedback for motor learning. Athl Insight 6:17–33
Sigrist R, Rauter G, Marchal-Crespo L, Riener R, Wolf P (2015) Sonifi- Publisher's Note Springer Nature remains neutral with regard to
cation and haptic feedback in addition to visual feedback enhances jurisdictional claims in published maps and institutional affiliations.
complex motor task learning. Exp Brain Res 233:909–925. https://
doi.org/10.1007/s00221-014-4167-7
Srinivasan M, Liederman E, Baluyot N, Jacoby R (2006) Saving time,
improving satisfaction: the impact of a digital radiology system
on physician workflow and system efficiency. J Healthc Inf Manag
20:123–131
13