INTRODUCTION
Technological advancements have led to the continued development of immersive technologies such as VR, AR, Extended Reality (XR), and Mixed Reality (MR). The Defence sector explore the use VR and AR tech- nologies for training, simulation, maintenance, and mission strategising (e.g., Harris et al., 2023; Henderson & Feiner, 2010). There is growing inter- est in understanding the potential for using these immersive technologies in operational domains. Each technology has advantages and limitations that require careful consideration. VR offers immersive virtual environments, while AR overlays situational information in real-world environments. XR includes all combined real and virtual environments, while MR combines real and virtual worlds to create hybrid environments. Advancements aim to com- bine VR’s situational immersion with AR’s real-time, contextual advantages, but may only partially replicate VR’s immersive experience (Carmigniani et al., 2011). By combining these technologies, Defence applications could be enhanced, including comprehensive training scenarios, improved mission strategising and situational awareness (Xiong et al., 2021; Munzer et al., 2019; Livingston et al., 2011). Using multiple immersive technologies while mitigating limitations opens new opportunities for innovation.
© 2024. Published by AHFE Open Access. All rights reserved. 54
Design Recommendations for Integrating AR in VR Environments Within Defence Research 55
As technology advances, examining how AR and VR can be optimally utilised is essential. Research needs to continue to understand their impacts and provide evidence-based recommendations. The fusion of AR and VR enables innovative applications to enhance operational efficiency and train- ing outcomes in a Defence context. However, whilst incorporating AR into a VR environment for Defence operations and training shows promise it requires careful consideration of methodological and design aspects. Suc- cessful implementation requires analysing challenges and opportunities and understanding fundamental design factors for an efficient, user-friendly, and secure system (Quarles et al., 2009). Realising the benefits of AR-VR fusion requires balancing research optimism and pragmatic considerations on integration and application.
Overview of VR VR in Defence contexts aims to create an immersive simulated battlefield where soldiers feel fully present and can interact realistically (Sherman & Craig, 2018). Key aspects are all-encompassing visuals resembling the com- bat environment, a sense of physical situation, unrestricted navigation, and weapon control. This enables soldiers to rehearse drills and gain tactical experience by actively engaging with responsive virtual zones. Rather than fully replicating real-world senses, the goal is to establish sufficient presence and interactivity for meaningful training. Enclosed head-mounted displays, tracking systems, interfaces, and tailored audio and visual feedback help cre- ate the VR battlefield. The opportunity to rehearse simulated missions in VR can provide valuable tactical experience, improving Defence readiness. Essentially, VR in military settings involves interactive computer-generated combat simulations that submerge soldiers in artificial three-dimensional bat- tlegrounds with multisensory feedback tailored to their tactical viewpoint (Berkowitz, 1995; Cruz-Neira et al., 1992). It generates a sense of pres- ence and “being on the battlefield” (Cipresso et al., 2018; Sherman & Craig, 2018; Witmer & Singer, 1998) and enables interactive tactics through bodily movements and weapon interfaces (Sherman & Craig, 2018; Steuer, 1992), replacing real-world combat stimuli with their virtual counterparts (Slater & Wilbur, 1997).
The distinguishing characteristics of military VR compared to other research platforms include the combination of immersive multimodal feed- back, the perception of being present in combat, and the ability to interact. These unique features allow VR to surpass visual representations and elicit responses similar to real combat situations, even when soldiers know it is a simulation (Cummings & Bailenson, 2015). This suspension of disbelief plays a crucial role in various applications, such as tactical training, psycho- logical resilience building, and strategy formulation. Contemporary military VR systems strive to completely immerse soldiers in synthetic battlefields by replacing natural sensory inputs with tailored multimodal digital illusions that cater to tactical requirements (Abrash, 2014; Sherman & Craig, 2018). This sensory isolation distinguishes military VR from augmented realities,
56 Williams and Blackford
integrating virtual battle overlays with unmediated views of actual terrains (Milgram & Kishino, 1994).
Overview of AR AR overlays digital information and interactions into the real world to enhance users’ perceptions and experiences. AR supplements reality by inte- grating abstract data into real-world contexts in real time (Azuma, 1997). AR systems combine real and virtual elements, operate interactively in real time, and align the virtual with the real (Carmigniani et al., 2011). While virtual reality replaces reality with a simulated environment, AR selectively aug- ments real-world aspects with contextual overlays. This makes AR helpful in improving situational awareness and informing decisions during real-world tasks (Van Krevelen & Poelman, 2010). AR virtual overlays are positioned within a three-dimensional coordinate system mapped to the physical envi- ronment and user viewpoint, anchoring the overlays to real spaces. Relevant information and interactions supplement the user’s natural environment and activities, preserving situational awareness (Bimber & Raskar, 2005). AR sys- tems track the precise viewpoint and positions of real objects and surfaces, allowing for accurate, location-aware rendering of overlays from the user’s perspective as they move and interact. Additionally, modern AR leverages technologies like optical head-mounted displays, outward-facing cameras, inertial sensors, depth sensors, image tracking, GPS, wireless networking, and mobile platforms, enabling lightweight and portable AR systems that map and supplement real-world environments and activities (Carmigniani et al., 2011).
AR-VR: Simulating AR Capabilities into VR Environments Integrated AR-VR platforms offer a significant advantage in facilitating seamless interaction between real and virtual assets for Defence training. By capitalising on their innate sensorimotor skills and instincts, trainees can actively participate in the environment by interacting with tangible and digital components (Slater & Sanchez-Vives, 2016). Such a high level of embodied interactivity brings enhanced flexibility and realism in AR-VR training, surpassing the limitations of purely virtual or augmented simula- tions (Hill et al., 2003). To achieve this, AR-VR systems should ensure precise alignment of virtual augmentations with the physical environment and the user’s perspective, accomplished through robust registration and tracking methods. Even minor discrepancies in alignment can disrupt the immer- sive experience (Rokhsaritalemi et al., 2020). Additionally, the system must effectively manage occlusion and seamlessly respond to user actions and real- world elements in real time to maintain a sense of plausibility (Grubert et al., 2017). Advancements in inside-out tracking, sensor fusion, edge comput- ing, and display technologies are instrumental in addressing these challenges (Huang et al., 2017). Through progressing these areas, Defence trainees can freely navigate hybrid environments such as AR-VR, using instinctual inter- actions between virtual and physical elements to achieve a realistic training experience.
Design Recommendations for Integrating AR in VR Environments Within Defence Research 57
However, effective design and integration are critical for AR-VR training. AR-VR integration balances both technologies’ strengths for more authen- tic and responsive simulated environments. The promise is developing more transferable military skills than VR simulation alone (Darken & Peterson, 2002). AR overlays provide missing contextual cues in VR, enhancing infor- mation and presence (Dey et al., 2018). AR also enables seamless switching between VR simulation and live surroundings to improve awareness (Davis et al., 2015). VR provides simulated military training environments but lacks physical fidelity compared to real-world practice (Darken & Peterson, 2002). AR overlays digital information onto real environments to maintain physical awareness Integrating AR into VR headsets blends simulated elements with real physical props and environments. This hybrid AR-VR approach aims to mimic real-world conditions more accurately than VR alone (Zhu et al., 2017). In essence, AR-VR headsets overlay digital AR information onto a VR environment. This fusion offers benefits over VR isolation while retain- ing VR’s control and safety. The potential is developing more transferable military skills than VR simulation alone (Georgiou & Kyza, 2018). How- ever, effective design and integration are critical for hybrid AR-VR training. AR-VR integration balances both technologies’ strengths for more authentic and aware simulated environments. However, realisation depends on over- coming key technical challenges. Further research should clarify the optimal fusion and applications of hybrid AR-VR for Defence training.
To achieve effective training in AR-VR, it is essential to prioritise user expe- rience and interface design beyond technical considerations. This involves giving primary importance to human needs to prevent overwhelming users and ensure skill transfer. For optimising AR-VR training, information visu- alisation, attention guidance, and collaborative interfaces require further exploration. For instance, using multimodal cues in AR could improve infor- mation acquisition, compared to relying solely on a single modality (Rebetez et al., 2016). The variation in visual-spatial abilities among individuals can affect the performance of AR. By providing options such as switch- able viewpoints, the diverse needs of users can be accommodated (Chen & Tsai, 2012). AR-VR training can be improved by customising interfaces and experiences to meet cognitive and psychomotor demands. Furthermore, inte- grating physical and virtual elements in personalised blended environments presents opportunities for improvement.
As AR-VR methods continue to advance, it is imperative to prioritise human-centred design to realise the potential of hybrid training fully. This involves combining technical advancements with thoughtful consideration of human perception, cognition, and team dynamics. Adopting this approach has the potential to transform military learning and preparedness through the integration of AR-VR platforms. A human-centred design approach is vital to achieving practical AR-VR training, considering human factors and personalising the training experience. Further research on optimising hybrid environments to meet human needs has the potential to revolutionise Defence learning through the implementation of AR-VR. Let me know if you need any more clarity or conciseness.
58 Williams and Blackford
Integrated AR-VR platforms offer the potential for enhanced and more natural interoperability between humans and technology in the context of Defence training and the operational environment. However, fully realis- ing this potential necessitates optimising crucial factors such as registration accuracy, occlusion handling, and real-time responsiveness. As technology advances, hybrid simulations can transcend the mere display of digital aug- mentations and usher in shared embodied environments, where the bound- aries between the virtual and real worlds fade away from the trainee’s perspective. This signifies the next stage of evolution in the capabilities of MR training. In summary, the integration of AR within VR holds the potential for facilitating more authentic experiences, although it encounters obstacles. To achieve more efficient Defence capabilities while upholding safety and respect in training and operations, a well-balanced approach that drives tech- nology forward with a focus on human-centred perspectives is crucial. The exploration and advancement of this trajectory through ongoing research and development can unveil vast opportunities for hybrid reality.
AR-VR Pilot Study This pilot study presents a summary of research conducted by Trimetis, BMT, and Middlesex University on behalf of the Defence Science and Technology Laboratory (Dstl). The primary objective of this research was to showcase the potential of emerging human-machine interfaces (HMIs) in enhancing cognitive performance for military personnel using prototypes within an AR- VR experimental testbed. The experiments undertaken aimed to address two key research questions:
Research Question 1: What is the impact of an AR HMI (interface aug- mented in the virtual environment) compared to a non-AR HMI (interface through a virtual handheld device) on the performance of individuals and teams and their cognitive workload during cognitive tasks?
Research Question 2: By developing a measure of cognitive optimisation (CO) based on performance and workload, how does an AR HMI support CO compare to a non-AR interface?
In this study, the term “cognitive optimisation” (CO) refers to attaining cognitive performance that is maximised within a given situation’s con- straints and contextual factors. It emphasises the optimal utilisation of cognitive resources for task performance rather than striving for unattainable perfection based on exhaustive analysis and logical reasoning.
Methodological Approach The experimental setup consisted of a realistic situation where an Armoured Fighting Vehicle (AFV) patrolled through a town resembling the typical lay- out encountered in UK operations. The AFV is manned by a driver, gunner, uncrewed aerial vehicle (UAV) operator, signals intelligence operative, and at least two infantry soldiers. In this scenario, the AFV is unexpectedly attacked by hostile targets. The crew and the vehicle retreat to a secure location, retal- iate, and subsequently devise a plan for a counterattack. Unfortunately, the
Design Recommendations for Integrating AR in VR Environments Within Defence Research 59
gunner sustains injuries, and the other soldiers ensure their safety before initiating a CASEVAC.
All participants are exposed to both experimental conditions, namely the AR HMI and the non-AR HMI conditions, within the synthetic VR envi- ronment. Experiment 1 (individual performance) comprised 18 participants, including civilians and military personnel. Experiment 2 (team performance) involved 18 military personnel working collaboratively in teams of 3. In both counter-balanced conditions, participants completed a series of experimental phases where task-specific information was either delivered through an aug- mented view (AR condition) or on a virtual tablet (non-AR condition). The primary focus of the experiment was on two measures: cognitive workload, which refers to the measurable or perceived mental effort exerted by individ- uals in response to a cognitive task, and cognitive performance, which relates to the performance on a cognitive task as observed through appropriate indi- cators. The subjective workload experienced by participants was assessed at critical points within each phase using the Instantaneous Self-Assessment method (ISA; Jordan & Brennen, 1992). Additionally, the NASA TLX (Task Load Index, Hart & Staveland, 1988) was used to measure workload at the end of each condition.
Performance measures showed variability and included binary (yes/no) responses, correct/incorrect responses, reaction times, and a correctness score for the provided response. To establish a consistent performance score during the relevant phases of the experiment, a score that accounted for all essential performance measures was generated. It is recognised that different method- ologies can produce a performance score, each of which may yield different results. In this study, the research team adopted an approach to determine a performance score that best represents the research inquiries related to cognitive optimization.
AR-VR Results, Discussion and Recommendations Results from the pilot study revealed some insight into the intricate relation- ship between technology and human perceptual capabilities. The pilot study highlighted a decline in performance as visual threats within the AR condition increase, which underscore challenges in interface design rooted in the inher- ent limitations of visual perception. As suggested by Wickens’ (2002), the risk of cognitive overload due to competing information streams in AR necessi- tates a cautious management of occlusion and visual clutter (Grabowski et al., 2018). This was evident as performance deteriorated with the escalation of visual threats, pointing to the potential risks of overwhelming the human visual processing capabilities (Swan & Gabbard, 2005).
Given AR’s potential to augment visual perception, it is critical to consider a multimodal design approach to mitigate the effects of increased cognitive workload. The integration of cross-modal capabilities has been shown to enhance the effectiveness of AR by distributing sensory input loads among various modalities (Piumsomboon et al., 2013; Lee et al., 2012). For instance, the use of haptic pulse guidance and combined spatial audio can direct attention more efficiently and improve task performance, underscoring the
60 Williams and Blackford
benefits of incorporating multiple modalities to alleviate visual overload. Fur- thermore, the development of infantry-appropriate AR solutions necessitates a rigid alignment between real and virtual environments to avoid disrupt- ing immersion (Harris et al., 2023). Minor misalignments can have adverse effects on user performance, highlighting the importance of advanced tech- nologies like predictive tracking and artificial intelligence in maintaining real-virtual coherence. This alignment is especially crucial in volatile infantry contexts where discrepancies could have dire consequences.
The study also revealed challenges in presenting comprehensive battlefield data without obscuring real-world views with excessive occlusion (Tang et al., 2003). A human-centred design approach, which prioritises understanding and fulfilling infantry needs within their operational context, is paramount for the successful implementation of AR systems (Sanders & Stappers, 2008). Viewing infantry personnel as collaborative partners rather than mere sub- jects fosters the development of tailored solutions that enhance rather than detract from operational capabilities.
Feedback from study participants revealed preferences for non-AR HMIs during tasks requiring situational monitoring, such as ambush and route change scenarios, due to the easier identification of threats and less cog- nitive load from not having to shift attention between multiple screens or directions. This suggests that certain screen layouts and presentation methods can aid situational awareness and reduce the cognitive demands associated with monitoring complex environments. The implications of switch costs, or the cognitive and temporal burdens associated with alternating attention between tasks, were also explored in relation to AR and non-AR HMIs. Research indicates that minimising switch costs can improve decision-making speed and accuracy by reducing the cognitive load on the individual (Philipp, Gade & Koch, 2007). In team settings, however, the expected benefits of dis- tributed situational monitoring in AR were not fully realized, potentially due to low levels of information sharing and team cohesion. This highlights the necessity for future AR systems to foster a shared awareness of the team workspace and roles within virtual environments (Gutwin & Greenberg, 2004).
CONCLUSION
The findings from the pilot study highlight the potential use of AR visuals, when anchored to real-world objects and locations, to enhance performance and facilitate the transfer of competencies from VR military simulations. The observed enhancements in tasks such as threat identification underscore the perceptual advantages offered by AR technology. To fully harness AR’s capabilities a human-centred approach to interface design is essential. Key challenges include managing visual occlusion, clutter, ensuring precise align- ment, and balancing perceptual resources to prevent cognitive overload. It is crucial to engage in participatory design processes to deeply understand the specific needs and operational workflows of infantry personnel, enabling the development of customised and modular AR interfaces that cater to the diverse requirements of Defence users across various roles and operational
Design Recommendations for Integrating AR in VR Environments Within Defence Research 61
environments. The commitment to sustained, iterative prototyping and test- ing with representative users in realistic conditions is vital for identifying usability challenges and refining augmentation strategies. Moreover, ongoing interdisciplinary research spanning technical and cognitive domains will be instrumental in furthering AR’s capabilities to revolutionise military training and operational effectiveness. The integration of AR into VR training repre- sents a significant advancement with promising implications, yet its success hinges on a design philosophy that prioritises human factors, ensuring AR’s benefits are fully realised while minimising cognitive drawbacks. The jour- ney towards effectively integrating these advanced technologies into Defence forces continues, with each step forward bringing closer the realisation of their transformative potential.
ACKNOWLEDGMENT
This publication was funded through ASTRID Task 193 – Optimising Human Systems Integration (OHSI) Continuity Tasks’ which is a contin- uation of work conducted in Task HS1.005 under the Human and Social Sciences Research Capability (HSSRC). This publication presents content based on Task HS1.005 that was originally executed by Trimetis, BMT, and Middlesex University funded by the Defence Science and Technology Lab- oratory (Dstl). DEFCON 705 © Crown Owned Copyright 2023. Supplied to MOD under DEFCON 705 in accordance with Contract No DSTL/A- GR/01142/01, Task 193. All correspondences relating to the content of this publication should be addressed to (craig.williams@trimetis.co.uk).
REFERENCES
Abrash, M. (2014). What VR could, should, and almost certainly will be within two years. Steam Dev Days, Seattle, 4, 2014. Azuma, R. T. (1997). A survey of augmented reality. Presence: teleoperators & virtual
environments, 6(4), 355–385. Berkowitz, D. (1995). Communication in the age of virtual reality. Public Relations Review, 21(4), 358–359. https://doi.org/10.1016/0363-8111(95)90123-x Bimber, O., & Raskar, R. (2005). Spatial augmented reality: merging real and virtual
worlds. CRC press. Carmigniani, J., Furht, B., Anisetti, M., Ceravolo, P., Damiani, E., & Ivkovic, M.
(2011). Augmented reality technologies, systems and applications. Multimedia Tools and Applications, 51(1), 341–377. https://doi.org/10.1007/s11042-010- 0660-6 Chen, C.-M., & Tsai, Y.-N. (2012). Interactive augmented reality system for enhancing library instruction in elementary schools. Computers & Education, 59(2), 638–652. https://doi.org/10.1016/j.compedu.2012.03.001 Cipresso, P., Giglioli, I. A. C., Raya, M. A., & Riva, G. (2018). The past, present, and
future of virtual and augmented reality research: a network and cluster analysis of the literature. Frontiers in psychology, 2086. Cruz-Neira, C., Sandin, D. J., DeFanti, T. A., Kenyon, R. V., & Hart, J. C. (1992). The CAVE: audio visual experience automatic virtual environment. Communications of the ACM, 35(6), 64–72. https://doi.org/10.1145/129888.129892
62 Williams and Blackford
Cummings, J. J., & Bailenson, J. N. (2015). How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence. Media Psychology, 19(2), 272–309. https://doi.org/10.1080/15213269.2015.1015740 Darken, R. P., & Peterson, B. (2002). Spatial orientation, wayfinding, and represen-
tation. In Handbook of virtual environments (pp. 533–558). CRC Press. Davis, M. C., Challenger, R., Jayewardene, D. N. W., & Clegg, C. W. (2014). Advancing socio-technical systems thinking: A call for bravery. Applied Ergonomics, 45(2), 171–180. https://doi.org/10.1016/j.apergo.2013.02.009 Dey, A., Billinghurst, M., Lindeman, R. W., & Swan, J. E. (2018). A System-
atic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014. Frontiers in Robotics and AI, 5. https://doi.org/10.3389/frobt.2018.00037 Gabbard, J. L., Hix, D., & Swan, J. E. (1999). User-centered design and evaluation of virtual environments. IEEE Computer Graphics and Applications, 19(6), 51–59. https://doi.org/10.1109/38.799740 Georgiou, Y., & Kyza, E. A. (2018). The development and validation of the ARI ques-
tionnaire: An instrument for measuring immersion in location-based augmented reality settings. International Journal of Human-Computer Studies, 98, 24–37. https://doi.org/10.1016/j.ijhcs.2016.09.014 Grabowski, M., Rowen, A., & Rancy, J. P. (2018). Evaluation of wearable immersive augmented reality technology in safety-critical systems. Safety science, 103, 23–32. Grubert, J., Langlotz, T., Zollmann, S., & Regenbrecht, H. (2017). Towards
Pervasive Augmented Reality: Context-Awareness in Augmented Reality. IEEE Transactions on Visualization and Computer Graphics, 23(6), 1706–1724. https://doi.org/10.1109/tvcg.2016.2543720 Gutwin, C., & Greenberg, S. (2004). The importance of awareness for team cognition in distributed collaboration. Harris, D. J., Arthur, T., Kearse, J., Olonilua, M., Hassan, E. K., De Burgh, T. C.,
& Vine, S. J. (2023). Exploring the role of virtual reality in military decision training. Frontiers in Virtual Reality, 4, 1165030. Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychol- ogy (Vol. 52, pp. 139–183). North-Holland. Henderson, S. J., & Feiner, S. (2021). Evaluating the benefits of augmented reality
for task localization in maintenance of an armored personnel carrier turret. 2009 8th IEEE International Symposium on Mixed and Augmented Reality. https://do i.org/10.1109/ismar.2009.5336486 Hill, A., Schiefer, J., Wilson, J., Davidson, B., Gandy, M., & MacIntyre, B. (2011, October). Virtual transparency: Introducing parallax view into video see-through AR. In 2011 10th IEEE International Symposium on Mixed and Augmented Reality (pp. 239–240). IEEE. Holtzblatt, K., & Beyer, H. (2014). Contextual design: evolved. Morgan & Claypool
Publishers. Huang, F.-C., Chen, K., & Wetzstein, G. (2015). The light field stereoscope. ACM Transactions on Graphics, 34(4), 60:1–60:12. https://doi.org/10.1145/2766922 Jordan, C. S., & Brennen, S. D. (1992). Instantaneous self-assessment of workload
technique (ISA). Defence Research Agency, Portsmouth. Lee, G. A., Dünser, A., Seungwon Kim, & Billinghurst, M. (2012, November 1). CityViewAR: A mobile outdoor AR application for city visualization. IEEE Xplore. https://doi.org/10.1109/ISMAR-AMH.2012.6483989
Design Recommendations for Integrating AR in VR Environments Within Defence Research 63
Livingston, M. A., Rosenblum, L. J., Brown, D. G., Schmidt, G. S., Julier, S. J., Baillot, Y.,... & Maassel, P. (2011). Military applications of augmented reality. Handbook of augmented reality, 671–706. Marner, M. R., Smith, R. T., Walsh, J. A., & Thomas, B. H. (2014). Spatial user inter-
faces for large-scale projector-based augmented reality. IEEE computer graphics and applications, 34(6), 74–82. Milgram, P., & Kishino, F.(1994). A taxonomy of mixed reality visual displays.IEICE TRANSACTIONS on Information and Systems, 77(12), 1321–1329. Manuri, F., & Sanna, A. (2016). A survey on applications of augmented reality. ACSIJ
Advances in Computer Science: an International Journal, 5(1), 18–27. Munzer, B. W., Khan, M. M., Shipman, B., & Mahajan, P. (2019). Augmented Reality in Emergency Medicine: A Scoping Review. Journal of Medical Internet Research, 21(4), e12368. https://doi.org/10.2196/12368 Olsson, T., Kärkkäinen, T., Lagerstam, E., & Ventä-Olkkonen, L. (2012). User eval-
uation of mobile augmented reality scenarios. Journal of Ambient Intelligence and Smart Environments, 4(1), 29–47. https://doi.org/10.3233/ais-2011-0127 Philipp, A. M., Gade, M., & Koch, I. (2007). Inhibitory processes in language switching: Evidence from switching language-defined response sets. European Journal of Cognitive Psychology, 19(3), 395–416. Piumsomboon, T., Clark, A., Billinghurst, M., & Cockburn, A. (2013). User-defined
gestures for augmented reality. CHI ‘13 Extended Abstracts on Human Factors in Computing Systems. https://doi.org/10.1145/2468356.2468527 Quarles, J., Lampotang, S., Fischler, I., Fishwick, P., & Lok, B. (2009). A Mixed Reality Approach for Merging Abstract and Concrete Knowledge. 2008 IEEE Virtual Reality Conference. https://doi.org/10.1109/vr.2008.4480746 Rebetez, C., Bétrancourt, M., Sangin, M., & Dillenbourg, P. (2009). Learning
from animation enabled by collaboration. Instructional Science, 38(5), 471–485. https://doi.org/10.1007/s11251-009-9117-6 Rokhsaritalemi, S., Sadeghi-Niaraki, A., & Choi, S. M. (2020). A review on mixed reality: Current trends, challenges and prospects. Applied Sciences, 10(2), 636. Chicago Rosenthal, M., State, A., Lee, J., Hirota, G., Ackerman, J., Keller, K., Pisano, E.
D., Jiroutek, M., Muller, K., & Fuchs, H. (2002). Augmented reality guidance for needle biopsies: An initial randomized, controlled trial in phantoms. A pre- liminary version of this paper was presented at the Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2001 conference in Utrecht. The Netherlands (Rosenthal et al., 2001). Medical Image Analysis, 6(3), 313–320. https://doi.org/10.1016/s1361-8415(02)00088-9 Sanders, E. B.-N.., & Stappers, P. J. (2008). Co-creation and the new landscapes of design. CoDesign, 4(1), 5–18. https://doi.org/10.1080/15710880701875068 Sherman, W. R., & Craig, A. B. (2018). Understanding Virtual Reality : Interface,
Application, and Design. Elsevier Science & Technology. Slater, M., & Sanchez-Vives, M. V. (2016). Enhancing our lives with immersive virtual reality. Frontiers in Robotics and AI, 3, 74. Slater, M., & Wilbur, S. (1997). A framework for immersive virtual environments
(FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators & Virtual Environments, 6(6), 603–616. Steuer, J. (1992). Defining Virtual Reality: Dimensions Determining Telepresence.
Journal of Communication, 42(4), 73–93. https://doi.org/10.1111/j.1460-2466. 1992.tb00812.x
64 Williams and Blackford
Swan, J. E., & Gabbard, J. L. (2005, July). Survey of user-based experimentation in augmented reality. In Proceedings of 1st international conference on virtual reality (Vol. 22, pp. 1–9). Tang, A., Owen, C., Biocca, F., & Mou, W. (2003, April). Comparative effectiveness
of augmented reality in object assembly. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 73–80). Tavanti, M., & Lind, M. (2001, October). 2D vs 3D, implications on spatial memory.
In IEEE Symposium on Information Visualization, 2001. INFOVIS 2001. (pp. 139–145). IEEE. Van Krevelen, D. W. F., & Poelman, R. (2010). A Survey of Augmented Reality Technologies, Applications and Limitations. International Journal of Virtual Reality, 9(2), 1–20. https://doi.org/10.20870/ijvr.2010.9.2.2767 Wickens, C. D. (2002). Multiple resources and performance prediction. Theoretical
issues in ergonomics science, 3(2), 159–177. Wickens, C. D. (2008). Multiple Resources and Mental Workload. Human Factors: The Journal of the Human Factors and Ergonomics Society, 50(3), 449–455. https://doi.org/10.1518/001872008x288394 Witmer, B. G., & Singer, M. J. (1998). Measuring Presence in Virtual Environments: A
Presence Questionnaire. Presence: Teleoperators and Virtual Environments, 7(3), 225–240. https://doi.org/10.1162/105474698565686 Xiong, J., Hsiang, E. L., He, Z., Zhan, T., & Wu, S. T. (2021). Augmented reality and virtual reality displays: emerging technologies and future perspectives. Light: Science & Applications, 10(1), 216. Xue, H., Sharma, P., & Wild, F. (2019). User Satisfaction in Augmented Reality-Based Training Using Microsoft HoloLens. Computers, 8(1), 9. https://doi.org/10.3390/computers8010009 Zhu, J., Ong, S. K., & Nee, A. Y. (2015). A context-aware augmented real-
ity assisted maintenance system. International Journal of Computer Integrated Manufacturing, 28(2), 213–225.