Wearable Experience: New Educational Media for Knowledge Intensive Training

Author: Mikhail Fominykh
Type: Invited speech publication
Source: EdMedia: World Conference on Educational Media and Technology
Publisher: AACE, USA
Date: 29 June 2016

Abstract: Wearable computing and augmented reality are disruptive technologies. They fundamentally change the way we educate and train people to a master level of performance. With advanced sensors we can capture experience as it emerges. For example, a trainee can receive live guidance in the form of semi-transparent 3D hands that appear at the right place spatially and are operated by a remote expert using sensor data. Captured guidance provides reference to scale, allowing repeated access to the information asynchronously at the right time and in the right place where it is most urgently needed. Expert guidance can be captured with wearable sensors and later re-enacted by trainees with augmented reality creating a believable illusion of a master-apprentice knowledge sharing. The captured experience therefore represents a new type of educational media that has properties of carrying both explicit and tacit knowledge. This new media helps to convert experience to knowledge and enable learning by bringing closer the theoretical knowledge and immediate experience, which are traditionally separated. Tailored content of captured experience can be presented with augmented reality using intuitive and immersive user interfaces. This can have a positive impact on mental processing and memorization, not only adding scaffolds for high performance, but also acting as a safety net preventing potential problems sensed in the environment. Learning how to master a complex task usually involves reflecting on your own performance, looking back at your behavior and comparing it to that of others. The goal of this new training methodology is to enable the full cycle of immersive experience observing an expert, training with and without guidance, and observing own performance.