ARLEM’s Wearable Experience for Knowledge Intensive Training (WEKIT)

Performance Augmentation Lab (PAL) Oxford  Brookes University’s Wearable Experience for Knowledge Intensive Training (WEKIT)

The Wearable Experience for Knowledge Intensive Training (WEKIT) prototype is a platform for immersive procedural training with wearable sensors and Augmented Reality. Focusing on capture and re-enactment of human expertise. The practical challenges of interpreting expertise, using suitable sensors for its capture and specifying the means to describe and display to the novice are of central significance here.

The proposed Augmented Reality Learning Experience Model (ARLEM) specifies how to represent activities conducive to developing or upgrading knowledge, skills, and other abilities in a standardized interchange format. The interchange format includes a description of the “activity” and of the environment and context in the actual workplace in which it can be executed.

 The “activity” contains a semantic description to log triples of subject, predicate, plus objects handled or acted upon. This allows for the auto-generation of log statements. The log statement is the expressed in an ADL JavaScript wrapper and communicated to xAPI endpoint/LRS.  For example, in a training procedure for an ultrasound machine, it contains an “activity” action step ‘locate the linear probe’, which has the action predicate and uses a tangible overlay ‘locate’ on the ultrasound machine’s linear probe. When the user enters the action step, it drops a xAPI triple to the LRS – also when the user moves on to the next action step (e.g. by saying ‘next’). With that information, it calculates how long the action step took. There is a video below under Augmented Reality guidance for doctors in training of a medical student conducting a diagnostic procedure on an ultrasound machine.

In the prototype trials, specially developed applications for both the experts and novices were used and feedback was collected to assess the suitability and acceptance of the system below in three distinctly different scenarios.

Augmented Reality guidance for doctors in training

With the help of radiologists in Genoa and EBIT, a medical software company, a number of medical students were trained to assess the blood flow in the carotid artery on an unfamiliar ultrasound machine. This tricky procedure involves following instructions (laid out in 3D) whilst maintaining control of both an ultrasound probe and a patient (in our case: an actor). A holographic tutor delivers the recorded think-aloud explanation of the expert, while instructional holograms, floating videos, and to-be snapshots guide step by step through the procedure. Tested by medical and engineering students, this trial provided in-depth feedback on the subtleties of using AR for complicated, interactive procedures Video Augmented Reality guidance for doctors in training.  Here is a video of a medical student conducting diagnostic procedures on an ultrasound machine they are not familiar with. 

Augmented Reality guidance for space

At ALTEC (a service provider for the Italian Space Agency) WEKIT tested a procedure for setting up stowage racks for use by astronauts on the International Space Station. Trainees were tracked as they installed the equipment, monitoring their efficiency on every step as well as their heart-rate variability. Augmented Reality can be used to train astronauts and within this video, they provided a few impressions from the WEKIT trials of training the installation of a stowage rack in a module of the international space station (ISS).

Augmented reality guidance for airplanes

Here is an augmented reality application for an airplane maintenance tech. The video shows how we tested the WEKIT prototype on a real procedure used for maintenance training in aviation.

Leave a Reply