The Augmented Reality (AR) Maintenance Trainer needed to assist users as they perform a maintenance routine on a physical object by providing various forms of guidance.

The project concluded with the construction of an AR Maintenance Trainer that the customer, O'Neil and Associates, Inc., was happy with.

O'Neil and Associates, Inc., which creates technical manuals for Fortune 500 companies, challenged the GRILL® to extend upon the GRILL 2020 AR Maintenance trainer by using a HoloLens 2 to overlay virtual objects over physical ones.

Using Vuforia and the Unity editor, students successfully tracked and animated the physical palette jack inside the virtual world. 

This research advocates for using imitation learning to train collaborative robots (cobots) for manufacturing tasks, specifically spraying speckle patterns for Digital Image Correlation (DIC). 

The GRILL® team developed a prototype which shows critical information within an inspector's field of view.

A secondary goal was to investigate AR technology for non-destructive evaluation techniques.

The military wants to decrease the cost of training experiences for low-risk routines. The GRILL® was tasked to create a simulation such that multiple users can interact in a shared environment and perform a maintenance routine.

A training simulation was developed using the Oculus Rift S and UE4.

The project concluded with maintenance simulations for arbitrary objects. In the future, new objects and routines can be added to the simulation.