AR Maintenance Trainer (2021)
In 2021, the AR Maintenance trainer initially built in 2020 was expanded to include an augmented reality (AR)component that would present a virtual object along with the guidance above the physical object being maintained.
Summary
Students at the GRILL® worked to integrate the HoloLens 2 to to the 2020 AR Maintenance trainer project, expanding the effort by including image tracking and 3D object recognition.
Features and Design
Software
Unity and C#
Vuforia Support
AR and Microsoft MR Toolkit
_
Hardware
HoloLens 2
Contributions
Team:
Elijah Crawford
Antoine Gagne
Anna Yang
Mentor:
Mr. Jerry Huggins
_
Clients:
O'Neil and Associates, Inc.
Mr. Dwight Oakley
Outcomes and Additional Information
The project goals included reviewing image tracking and 3D object recognition, implement full-scale object recognition, automatically detecting equipment for maintenance, spawning and overlaying a virtual object over physical object, and creating easy to follow, step-by-step instructions with visual aids.
Microsoft's HoloLens 2 was explored as an AR head mounted device for the project.
The challenge came from O'Neil and Associates, Inc., a company that creates technical manuals for Fortune 500 companies. Using Vuforia and the Unity editor, the students successfully tracked and animated the physical palette jack inside the virtual world.