ANNE: AR MANNEQUIN

Software Engineer

About: An AR experience for Emergency Department Staffs who need to learn CPR, the AR Mannequin is a AR CPR mannequin simulator that provides augmented CPR learning using Hololens and real-time facilitator control via a network connection.  Unlike VR CPR training, AR Mannequin uses real objects like a CPR mannequin and medical devices.

Type: Hybrid Microsoft Hololens and tablet AR experience made with Unity C#

Tim-frame: September 2019 - December 2019

​

Role: Software Engineer

• Integrate Photon Engine PUN 2 for communication between Microsoft Hololens and external tablet device

• Program UI for tablet device view 

• Design and implement custom, scalable command buffer system using Photon raised events

Challenges:

• Overcoming incompatibilities between Hololens and PUN

  • Sending events via PUN to objects instantiated for Hololens environment​

• Tracking status of facilitator upon disconnection and reconnection

Learned:

• PUN 2 for multi-device communication

• Gained familiarity with Hololens Toolkit

• How to set up a Unity scene for Hololens Toolkit and Vuforia

​