Mixed Reality Mobile Remoting for Unity

A Unity plugin to record HoloLens apps in 4K from a third person point of view.

My role: Designer, Developer.

https://github.com/microsoft/Mixed-Reality-Remoting-Unity

The problem

HoloLens developers capture recordings of apps for app store listings, marketing videos and to share their creations with the world.

The recommended method makes use of the onboard HoloLens camera, however, the footage can be shaky (as the device cannot be placed on a tripod), the field of view is often too narrow and framing the shot for professional results is almost impossible.

Mixed Reality Captures uses the HoloLens' onboard camera and footage is often shaky with a narrow field-of-view

The solution

I built a companion mobile app that acts as a window in to the holographic world. It then records the regular camera feed (from the rear facing camera) with the holograms composited on top.

The camera feed and holographic app feeds can be recorded as separate files for greater video editing fidelity.

The result is a recording of a HoloLens experience from a third person point of view.