HOLOPORTATION:Virtual 3D Teleportation


November 09 2018


Holoportation is a new immersive telepresence system developed by Microsoft.It combines the ability to capture high quality 3D models of people, objects and environments in real-time.It is enabled into action with the help of virtual or augmented reality displays.The innovative technology provides the ability to see, hear and interact with participants located far away by virtually teleporting.

The object is placed in a particular area which is surrounded by certain number of cameras that capture the depth information of the subject.These cameras then capture the object in 3D.A holographic 3D model is generated after the capture. The textures are applied on this 3D model. This 3D model is compressed and transported.The information is received by the device which then decompresses it, extracts the model and renders it in the users space.All the actions are reproduced in users environment.The image below describes the working of this technology.

Image source:Holoportation:http://www.cs.toronto.edu/~slwang/holoportation.pdf

This technology brings collaboration to complete new level.The enhanced form of interaction among users is what we imagined in future is now reality.Existence in same space despite being located remote makes more sense and immersion.The difference from previously introduced technology is the unrestricted motion of user in space that is made possible with current available hardware.The quality of performance is another point to notice here that is again flawless live streaming.The interaction with other 3d objects is another amazing feature.One of the striking feature that I liked specially is that now it is also possible in moving environment.For this the bandwidth required is 30-50 Mbps and works well till the user is in the wifi range.The image below describes the teleportaion in real world.

https://www.microsoft.com/en-us/research/project/holoportation-v1-images/

From future prospective,it opens door for many applications that will make difference.For example this kind of application can be very effective in the field of real estate.The clients can easily go through the space without being physically present.A broader application can be in medical field where a doctor can guide the surgery.With improvement and addition of new features there can be more such utilization in various fields.

Although this technology seems promising,there are certain limitations that are still required to overcome.One of such limitation is extensive hardware requirement.The hardware plays a important part in getting the accurate teleportation.To overcome this limitation,high resolution camera that would be good enough to capture the depth is required.Another limitation that is that the algorithm should be efficient (lossless compression).Also we are not aware how this looks in AR.With the amount of on going research,one can really hope to overcome these limitations.