Search

MTBS3D RT @IFCSummit: .@Dell’s Director of Virtualization and Commercial #VR and #AR is speaking at #IFCSummit. https://t.co/aBSSFDfmE6
MTBS3D RT @IFCSummit: .@tifcagroup’s International Future Computing Summit ushers in #clientocloudrevolution. #IFCSummit #PC #cloud #XR #VR #AR #A
MTBS3D RT @IFCSummit: Dr. Ali Khayrallah, Engineering Director for @ericsson speaking at #IFCSummit. #clientocloudrevolution #cloudcomputing #futu
MTBS3D RT @tifcagroup: TIFCA releases new #ClienttoCloud Vision Document and a $200 off code for @IFCSummit tickets. #TIFCA #IFCSummit #cloud #cli
MTBS3D RT @IFCSummit: .@tifcagroup releases new #ClienttoCloud Vision Document and a $200 off code for #IFCSummit tickets. #TIFCA #cloud #clientot
MTBS3D RT @MTBS3D: Interview with Shawn Frayne, CEO of @LKGGlass, #3D footage included. Alex Hornstein, CTO of Looking Glass Factory, will be spe…
MTBS3D Interview with Shawn Frayne, CEO of @LKGGlass, #3D footage included. Alex Hornstein, CTO of Looking Glass Factory,… https://t.co/sMLRxLd7eE
MTBS3D RT @IFCSummit: #IFCSummit is proud to announce @intel as a Platinum Sponsor! #Intel #futurecomputing #cloud #gamedev #AI #AR #VR https://t.…
MTBS3D RT @IFCSummit: IFC Summit is proud to announce @AMD as a Silver Sponsor for #IFCSummit! #CloudComputing #FutureComputing #AI #gamedev #AR #…
MTBS3D RT @IfcSummit: IFC Summit welcomes Professor Bebo White to our futurists panel. @beboac is a Department Associate (Emeritus) at the SLAC Na…
MTBS3D RT @IfcSummit: Nima Baiati Global Head of Cybersecurity Solutions for @Lenovo is speaking at #IFCSummit. #IFCSummit2019 #CyberSecurity http…
MTBS3D RT @IfcSummit: Jeffrey Shih Lead Product Manager for @unity3d’s efforts in #ArtificialIntelligence is speaking at #IFCSummit. #IFCSummit201
MTBS3D RT @IfcSummit: We are excited to welcome Director in Privacy and Security, Paul Lanois, for @Fieldfisher as a speaker at #IFCSummit. Paul…
MTBS3D Jim Jeffers talked about @intel’s efforts to enable over a billion users with creative and computing tools.… https://t.co/Z9fi0pS8xp

Novel Way to Shoot VR With GoPro Cameras


While there is a seemingly endless amount of enthusiasm for 360-degree cameras; especially cameras that can record in stereoscopic 3D, the availability of such tools is actually very rare. It's not just that most of the camera rigs are in continual development and are largely experimental, the tools needed to effectively cut and edit content like this is very processor intensive. For example, if it takes several hours of processing time to encode a regular video, imagine what it is to encode a film based on 14+ cameras or a full-resolution 360-degree solution?

This is the conundrum faced by Toronto independent filmmakers Elli Raynai and Alexander Kondratskiy, and their quest to record virtual reality on a tiny budget. The result was "I am You", a short film that gives the HMD user the perspective of the wearer. Here is Elli's explanation of how they got it to work with just two GoPro cameras:

I am You Movie Theater Scene
"We shot the first half of the film with a regular DSLR camera and built a 3D cinema from scratch. This way a viewer who hasn't experienced VR before could get a 'comfortable' introduction to the platform. Then halfway through the film the viewer gets pulled into the body of the character and they see the remaining part of the movie from their perspective. We use two gopro's which gave us an approximate FOV of 120 degrees, I don't know how much we had vertically, but it wasn't much. We shot that part in 3D, but not 360 of course, as we chose a different approach for immersion and directing the viewer's attention. In that way when the actor moved left or up and down, so did the screen. So basically the viewer has to follow it, which makes them feel like they are there."

The advantage of shooting 360-degree video is the HMD user can move their head all over the scene and get the full experience. Remember that they only need to see 90 to 120 degrees of field of view at a time depending on the hardware they are using, so while there is a full 360-degrees of content being sent to the user, they have full head tracking capability because they only need to see smaller slivers of it at a time. This is how it's possible to remotely enjoy a basketball game, for example.

The challenge is if you don't have a 360-degree camera, you only have a fraction of the material to work with when making your VR films, so it's no longer possible to offer head tracking. What happens instead is the HMD user is forced to see experiences that are completely disconnected from where their head is pointed, and this can easily cause nausea and discomfort.

I am You First Perspective
The solution is in how the content is captured along with additional positional data. They were still limited to 120 degrees of FOV, but as the scene was captured from the stereoscopic 3D GoPros on the actor's head, he was also wearing an Oculus Rift that was capturing head tracking data. The filmmakers then created a digital 360-degree map, and using this head tracking data, placed the image where it should be according to what the actor experienced. For the final user, they just have to keep a watchful eye and follow the placement of the scene in this 360 environment and move their head around to follow it accordingly.

Very interesting experiment! The film was also featured by Canada's CBC.  Congratulations!