It is currently Sun Sep 21, 2014 12:09 pm



Reply to topic  [ 42 posts ]  Go to page 1, 2  Next
 Rig for Gopro vertical stereo fisheye video 
Author Message
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
Here is a Gopro Hero2 stereo rig I have been using for a while for shooting stereo 360 panoramas (on a turntable) -- which can be used for example with VR Player with the Rift (and other display and tracking options).
http://www.mediavr.com/oculus/goprovertical.jpg
-- some earlier examples of Gopro stereo 360 panoramas are on my blog eg.
http://www.stereopanoramas.com/sydney2hobart.htm


One camera is inverted relative to the other because the original 3d case for Gopro2s has the cameras that way and the firmware expects that and you get rolling shutter differences if you have both cameras up the same way. Sync is very good with the 3d kit (a 3d kit is not available yet -- ever maybe -- for the Hero3)

You can see you can slide one of the cameras to vary the interocular. The viewfinder is a wide angle viewfinder, originally for the Nex 5.

This kind of rig can also be used directly for shooting videos that look correct in the Oculus Rift (if you offset the R video to the left a little)
Here is a (short) video I shot with it (side by side stereo). This works ok in my Rift -- if you set it full screen.

http://www.youtube.com/watch?v=T8bESSpyQa4&hd=1

--edit -- here are a couple more Youtube videos shot with this rig
https://www.youtube.com/watch?v=KMa8AM5Df8o&hd=1 (puppies)
https://www.youtube.com/watch?v=3yKQ2GSkpaI&hd=1 (low light test)





If you wanted to shoot 180 videos for Rift etc with a Gopro stereo rig like this you could replace the lenses with short focal length fisheyes eg. I adapted a Sunex 218A miniature fisheye to an earlier Gopro without much trouble. Of course one issue with 180 stereo fisheye capture for stereo video is your effective interocular is zero at the horizontal limits of the frame.

I have been tailoring a stereo video fisheye setup from a (vertical, base to base) pair of 5DMKIIs lately (with twin 10.5mm Nikkors). This looks very promising for stereo video capturing for Rift etc and rapid stereo 360 panoramas capture from video with a fast rotating turntable. Recent Magic Lantern firmware enables raw capture and half-press shutter for video start with these cameras. I have been getting very good video sync (via spliced cable release) with ML and these cameras in Raw mode with half-press start -- but maybe I have just been lucky with the sync. I will have to do more testing. Raw is very important for superwide and 360 panoramic capture because of the large dynamic range common in such subjects.

[edit] I have changed the Youtube url above to one with better alignment of the two windows I think. ( My workflow involved positioning the L/R videos in After Effects and saving as mp4s and viewing them in Media Player Classic with the Rift to check the alignment. There is a big difference in screen position of the L/R elements with MPC and windowed full screen and full screen proper and I was using the former when I should have been using the latter. Ideally Youtube should have lateral alignment (independent L/R and linked) options for its 3d video mode.)

PeterM


Last edited by mediavr on Wed Aug 07, 2013 9:12 am, edited 1 time in total.



Mon Jul 01, 2013 6:20 pm
Profile
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
Here is a stereo video with wider (180 degrees) coverage
http://www.youtube.com/watch?v=wE_s1maTsPk&hd=1 (you need a Youtube downloader)
that will work in VR Player
\http://vrplayer.codeplex.com/


or here, for a couple of weeks, is a Yousendit download link
http://www.yousendit.com/download/WFJXW ... UUVQWWNUQw

This is in over/under cylindrical stereo format -- the image portion of each L/R frame is 180 degrees wide, 83 degrees high. I shot this with twin 5D MkIIs Canons with 10.5mm Nikkor lenses. These lenses on full frame sensors have a coverage of 195 degrees by 130 degrees approximately (once the lenses have their lens hoods "shaved" off). I converted the frames from Raw to dngs to jpgs and then transformed them to cylindrical and cropped , aligned and stabilized the frames with PTGui panorama software. The cameras are synced for stereo video with Magic Lantern "half shutter press" video start and I use spliced cable releases.

In VR Player with a Oculus Rift connected you can "look around" in the view of the videos from side to side. (Click the timeline to get the video to restart).

You might notice the stereo impression is less pronounced at either side of the view because then the effective stereo distance between the camera lenses is less than when the view area is directly ahead.

In VR Player you need the following settings:
Media -- Format -- Over/under
-- Projection - Cylinder
-- Effects - None

Device -- Layout -- Side by Side
-- Distortion -- Barrel
-- Tracker -- Oculus Rift

Tools -- Setting -- Fov 110
-- Horizontal Offset -- 72
-- Vertical Offset -- 0
-- Effects -- None
-- Distortion -- Barrel -- 1.45
-- Tracker -- Oculus Rift

PeterM


Thu Jul 04, 2013 12:20 am
Profile
Petrif-Eyed
User avatar

Joined: Sat Sep 01, 2012 10:47 pm
Posts: 2650
Very nice! Thank you for sharing that. I am very interested in this stuff.

_________________
“The creative person wants to be a know-it-all. He wants to know about all kinds of things: ancient history, nineteenth century mathematics, current manufacturing techniques, flower arranging, and hog futures. Because he never knows when these ideas might come together to form a new idea. It may happen six minutes later or six years down the road. But he has faith that it will happen.” ―Carl Ally


Last edited by geekmaster on Sun Jul 07, 2013 11:37 am, edited 1 time in total.



Thu Jul 04, 2013 6:49 am
Profile
Binocular Vision CONFIRMED!
User avatar

Joined: Mon Aug 06, 2012 9:26 pm
Posts: 283
Location: Sweden
This is inspiring :D I have been sketching on a rig of my own for the last what... four or five months? Life has been chaotic though (new city, new job, no place to live yet... erhm) so nothing has come to fruition! I finally found a place with laser cutters here, but they had just closed for the summer the week before D: My timing is crappy, hahaha. Do you have any build log for your rig? I would happily gloss it over :D Then read it in detail. Then obsess over building something of my own. Right, I'm already doing that. Cheers!


Sun Jul 07, 2013 11:22 am
Profile WWW
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
One thing to keep in mind for building Gopro rigs is that the Gopro 2 does not have totally flat sides. (Hero3s do). So I had to file down the sides a little to make them fit and slide smoothly in my rigs.

There are a few M12 fisheye lenses with shorter focal lengths and more compact image circles than the standard Gopro ones.
This Omnitech one has a 190 degree image circle with a 3.4mm image circle that would provide full circle coverage with the 1080p W setting on Gopro 2s. Sensor size on recent Gopros is 1/2.5" - 5.70 × 4.28 mm according to this:
http://en.wikipedia.org/wiki/GoPro
(none of the Gopro 2 format options actually use the full sensor size. 960p uses the maximum shorter dimension, 1080p the maximum longer dimension)
This Omnitech lens ($250) has a 2.8 aperture. It lacks a IR filter but Omnitech say they could cement one on (for an extra $50 I think)

Ragecam sell two circular fisheye suitable models.
http://ragecams.com/shop/gopro-hero2-he ... -c-72.html
This one ($400) is they say the best quality one
http://ragecams.com/shop/119mm-panorami ... p-559.html
but can be used on the Hero2 only if you fit a M12 mount on the front of the camera body (the lens has too short a back section to screw into the standard M12 mount).
This modification is $200 done by them I think.

Or there is this one they sell ($160). I think this might be the best bang for buck
http://ragecams.com/shop/124mm-aspheric ... p-499.html
This will fit directly on the Gopro2 (once you have removed the original lens -- see Youtube tutorials)

Sunex sell a bunch of miniature fisheye lenses ($100 but expensive! postage)
http://www.optics-online.com/dsl_fisheye.asp
I have one of these but the quality is ok but not as good as the original Gopro one say.

PeterM


Sun Jul 07, 2013 4:46 pm
Profile
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
Omnitech link
http://www.omnitech.com/pdf/ORIFL190-3%20rev%209.pdf


Sun Jul 07, 2013 4:57 pm
Profile
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
One interesting snippet in that interview with Next3d is about a possible 3d kit for Gopro Hero3
"We are very hopeful to add support for GoPro Hero3's in 2.7K mode, as soon as GoPro releases the 3D sync kit. (BTW - David Newman from GoPro says, "It is coming. Certainly we expect to be in the market well before consumer launch of Oculus Rift.")."

Yes stereo Gopros can be used for a wider range of subjects than their current rig which has a very large interaxial -- and mirror stereo rigs wont work with fisheye lenses (or at least the view is very cropped)

If Gopro do make a 3d kit for the Hero3 (or more likely maybe, its successor) then that perhaps with the more expensive of the Ragecam lens options might be the way to go. Certainly the Hero3 Black has superior video to earlier versions.

Actually simple M12 mini fisheyes like are used in the Gopros etc are not ideal for fisheye video -- no adjustable aperture for instance. A while back I looked at alternative mini fisheyes (used in all-sky cameras etc) that might be adaptable via C mount to M12 adapters
http://tech.groups.yahoo.com/group/Pano ... sage/52390

in that pdf in that link where he compares the Omnitech and Fujinon mini fisheyes he mentions that tolerances are not very tight in mini fisheyes assemblies generally

PeterM


Fri Jul 12, 2013 5:40 pm
Profile
Binocular Vision CONFIRMED!
User avatar

Joined: Mon Aug 06, 2012 9:26 pm
Posts: 283
Location: Sweden
This is all very interesting mr PeterM :D I do hope Next3d supports the 1440p48 mode too, it has the most pixels pushed per second out of all the modes on the GoPro black, and since watching The Hobbit in 48 fps it feels like the new lowest fps :o

Right now I only own two HD Hero 1 cameras, which are what I'm experimenting with. It'll probably be a while before I actually have the guts to replace the lenses of GoPro 3's if / when I get them, I tend to use my cameras for many different things and would like to keep the versatility. Preferably I'd use two normal cameras for it with fisheye lenses, buuuuut... it's hard to get the video resolution that the Hero3 does for that price, for now.

Thanks for the info :D definitely inspiring!


Mon Jul 15, 2013 11:18 am
Profile WWW
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
This new Mobius mini fisheye camera looks like it has a really good lens. I am tempted to buy one to see if the lens can be used on a Gopro.
Set this to 1080p on Youtube and check the image sharpness (from about 7.10 on). If two of these Mobius cameras could be synced somehow (wire the start buttons together?) it might be a good look - around video stereo solution -- it can also be used as webcams and the lens focuses close too.
http://www.youtube.com/watch?v=7wmIyD1fM4M

PeterM


Wed Jul 17, 2013 1:46 am
Profile
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
the Mobius camera (previous post) does look like it has potential for fisheye stereo sync -- one mode you can configure it -- via editing a txt file you put on the microsd card -- is to set it to start video shooting on power up.

With simultaneous power up maybe two (or more!) would be in sync. The manufacturer does frequent firmware updates according to user feedback. Maybe he can be persuaded to make specific Rift suitable tweaks.

Another interesting dual mini fisheye camera concept is the ATC Chamelion
This is an action cam with two swiveling fisheye lenses. One can be front facing and the other looking straight up. Good for certain Rift (mono subjects). Or maybe you could hack it to make a superwide camera.
http://www.laptopmag.com/review/camcord ... eleon.aspx
For underwater applications there is this (not very compact :-) ) superwide concept
http://web.archive.org/web/200701130352 ... roject.htm

PeterM


Sat Jul 20, 2013 5:37 pm
Profile
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
Here is a rig I have been using for a few years for 360 timelapse videos from time lapse stills with 5D MkIIs and 10.5mm Nikkor fisheye lenses.
http://www.mediavr.com/twinrig1.jpg
It makes interactive 360 videos (gets smoother when it all loads) like this
http://www.mediavr.com/ch364/ch360d.htm

The 10.5mm Nikkor (once you have trimmed off the lens hood) has coverage of about 194 by 130 degrees on full frame cameras-- which makes it the widest of common modern fisheye lenses for DSLRs -- so there is enough overlap for horizontal stitching into 360s from two views.

Now with Magic Lantern Raw you can shoot videos at normal video rates with raw video with such a setup -- making it a good alternative I think to the more miniature multicam rigs when you need raw video quality and the subject is not too close and full spherical coverage is not essential.

Here is a 360 video with it (with Magic Lantern Raw --shot at 24fps but sped up about 250% to make it look more lively). This is in spherical 360 perspective and will work in VR Player on the Rift (but not in stereo of course)
http://www.youtube.com/watch?v=lpkOjWCkBYU&hd=1

Here is a link (for a couple of weeks) if you want to download it (35mb) and try it out in VR Player. In the Media menu in VR Player the Format is Mono, the Projection is Sphere (the original stitched video is about twice the size and resolution of this download -- but too large)
http://www.hightail.com/download/bWJyRkJYTmF0Ni80WjlVag

Using the Rift with a 360 pano shot from a pole like here you get the impression the natural thing to do is look down a bit (it is more comfortable generally to look down than up with HMDs I find). So a 360 video from a pole would be better generally with more area to look at down than up -- ie. an asymmetric pano would be better. Which can be done with this sort of rig just by tilting each camera down a bit. If each camera with these lenses is tilted down about 20 degrees you get full nadir coverage (no hole) and vertical coverage up to about 20 degrees above the horizon in the finished panorama -- and this would have been better with this subject maybe. (Of course a full 360/180 panorama would be better still.)

VR Player
http://vrplayer.codeplex.com/



I write about the twin DSLR approach to 360 video capture in more detail on the Yahoo Panotools NG list here:
http://tech.groups.yahoo.com/group/Pano ... sage/56795

Another thing that Magic Lantern raw video enables is very rapid stereo spherical 360 panorama capture with twin camera (5DMKII or III) rigs. Rapid capture is essential for 360 stereo of action scenes (water, street scenes etc). Here is one I shot this morning with a 4 second rotation (100 frames approx). The alternative, long bursts of stills, is bad for the shutter life of cameras, and not nearly as fast.
http://www.stereopanoramas.com/peak.htm (you can drag the view)



PeterM


Fri Jul 26, 2013 8:45 pm
Profile
Binocular Vision CONFIRMED!
User avatar

Joined: Mon Aug 06, 2012 9:26 pm
Posts: 283
Location: Sweden
A crazy amount of links :D I am actually subscribed to TechMoan so I had seen that video of the Mobius camera :) it seems very nice for the price, for sure. And with features in the firmware that I have requested from GoPro for years, which kind of puts GoPro to shame.

What the GoPro has though are the higher resolution capture modes, which is well... what sets them apart from the competition right now :/ I have been holding off getting GoPro blacks though due to the reported freeze/reboot glitches, as well as all my SD cards not fitting in them, haha.

I am fascinated by your rigs and panoramas :3 I have been a hobby panorama photographer for years, mostly just spontaneously with P&S cameras, but it would always take me months to get to building them :P I really should try to get into the process of it more, I think I still have sequences that are not built.. haha.

Thank you for the inspiration :D


Wed Jul 31, 2013 2:48 am
Profile WWW
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
Oculus Reddit readers might have seen my posts about Gopro 3d video for the Rift, and using Magic Lantern for Raw video capture of stereo 360 panoramas for HMDs

http://www.reddit.com/r/oculus/comments ... mat_video/

http://www.reddit.com/r/oculus/comments ... g_and_the/

Raw video capture for 360 stereo still panoramas also means it must be possible now to make a kind of 360 stereo video panorama without much extra effort. For stitching still stereo panoramas with twin cameras you need a lot of shots so the non-axial character (of at least one) of the cameras is mitigated. This is why it is a boon to be able to shoot stereo panoramas with good quality (raw) video You are stitching thin vertical slices together.

But if an area of the scene is not very close to the camera you can use quite a wide (say 20 degrees) span of a single image pair from the sequence for part of the scene. So you can shoot a stereo still panorama and then rotate the cameras to a talking character standing in the scene say. And the character can appear in multiple areas of the scene -- pointing, talking and gesticulating. Directional sound might help the user turn to a different area when the character is in a new area. Architects, real estate agents talking about their building for instance. Or you can imagine dramatic narrative scenarios. The only requirement for this approach is that the characters dont perambulate around the camera -- they could stand up, sit down, climb up and down ok.

Of course you could make a Unity app for a more ambitious kind of 3d panoramic 360 movie by using blue screen real people or CG character animations with stereo panoramic skybox backgrounds
.. like here in 2d
http://www.stadtmaus.de/halloween-special/

CG characters have an advantage that you can incorporate occlusion and shadow casting effects in stereo panoramas with a bit of work (if the game engine supports it).

PeterM


Sun Aug 04, 2013 6:00 pm
Profile
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
A new over/under spherical 360 perspective still stereo panorama -- of a girl on a balcony. Shot handheld
.... about 200 by 130 degrees of actual image -- it will work in VR Player or Yuri's Rift Imager
http://www.stereopanoramas.com/hbgloverunder.jpg

Shot with this Gopro vertical rig camera with the cameras pushed together so they are touching (for this closeup shot)
http://www.mediavr.com/oculus/goprovertical.jpg

For regular 2D panoramas I sometimes use a compact motorized rotator I have made from a battery powered pepper grinder. These pepper grinders rotate their main drive shaft at about 10 rpm -- which is convenient for capturing 360 panoramas of a reasonably fast action scene
http://www.youtube.com/watch?v=j2QqJCUZKpM

For stereo panoramas the rig has really to be held more steady than you can see in this video -- which was done with a single heavy dslr on the pepper grinder over my head.

For handheld stereo panoramas I have been using my Gopro rig on this pepper grinder rotator and I have the cameras rotating directly in front of my head -- holding the pepper grinder rotator below -- at chest level. My head ends up comprising 120 degrees of the panorama -- but that is the penalty for being able to hold the setup very steady. I have a horizontal support attached to the grinder base which I press against my chest as a chest pod. Some pictures of the assembly soon.

PeterM


Mon Aug 12, 2013 9:19 am
Profile
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
The Mobius mini camera is getting a new extra wide angle fisheye lens
http://www.rcgroups.com/forums/showthre ... 9&page=133
This lens -- super cheap -- looks like it will be a very good fit for filming for the Rift -- HFOV 116 degrees.

I am pleased to finally be able to give definitive information on a new wider FOV lens for the Mobius (lens name designation yet to be announced)! This is the same lens I have had for testing for a couple months now, made in Japan with 7 quality optical glass elements. This gives excellent image corner-to-corner sharpness, contrast, and color uniformity, with negligible vignetting.

With current FW v0.41, the horizontal field of view (HFOV) of this new lens in 1080p-30fps mode is about 116 deg. by my measurements. In 720p-60fps mode the HFOV is about 63 deg. and in 720p-30 fps mode, the HFOV is scaled and identical to the 1080p-30 fps mode (116 deg.). Compare this with the existing standard Mobius lens which has HFOV of about 85 deg. and 46 deg., respectively. In still photo mode set for 2304x1536 pixel size, the wider lens gives a HFOV of about 118 deg. from the larger size unscaled 1:2 aspect ratio imager CMOS array. The new lens will add about 2 gms of weight to the camera compared to the standard lens.


The projected cost of this new lens from the China verified sellers is about $13 US (delivered) for the lens only, and about $27 US (delivered) for the complete lens/CMOS module. Availability is uncertain (lenses have been ordered), but is hoped to be early to mid Sept. 2013 from the China eBay sellers. Pricing and availability from verified resellers will likely be a bit higher/longer. Contact your favorite verified vendor for their most current information on this lens.

A couple of Mobius cameras with these lenses -- affixed to front of the Rift -- will be a good passthrough solution I think (they have a webcam mode). Also I am interested in macro stereo panoramas so they will be useful for that -- I will have to order a couple of the cameras I think and start experimenting with them.


Mon Aug 19, 2013 3:19 pm
Profile
One Eyed Hopeful
User avatar

Joined: Fri Aug 03, 2012 3:42 am
Posts: 41
Hey Peter,

since I am very interested in your whole project, I wanted to ask if you had luck with those lenses you mentioned?


Wed Sep 04, 2013 2:11 pm
Profile
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
DolAtoR wrote:
Hey Peter,

since I am very interested in your whole project, I wanted to ask if you had luck with those lenses you mentioned?


My Mobius cameras came (in about a week from China) and the lenses -- the default lenses -- are very good. They are fisheye with a diagonal angle of about 110 degrees. They seem to have no chromatic aberration at all (compared with quite a bit with the Gopro Hero2 lens) and seem sharper too. But they have more flare when used into the light. The optional wider lenses have not been released yet (in a couple of weeks reportedly).

The cameras work really well in webcam mode -- much better sharpness and color in low light than Gopro Hero2s. With the forthcoming lenses the Mobius will be a great solution for streaming Skype type video for the Rift I think.

I havent tested them yet for stereo sync in normal video mode. You can configure them to start recording video on power up (external power applied to the usb socket) but the start process takes quite a few seconds
so there is plenty of scope for missyncs to develop in that period. I will buy a USB external power supply with dual outputs and power switch to test this soon (something like this maybe
http://www.ebay.com.au/itm/Brandnew-DC- ... 2c67716c69 )

I think a better chance might be to join the two start video button switches on the cameras but that would require much superior soldering skills than I have. Alternatively I am thinking of a mechanical lever switch which would actuate both switches (approximately) simultaneously.

The cameras are really easy to pull apart and they even come with an Allen key to unlock the lens for removal and the extension cables for the sensor are available (I bought a couple of 20cm extensions) so when the new lenses are available this will be an exciting prospect for macro stereo video setups (think architectural physical models, ants etc) for the Rift. You will be able to get the lens centers together as close as about 15mm I think (even closer in vertical mode for the Rift).

PeterM


Thu Sep 05, 2013 4:17 pm
Profile
Binocular Vision CONFIRMED!
User avatar

Joined: Mon Aug 06, 2012 9:26 pm
Posts: 283
Location: Sweden
This sounds nutty interesting o.o Macro videos sounds awesome! And I didn't actually know they could be used as webcams, what kind of resolution can you get? Is there a way of merging two camera feeds into one virtual webcam? Exciting!


Thu Sep 05, 2013 6:34 pm
Profile WWW
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
BOLL wrote:
This sounds nutty interesting o.o Macro videos sounds awesome! And I didn't actually know they could be used as webcams, what kind of resolution can you get? Is there a way of merging two camera feeds into one virtual webcam? Exciting!


They can be captured in 1280 by 720, 24 bit color, 30fps each camera.

There is this project to make a virtual webcam for the Rift but the thread is old
https://developer.oculusvr.com/forums/v ... =29&t=1234

What you can do is create a live stream with Stereoscopic Multiplexer
http://www.3dtv.at/Products/Multiplexer/Index_en.aspx
You see a capture window which can be scaled to fill up the screen laterally
-- the sync with two Mobius plugged in looks good and the side by side video can be
captured at 2560 by 720 at 30fps -- so you could make Rift movies with ithr program with a laptop (with the
upcoming superwide lenses and the cameras turned vertically) which would look good
in the Rift I think. (You can use an overlay image and adjust lateral alignment in the program for preview and render) You can preview the movie as you shoot - through a Rift or on the laptop screen. I will do some tests shortly with the existing lenses. The fisheye amount and fov of the superwide lenses look close to the ideal Rift amounts so I think these lenses will work as is without additional image correction.

[edit] Mobius cameras with the superwide lenses are available for preorder now
http://joovuu.com/index.php?
According to the RCGroups forum thread they will be available for shipping 18th Sept -- two of these plus Stereomultiplexer will be a great live feed/streaming solution for the Rift I think. Probably the lenses themselves will appear on Ebay the next couple of weeks I would think.

[edit] someone has tested a Sunex 215A on the Mobius and it looks really sharp ( watching at 1080p on youtube) and very wide angle. This would be better for the Rift than even the wider angle option lens for the Mobius but it is much more expensive ($99 last time I bought a similar one).
http://www.youtube.com/watch?v=mWE__XFU2aQ#t=60


Last edited by mediavr on Wed Sep 25, 2013 2:37 pm, edited 2 times in total.



Fri Sep 06, 2013 6:21 pm
Profile
Binocular Vision CONFIRMED!
User avatar

Joined: Mon Aug 06, 2012 9:26 pm
Posts: 283
Location: Sweden
Hmm, the wide one says 116 degrees, I guess diagonal, far from a full circle fisheye and lower than a GoPro :P but still way cheaper. Have you got the lenses yet? How close focus can you get? I'm totally sold on the stereo macro concept you said :P


Fri Sep 20, 2013 3:57 pm
Profile WWW
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
Here is a rig with twin 5DIIs that I have been testing lately for Rift stereo video content making.
http://www.mediavr.com/5d2sidebyside.jpg

The lenses are 10.5mm Nikkor fisheyes with trimmed lens hoods (to get more of the image circle on full format DSLRs)

The cameras you see are base to base and used in vertical orientation for side by side stereo video shooting.

This configuration of two 5DIIs gives you the minimum possible interaxial -- just a little larger than normal IPD -- but has the issue that your resolution and coverage options are comparatively restricted compared with horizontal side by side arrangements. Also since the cameras are inverted relative to each other the rolling shutter distortions are different with fast subject or camera motions leading to rolling shutter stereo missyncs. This last consideration stopped me trying this configuration for stereo video up to now but it worked well anyway I think.

Here is a video you can try with VR Player from it ... under Media / Format is Side by Side/ Projection is Dome
https://www.dropbox.com/s/oncaro82i803x ... tsdome.mp4

Coverage is about 160 by 160 degrees. It was shot with Magic Lantern firmware Raw video at 1280 by 1260 resolution and the fisheye images converted and aligned with PTGui and After Effects -- into side by side equirectangular 180 by 180 images and then made into the mp4. The depth impression on the Rift falls off a little to the sides of the panning range of course, since the effective interaxial is less there, but in the middle of the panning range the effect is very immersive and natural looking I think.
(You can get the video to repeat by clicking on the video bar near the start)


Sat Sep 28, 2013 6:17 am
Profile
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
I purchased a couple of wider fisheyes from Sunex -- their models DSL215 with IR filter ($99 each + expensive FedEX shipping if you are not in the US).
http://www.optics-online.com/OOL/DSL/DSL215.PDF
I fitted them to two of my Gopro Hero2s and made some rigs for the Gopros with the 3d Kit and have been doing some tests. For fitting them I followed the Ragecam tutorial
http://www.youtube.com/watch?v=Lx-Uotq37nw
They also have a tutorial btw for adapting Gopro 3s (and the Gopro3+) for this and other M12 lenses too. Gopro3s look a little more complicated to do.

With the Sunex lenses you need to trim off some of the plastic lens barrel of the Gopro M12 mount - with a fine saw -- to make the lenses focus to infinity -- so it is a more drastic kind of modification than you need with most M12 lenses . You can still use the original Gopro lenses but they fit with looser tolerances now. In general the mod makes the plastic threads of the mount not so functional so you really need some method of locating the lenses more securely once you have focused them. Ragecam supply a rubber washer with their lenses. I am using a small amount of Bluetak.

The Sunex lenses on the Gopro Hero2 (and on the Hero3s which have the same sensor size) have a 185 degree image circle which gives you about 185 by 100 coverage on 1080p and about 185 by 150 degrees on 960p (1280 by 960). The lenses look nice and sharp when you shoot test stills with them, not so sharp with video modes as the amount of sensor pixels you are using is not optimal. Ideally you would like a square sensor for shooting circular fisheye images. You need to set the focus carefully with test stills - previewing the focus with a test TV via HDMI is not accurate enough.

Here is a 3d 180/150 test (in equirectangular perspective) with a very close inter lens distance (35mm) -- so the depth effect is not very strong with this subject -- but it will give you an idea
https://www.dropbox.com/s/5qrl87s2nwtcyhp/bananal_1.mp4
It was shot at the 960p 48fps setting (the only fps for 960p) -- so at 30fps here it is a little slow motion. Download it if you want to try it in VRPlayer -- use Side by Side and Dome as the settings under Image. I think it will be a useful setup if you have interesting subjects up close to the camera in an arc around 180 degrees. With the Gopro2s at least the resolution of more distant subjects is not conducive to good depth with the video pixels available -- and Gopro have not released a 3d kit yet for the Hero 3s or the new Hero 3+ models.


Sat Oct 12, 2013 11:35 am
Profile
One Eyed Hopeful
User avatar

Joined: Fri Aug 03, 2012 3:42 am
Posts: 41
Hey Peter,

very interesting new lenses, the lack of depth in the banana example is striking though - have you made videos with an IPD of 64mm as well? Would be very interested in seeing these, since I'm building a GoPRo rig at the moment where the IPD is freely adjustable up to 500mm (for hyperstereo).

Also, I would love to hear your opinion on the new SuperView mode of the GoPro 3 Plus. Here is a comparison videothat shows a pretty wide angle - would that be usable for our goals? And have you heard anything about a new 3D set for the 3 Plus?

Thanks for the update!
d


Thu Oct 24, 2013 6:25 am
Profile
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
I have given up on Gopros for the time being. I fitted my new Sunex lenses to the two Mobius cameras I have and the image quality is so much better for videos that it is worth the lack of accurate sync I think.

Re the Gopro 3 and 3+ the default view, even the Superview setting on the 3+ is not enough fov to give you a lookaround experience. And the process of making Sunex or other mini fisheyes work on those cameras is very unsatisfactory. Not only do you have to loosen and remove the original lens, you have to trim off some of the plastic M12 mount on the cameras to get the new lenses to focus at infinity , a precarious process unless you are very experienced with those cameras I would think. Also the 3+ has issues with infinity focus with the default lens, according to long threads on the Gopro User groups forums and the RCgroups aerial photography forums. And there is no 3d kit yet for the Gopro 3 or 3+. So you might as well use the much cheaper Mobius, which is designed to use interchangeable M12 lenses. Also the sound recording of the Mobius is very good. I am going to order a couple of even wider Sunex lenses to try to get full circle 185 degree coverage on the Mobius. The Dsl215s I have been using in my latest tests give me about 180 by 125 degree stereo coverage. I have posted some examples with the Mobius/Sunex215 and explanations in this thread on the Oculus Reddit group
http://www.reddit.com/r/oculus/comments ... pic_music/

I have done more since then with the Mobius/Sunex215 which I am very happy with which I will post there soon


Thu Oct 24, 2013 10:46 pm
Profile
One Eyed Hopeful
User avatar

Joined: Fri Aug 03, 2012 3:42 am
Posts: 41
Cool, thanks for sharing it on /r/oculus - I'm dudelsac over there :)

Now that you prefer the Moebius, it's a shame that I have just printed myself a rig for GoPro 2s :D

Re video quality Moebius vs. GoPro 2: Are the moebius videos better quality when compared to GoPro 2? Or compared to GoPro 3/3+?

Sync can be done via audio clap/light flash in post with the moebius, but is that sync good enough for viewing in an HMD? What's your experience on that?

Looking forward to seeing your new experiments!


Fri Oct 25, 2013 7:53 am
Profile
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
DolAtoR wrote:
Cool, thanks for sharing it on /r/oculus - I'm dudelsac over there :)

Now that you prefer the Moebius, it's a shame that I have just printed myself a rig for GoPro 2s :D

Re video quality Moebius vs. GoPro 2: Are the moebius videos better quality when compared to GoPro 2? Or compared to GoPro 3/3+?

Sync can be done via audio clap/light flash in post with the moebius, but is that sync good enough for viewing in an HMD? What's your experience on that?



Re video quality -- Gopro 2 vs. Mobius. Mobius is much better in low light. And better in good light except that if you are shooting in weird light the Gopro 2 in Protune mode might give you better color correcting latitude. Mobius have an extended dynamic range setting which works but it doesnt give the color grading scope of Protune.

Re video quality Gopro 3 or 3+ vs. Mobius. I havent got a Gopro 3 or 3+ yet but I think the Gopros would be better. Also they have 1080p at 60p which gives more scope for post-syncing. And they have Protune.

This is just considering the sensors, when you add lenses into the equation the answer is more complex. I think the default Mobius lens is a bit better than the default Gopro 2 lens but it is not as wide angle as the default Gopro2 lens. The wide angle Mobius lens option
http://www.ebay.com.au/itm/Mobius-Repla ... 70c&_uhb=1
is I think about the same coverage as the default Gopro 2 (or 3s) lens but I havent tested it quality wise.
The Gopro 2 lens has better flare resistance than the default Mobius lens.

The default Gopro lenses (and the Mobius with the wide angle Mobius lens option) are good for side by side, vertical orientation rigs for Rift videos for Youtube (no look around but almost fill up the frame).

Re Sunex lenses vs. Gopro and Mobius lenses. With Sunex or other third party lenses you have the possibility of much wider coverage giving you the possibility of making 180 degree wide lookaround stereo videos suitable for VR Player etc in the Rift. The Sunex lenses I have , the DSL215, are much sharper than either the default Gopro Hero2 lens or the default Mobius lens. The Sunex lens has a compact discrete flare pattern when pointing into the sun but otherwise it has better contrast too than the default lenses for Gopro 2 or Mobius. Gopro2 default lens has a soft overall flare when pointed into the sun. Mobius default standard lens has a lot of soft overall flare when pointed into the sun.

Re sync, the Gopro 2 with the Gopro 3d kit (only for the Gopro 2) has perfect sync (so long has you have the cameras inverted one to the other, to provide equal rolling shutter distortions in accordance with the one up and down default stereo arrangement of the Gopro 3d case).

With the Mobius you can arrange them side by side like this
http://www.mediavr.com/mobius2.jpg
http://www.mediavr.com/mobius1.jpg
You can hold this rig so that you can fire both cameras almost simultaneously between thumb and forefinger on each hand to within a maximum of 1 frame offset so that makes it simpler for post syncing. Or you can look at the sound tracks and align the videos by sound peaks. Or use a clapper as you say.

I have tried with the Mobius's using identical new micro sd cards and using simultaneous power up (with a external battery twin usb power supply with a switch) and auto video start on power up -- but that doesnt work for syncing.

In the Mobius configuration software there is an option to sync the camera to the PC system time clock which I normally have checked. Also if you use Mobius's in Stereoscopic Multiplexer as twin webcams that program seems able to sync them perfectly (I havent tested that much).

What I havent tried is wiring both video start buttons together (it is beyond my soldering abilities) but I think that would be a thing worth trying.

Re syncing Gopro 3s -- there are options out there for making it better than random.
http://3dguy.tv/3dguy-creates-the-first ... 3d-system/
He sells a twin cable solution (with options for attaching twin LCD Gopro screens for stereo previewing) for about $200 I think but I dont know how well it works.

If they do bring out a 3d kit for the Gopro 3+ or its successor I will definitely start hacking them for wider lenses for lookaround Rift videos. One thing about the Gopro 3+ compared with the Gopro 3 is that it seems somewhat easier to remove or adjust the lens -- a thing a lot of people are trying in their efforts to remediate the focus at infinity problem many are encountering (with the initial releases of the Gopro 3+ at least). But like I say, for lens modding of the Gopros (all Gopros) with very short focal length M12 fisheyes, the M12 focusing barrel on all Gopros is too long to bring the lens close enough to the sensor. So a few mm of the M12 focussing barrel have to be cut off (with a very thin rigid modeling saw) -- which means you have to dismantle the camera thoroughly. With other M12 lenses you dont have to do this. I have done this surgery with two of my Gopro2s with success and screwed up the third (I am hamfisted). So I am reluctant to imperil Gopro3s to do this. Ragecam will do it for you but at a price.

It is a pity there are not more affordable professional options for making compact 3d rigs for lookaround Rift videos. There is a thread here on the Kappa Tauri cameras which look promising (down the bottom of the thread)
http://www.personal-view.com/talks/disc ... -hyperdeck
I have asked Kappa for price etc details but no answer yet.


Fri Oct 25, 2013 3:42 pm
Profile
One Eyed Hopeful
User avatar

Joined: Fri Aug 03, 2012 3:42 am
Posts: 41
Thanks for your insights, Peter! It's so great to have someone like you who seems to be able to answer all of my questions :)

For the moment, I will just use my GoPro 2 Rig and see if there will be a 3D Sync Kit for the 3+ or future iterations. If I remember correctly, GoPro wants to bring one to market before the launch of the consumer Rift. Do you have any further info on a confirmation of the 3D Kit for 3+?

I was also planning to order Sunex lenses, since I find your results very interesting - but the Fedex shipping to Europe is ridiculously expensive! Do you maybe have any idea where I could get those lenses (or comparable) a little bit cheaper?

Those Kappa Tauri Cams look promising indeed! Kappa is a German Corporation - so if you need anything specific from them, I could ring them up for you :)


Mon Oct 28, 2013 10:00 am
Profile
Two Eyed Hopeful

Joined: Sun May 30, 2010 3:55 am
Posts: 69
Hi guys,

I have a couple of Sony action cams (very similar to gopros) and I had a go at shooting something like this over the weekend. I'll have a play with the footage and see what I can come up with. I didn't get them lined up with each other very well (using a block of wood and elastic bands!).

If you want to sync the videos, the way I would do it would be to start them at roughly the same time, then move a stick downwards across both cameras at the same time. Then in video editing you can just remove everything before the stick (ie get the stick at the same point on both videos). That way they are both starting at the same time. I'm not sure if they would stay in sync, depends on if the cameras record at exactly the same rate.


Mon Oct 28, 2013 11:52 am
Profile
One Eyed Hopeful
User avatar

Joined: Fri Aug 03, 2012 3:42 am
Posts: 41
Hi Benji,

Your method is good, it is used in cinema filming since forever to sync audio and video via a clapper. Same can be done for 3D sync the way you described it but the problem is that in scenes with lots of action, sync like that might not be sufficient. Especially when viewing the content in an HMD, which is even more unforgivin of sync errors. That is why the GoPro 3D Hero Kit for two GoPro 2's is my choice at the moment - it has near perfect sync.

But Mediavr has made some great progress with non-Synced Mobius cams as well, so maybe syncing in post is truly sufficient.

I would be interested in seeing your Sony experiments, no matter how basic the construction is :D

By the way I have finished my own GoPro 2 rig (standard lenses for the moment) and will upload my VR Tourism experiments once I'm back from Australia :)


Tue Oct 29, 2013 9:42 am
Profile
Petrif-Eyed
User avatar

Joined: Sat Jan 09, 2010 2:06 pm
Posts: 2253
Location: Perpignan, France
DolAtoR wrote:
Especially when viewing the content in an HMD, which is even more unforgivin of sync errors. That is why the GoPro 3D Hero Kit for two GoPro 2's is my choice at the moment - it has near perfect sync.
The GoPro 3D kit looks far from having a perfect sync according to these tests :
viewtopic.php?f=3&t=15667


Thu Oct 31, 2013 8:59 pm
Profile WWW
Binocular Vision CONFIRMED!
User avatar

Joined: Mon Aug 06, 2012 9:26 pm
Posts: 283
Location: Sweden
On my spare time I'm currently making an Android app that will help sync stereo video. It's still not feature-complete but it's getting there. If anyone is interested in trying it out register at TestFlightApp and PM me your details and I can add you to the team, it'll let you download a test build :) I can provide more details and perhaps a video demonstration if requested, lunch is running out so this is just a short notice for now ;)

Edit: The app flashes squares on the screen of the device in the frequency you (soon can) input. It can also play a reference tone and (eventually) show some other stuff. Currently working overtime with uh... work projects, been doing that four weekends in a row now, so not much time to spare on this right now... but soonish :P It works with hardcoded values right now.

Can it be accurate? I've implemented a nano-second countdowntimer so rounding errors should be minimal and if you have an OLED phone it should work quite nicely, at least that is what I have tried it on so far.


Fri Nov 01, 2013 6:24 am
Profile WWW
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
https://www.dropbox.com/s/58lifltuxeck4ud/zombie1.mp4
http://www.reddit.com/r/oculus/comments ... reoscopic/

here is a video shot with the new Sunex lenses I ordered -- the DSL218 --
http://www.optics-online.com/OOL/DSL/DSL218.PDF -- on my Gopro2s. On the Gopros (any Gopros -- the sensor for the Gopro 2, 3 and 3+ are the same size) you get almost full circle coverage on 1080p. Just a sliver cut off top and bottom of the circle. So you can use the cameras vertically as well as horizontal if that is convenient (for example, to get the lenses closer).

On the Mobius the coverage with the DSL218 is less than on the Gopro (smaller sensor) , maybe 180 by 155 degrees and it looks sharper than with the Gopro but it looks very overexposed -- the reason being I think that the Mobius lacks a spot metering mode and all the black in the frame with the fisheye circle makes the camera think the scene is dark. With the Gopro in spot mode you dont have this problem. Also all the black in frame seems to throw off the color balance on the Mobius. But the DSL218 looks really sharp on the Mobius, not as sharp edge to edge though as the DSL215 (which I suspect is a more recent design). The DSL218 -- which I did the zombie movie with -- hardly ever looks sharp on the Gopro -- but the color and contrast are better than the Mobius and the sync is not an issue.


Sat Nov 02, 2013 7:01 pm
Profile
Two Eyed Hopeful

Joined: Sat Aug 08, 2009 9:53 pm
Posts: 58
I bit the bullet and bought a couple of Gopro 3 + Black. I unscrewed the existing lenses without much drama and saw that compared to the Gopro 2 the lens mount barrel is metal rather than plastic. This accounts for it being easier to break the focus locking glue of the lens in the lens mount and unscrew it than it is in the Gopro 2 maybe. Also it means that the barrel is clean afterwards and holds other M12 lenses securely and rigidly.

One of my Sunex fisheye lenses (and only one) would screw in and achieve focus. The DSL129D. The other ones I have needed to be screwed in a lot more to get focus and it wasnt physically possible (without major reengineering of the lens barrel). But the DSL129D looks good on the 3+ and gives about 180 by 160 coverage (full circle horizontal) -- which is a pretty good compromise coverage wise for pixel usage efficiency.
So I have ordered another DSL129D (I only had one) and a dual cable video start assembly by Camdo. If the sync is bad with this I will order the 3dguy.tv one and try that one maye (that has the advantage you can plug in LCD Gopro Backbaks into the cable and preview your video in stereo.


Fri Nov 22, 2013 5:31 pm
Profile
One Eyed Hopeful

Joined: Thu Dec 12, 2013 11:33 am
Posts: 15
I have been doing some experimenting with multiple Mobius cameras with the Wide angle lens option, trying to create 3D panoramic video. :anaglyph
It is impossible to sync the cameras. Using the record on power option it is possible to get them to start within a few frames of each other.
I used pairs of cameras to capture stereo; mounted in portrait, to get the most vertical FoV, then placed the pairs of cameras into a circle to create a panorama that would be in stereo. I had 4 pairs of cameras, 7 pairs are required with this lens to capture a full 360°. Without creating stereo 6 cameras are enough to capture 360° around.

The seams from stitching a multicamera rig take away from the immersive experience. Although with some more work I should be able to get it better. The biggest problem is, I could not get any footage from one of the cameras, so there is no stereo just right of center of the panorama.
http://photocreations.ca/3D/index.html

This was created as a proof of concept to see how hard it might be to create a full 360° panorama in stereo. For most instances on the Rift I think using a pair of ultra wide lenses on genlocked cameras is the best method. It is much easier and the seams take away from the experience.
To get the Full 360° in stereo, I think the ideal rig would be with 5 pairs of cameras with slightly wider lenses, that are arranged overlapping like I did. The wider lenses will also give more vertical FoV.


Thu Dec 12, 2013 8:33 pm
Profile
One Eyed Hopeful

Joined: Thu Dec 12, 2013 11:33 am
Posts: 15
This Kickstarter project for mirror to put on action cameras to create 360° video.
http://www.kickstarter.com/projects/953 ... f=category
Talks about a firmware hack for GoPro cameras, that allows GoPro Hero+ Black to capture 3040x3040 at 22FPS. This might be very useful with a circular fisheye lens.


Thu Dec 12, 2013 8:50 pm
Profile
Binocular Vision CONFIRMED!
User avatar

Joined: Sun May 26, 2013 2:45 pm
Posts: 205
j1vvy wrote:
This Kickstarter project for mirror to put on action cameras to create 360° video.
http://www.kickstarter.com/projects/953 ... f=category
Talks about a firmware hack for GoPro cameras, that allows GoPro Hero+ Black to capture 3040x3040 at 22FPS. This might be very useful with a circular fisheye lens.


Yup, I posted it on my facebook page!

_________________
Portal Dual 180+ HFOV HMD: viewtopic.php?f=26&t=18335

PORTAL DUAL VR, Downloads: http://hannibalj2.jimdo.com/


Thu Dec 12, 2013 9:14 pm
Profile
One Eyed Hopeful

Joined: Thu Dec 12, 2013 11:33 am
Posts: 15
I have another 3D panoramic video. Christmas Day 2013
A walk in the woods with ice covered trees.

http://photocreations.ca/3D/index.html

Stitched together from 8 cameras with wide angle lenses.
I did the aligning in PTGui and the stitching using VideoStitch.

To aligned the stereo pairs I added a ton of control points and turned them all the horizontal line control points. I added a couple normal points to determine at what distance I want the pairs to converge.

I edited the video down to 6 min.


Mon Jan 06, 2014 12:21 am
Profile
3D Angel Eyes (Moderator)
User avatar

Joined: Sat Apr 12, 2008 8:18 pm
Posts: 10903
@j1vvy: Awesome, man!

_________________
check my blog - cybereality.com


Mon Jan 06, 2014 12:49 am
Profile
One Eyed Hopeful

Joined: Fri Jan 17, 2014 2:05 am
Posts: 1
Hi,

I've been looking for a good full circular fisheyes on gopro too. I tested some so called high res circular fisheyes at MP, 2MP & 5MP, but most of them do not produce clear images outside the central sweet zone. And, there is not much fisheyes lens designed for 1/2.3" sensor, so the image circle fall either fall outside the frame (e.g. sunex 219) or too small for pixel usage (the expensive 1.19mm for 1/3.2" only can make 2100x2100 photo/1500x1500video on gopro hero3).

I have a friend working in a lens factory and he did a prototype to me, a big F2.0 - 185 deg full circular fisheyes rated at 10MP, which enable the gopro to take 3000x3000 circle, more than 2X photo pixel count (4X for video, with some hack script) to the 1.19mm's. I shall need some more patient to calibrate the lens as the tiny difference in focus cannot be seen clearly even with HDMI output on a 42" TV.
here is the captured image:
http://ge.tt/60hGs8G1/v/0

the sweet zone is very large thus very helpful for stitching with only a few shots. Here is a quick krpano test for S3D 360 in a snapshot:
www.izugar.com/demo/3603d/stair/stair_sbs.html

The test was done with an early prototype with 2MP lens. The hand-made 10MP lens is quite expensive at the moment, and I wish the price could go down once the order was large enough for mass production.

Regards,
KC


Thu Jan 23, 2014 9:48 pm
Profile
One Eyed Hopeful

Joined: Thu Dec 12, 2013 11:33 am
Posts: 15
Mediavr,
GoPro has released a new case for two GoPro cameras.
http://gopro.com/camera-accessories/dual-hero-system

Will it fit your modified camera with wider lenses?


Wed Apr 02, 2014 8:33 am
Profile
Display posts from previous:  Sort by  
Reply to topic   [ 42 posts ]  Go to page 1, 2  Next

Who is online

Users browsing this forum: No registered users and 3 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Jump to:  
Powered by phpBB® Forum Software © phpBB Group
Designed by STSoftware.