Telepresence / Rotating Stereoscopic Camera (3D FPV)
- blazespinnaker
- Certif-Eyed!
- Posts: 541
- Joined: Sat Sep 01, 2012 11:53 pm
Telepresence / Rotating Stereoscopic Camera (3D FPV)
Perhaps I missed it, but is anyone working on this yet?
Basically, I'm looking for a stereoscopic camera mounted on a rotating platform that can take positional information from the Oculus Rift and position itself accordingly.
I can imagine there'd be some problematic latency issues if the device was too far away, but still might be fun to play with.
Basically, I'm looking for a stereoscopic camera mounted on a rotating platform that can take positional information from the Oculus Rift and position itself accordingly.
I can imagine there'd be some problematic latency issues if the device was too far away, but still might be fun to play with.
Last edited by blazespinnaker on Wed Feb 13, 2013 3:20 am, edited 1 time in total.
Gear VR: Maybe OVR isn't so evil after all!
- BOLL
- Binocular Vision CONFIRMED!
- Posts: 295
- Joined: Mon Aug 06, 2012 9:26 pm
- Location: Sweden
- Contact:
Re: Telepresence / Rotating Stereoscopic Camera
People interested in using the Rift for FPV are probably looking at it which makes me think of borrower-vision with a tele-prescence that is miniaturized with a very short IPD. Or the other way around, a large IPD to see the world miniaturized instead. I would definitely want to try things like that
- Diorama
- Binocular Vision CONFIRMED!
- Posts: 273
- Joined: Mon Jan 28, 2013 10:37 am
- Location: Brighton, UK (Sometimes London)
Re: Telepresence / Rotating Stereoscopic Camera
Realistically, how low can the latency go, with current technology (that is affordable)?
That stereo FPV camera for model planes looks really light: http://www.nghobbies.com/cart/index.php ... cts_id=393
It's just a PCB with a chip and two tiny cameras, and weighs 30grams according to the website.
You'd need to simulate at least 2 degrees of freedom (I would have thought that simulating roll properly might complicate things), I wonder what the best way to do that would be? Are the kind of servos you'd need expensive?
I am very interested in the whole stereo-camera-telepresence thing too.
Because its one of the first things I want to do when I get my Rift haha!
That stereo FPV camera for model planes looks really light: http://www.nghobbies.com/cart/index.php ... cts_id=393
It's just a PCB with a chip and two tiny cameras, and weighs 30grams according to the website.
You'd need to simulate at least 2 degrees of freedom (I would have thought that simulating roll properly might complicate things), I wonder what the best way to do that would be? Are the kind of servos you'd need expensive?
I am very interested in the whole stereo-camera-telepresence thing too.
Like this?:BOLL wrote:Or the other way around, a large IPD to see the world miniaturized instead. I would definitely want to try things like that
Because its one of the first things I want to do when I get my Rift haha!
- mahler
- Sharp Eyed Eagle!
- Posts: 401
- Joined: Tue Aug 21, 2012 6:51 am
Re: Telepresence / Rotating Stereoscopic Camera
This gives a whole new meaning to having your head-in-the-clouds.
It also illustrates how important it is for game developers to think about the influence and in-game character's IPD has on the way the player experiences the world. Different people experience objects in different ways because of their IPD. If that of an in-game character is suddenly from yours this is likely to impact the way you experience a game. My guess is that Oculus is already ahead of us and will put this value in the SDK, perhaps based on how the player customizes the head-set.
It also illustrates how important it is for game developers to think about the influence and in-game character's IPD has on the way the player experiences the world. Different people experience objects in different ways because of their IPD. If that of an in-game character is suddenly from yours this is likely to impact the way you experience a game. My guess is that Oculus is already ahead of us and will put this value in the SDK, perhaps based on how the player customizes the head-set.
- blazespinnaker
- Certif-Eyed!
- Posts: 541
- Joined: Sat Sep 01, 2012 11:53 pm
Re: Telepresence / Rotating Stereoscopic Camera
My 3d printer whips around pretty fast. You might be able to hook something up with some wifi cameras, gears, arduino, stepper motors and belts.
Haven't thought too much into this yet, TBH, but I'll probably start tinkering around with a BOM while I wait for the rift.
I agree though, it probably won't be the kind of latency you can get via rendering.
At least the scenery would be photo realistic And of course, it reminds me of that passage near the end of Neuromancer:
Haven't thought too much into this yet, TBH, but I'll probably start tinkering around with a BOM while I wait for the rift.
I agree though, it probably won't be the kind of latency you can get via rendering.
At least the scenery would be photo realistic And of course, it reminds me of that passage near the end of Neuromancer:
Another reason I want one, is that they could certainly bring a new dynamic to these:"The head," Case said, "there's a panel in the back of the
head. Zircons on it. Get it off. That's where I'm jacking in."
And then they were inside.
"Christ on a crutch," the Flatline drawled, "you do believe
in takin' your own good time, don't you, boy?"
"Kuang's ready?"
"Hot to trot."
"Okay." He flipped.
And found himself staring down, through Molly's one good
eye, at a white-faced, wasted figure, afloat in a loose fetal
crouch, a cyberspace deck between its thighs, a band of silver
trodes above closed, shadowed eyes. The man's cheeks were
hollowed with a day's growth of dark beard, his face slick withsweat.
He was looking at himself.
Molly had her fletcher in her hand. Her leg throbbed with
each beat of her pulse, but she could still maneuver in zero-g.
Maelcum drifted nearby, 3Jane's thin arm gripped in a large
brown hand.
A ribbon of fiberoptics looped gracefully from the OnoSendai to a square opening in the back of the pearl-crusted
terminal .
He tapped the switch again.
Gear VR: Maybe OVR isn't so evil after all!
- brantlew
- Petrif-Eyed
- Posts: 2221
- Joined: Sat Sep 17, 2011 9:23 pm
- Location: Menlo Park, CA
Re: Telepresence / Rotating Stereoscopic Camera
Don't forget this one. $1000 and the only one with an independent neck. (although motor latency would certainly be a problem)
http://teledev.blogspot.com/2011/07/diy ... art-1.html
http://teledev.blogspot.com/2011/07/diy ... art-1.html
- BOLL
- Binocular Vision CONFIRMED!
- Posts: 295
- Joined: Mon Aug 06, 2012 9:26 pm
- Location: Sweden
- Contact:
Re: Telepresence / Rotating Stereoscopic Camera
Haha, if you have access to two mountain tops, sure no head-tracking possible then though. This reminds me of some photohraphs I took in 2011... I've put a few in the gallery. Keep in mind it was entirely experimental, hard to keep track of convergence in a moving aircraft.Diorama wrote:Like this?: http://i.imgur.com/AmqGNj6.png
-
- One Eyed Hopeful
- Posts: 23
- Joined: Fri Jul 13, 2012 5:02 pm
Re: Telepresence / Rotating Stereoscopic Camera
I'm not sure latency is a show stopper here, at least if you're not going for absolute realism.
Imagine you are in a fairly blank virtual room, perhaps just blackness with a grid of lines. As you move your head, your view moves as you'd expect. The image from the camera is displayed in a virtual window in front of you. If you turn your head, the window goes out of your view, but will move back into your view as soon as it can.
Imagine you are in a fairly blank virtual room, perhaps just blackness with a grid of lines. As you move your head, your view moves as you'd expect. The image from the camera is displayed in a virtual window in front of you. If you turn your head, the window goes out of your view, but will move back into your view as soon as it can.
- Diorama
- Binocular Vision CONFIRMED!
- Posts: 273
- Joined: Mon Jan 28, 2013 10:37 am
- Location: Brighton, UK (Sometimes London)
Re: Telepresence / Rotating Stereoscopic Camera
That is a fantastic idea angrybob. So as long as I am rendering a 3d room/sphere with the camera input like an imax screen, there is no issue with latency between me and the camera as long as there is no latency between me and the 3d 'room' I am in.
Yes I can see it now
Yes I can see it now
-
- Cross Eyed!
- Posts: 129
- Joined: Tue Sep 25, 2012 7:53 am
Re: Telepresence / Rotating Stereoscopic Camera
Thats basically how I imagined FPV to be. You might want to consider the idea of having the image wider than the rift FOV with a dead zone though, because when I was doing a thought experiment I could envision a lot of odd movement as the user moves their head BEFORE the camera finishes making the last movement.
- blazespinnaker
- Certif-Eyed!
- Posts: 541
- Joined: Sat Sep 01, 2012 11:53 pm
Re: Telepresence / Rotating Stereoscopic Camera
If the camera is one spot, there could be some interesting opportunities for predictive caching.
For example, let's say the telepresence robot was at a sports game, live concert, or just security camera. A lot of the environment could potentially be cached and perhaps the wifi cameras could be programmed to just send the delta between the cache and any new information. Also, on the other side, there could be low latency software linked to the SDK which sends the cached data and then blends in the new information as it gets it.
For example, let's say the telepresence robot was at a sports game, live concert, or just security camera. A lot of the environment could potentially be cached and perhaps the wifi cameras could be programmed to just send the delta between the cache and any new information. Also, on the other side, there could be low latency software linked to the SDK which sends the cached data and then blends in the new information as it gets it.
Gear VR: Maybe OVR isn't so evil after all!
- KBK
- Terrif-eying the Ladies!
- Posts: 910
- Joined: Tue Jan 29, 2013 2:05 am
Re: Telepresence / Rotating Stereoscopic Camera
I listed the 3d camera (human IPD) and the 2 axis geared mount in the plane FPV thread. It's here somewhere on this forum...
I guess I did not list the mount, but there are at least two, possibly three of them. One is small, light and wood, the other is aluminum, looks like it is for copters and other stationary fliers. The wooden one is available as a kit..and I believe the third one is also from the same company.
I guess I did not list the mount, but there are at least two, possibly three of them. One is small, light and wood, the other is aluminum, looks like it is for copters and other stationary fliers. The wooden one is available as a kit..and I believe the third one is also from the same company.
Intelligence... is not inherent - it is a point in understanding. Q: When does a fire become self sustaining?