Hi all,
We're building a time of flight depth sensing camera specifically for virtual reality hand-tracking and input. We just launched the project on Kickstarter:
https://www.kickstarter.com/projects/ni ... al-reality
The camera will capture a 3D point cloud across a 110 degree field of view and at a range of 10-70 cm. We're combining this with the world's most robust skeletal hand tracking software to bring hands into VR for input.
Here's a video of how you might use this input in games like Spectre, Technolust and Ethereon.
https://www.youtube.com/watch?v=M6EPo65Yvwg
Looking for feedback and your support!
Thanks!
Rob
Nimble Sense time-of-flight 3D camera brings hands into VR
-
- One Eyed Hopeful
- Posts: 2
- Joined: Sat Oct 25, 2014 6:25 pm
-
- Binocular Vision CONFIRMED!
- Posts: 284
- Joined: Tue Jun 26, 2012 2:50 am
Re: Nimble Sense time-of-flight 3D camera brings hands into
If you designed the camera from the ground up why did you make it only 45Hz, isn't that a little low?
-
- Golden Eyed Wiseman! (or woman!)
- Posts: 1329
- Joined: Fri Jun 08, 2012 8:18 pm
Re: Nimble Sense time-of-flight 3D camera brings hands into
"from the ground up" using a ToF sensor from pmd technologies, so the refresh might possibly be limited due to that.Endothermic wrote:If you designed the camera from the ground up why did you make it only 45Hz, isn't that a little low?
-
- Golden Eyed Wiseman! (or woman!)
- Posts: 1329
- Joined: Fri Jun 08, 2012 8:18 pm
Re: Nimble Sense time-of-flight 3D camera brings hands into
Hmm... according to pmd's site, the sensor is 19,200 pixels, and the readout clock is up to 15 megalpixels, so if it can actually sense at that rate, that should provide ~780fps...
-
- One Eyed Hopeful
- Posts: 2
- Joined: Sat Oct 25, 2014 6:25 pm
Re: Nimble Sense time-of-flight 3D camera brings hands into
We're designing a new camera module for VR, but you're right that we're using an existing ToF chip from Infineon / pmdtechnologies. 45 Hz is all we can promise right now given the progress on our current hardware revision, but you're right that a higher frame-rate could be achieved in theory, even over USB2. There are a lot of factors influencing the frame-rate, including the brightness of the laser, the exposure time of the camera, the heat of the laser, etc. Hopefully, we'll have better numbers to report when we get our next hardware revision, but we don't want to over-promise!
-
- Golden Eyed Wiseman! (or woman!)
- Posts: 1329
- Joined: Fri Jun 08, 2012 8:18 pm
Re: Nimble Sense time-of-flight 3D camera brings hands into
It does seem pretty cool, and the DK2 clip is pretty darn clever. Good luck on the kickstarter ![Smile :)](./images/smilies/icon_e_smile.gif)
![Smile :)](./images/smilies/icon_e_smile.gif)