Page 1 of 1

Nimble Sense time-of-flight 3D camera brings hands into VR

Posted: Tue Oct 28, 2014 12:43 pm
by rywang
Hi all,

We're building a time of flight depth sensing camera specifically for virtual reality hand-tracking and input. We just launched the project on Kickstarter:

https://www.kickstarter.com/projects/ni ... al-reality

The camera will capture a 3D point cloud across a 110 degree field of view and at a range of 10-70 cm. We're combining this with the world's most robust skeletal hand tracking software to bring hands into VR for input.

Here's a video of how you might use this input in games like Spectre, Technolust and Ethereon.

https://www.youtube.com/watch?v=M6EPo65Yvwg

Looking for feedback and your support!

Thanks!
Rob

Re: Nimble Sense time-of-flight 3D camera brings hands into

Posted: Thu Oct 30, 2014 5:29 am
by Endothermic
If you designed the camera from the ground up why did you make it only 45Hz, isn't that a little low?

Re: Nimble Sense time-of-flight 3D camera brings hands into

Posted: Thu Oct 30, 2014 8:57 am
by MSat
Endothermic wrote:If you designed the camera from the ground up why did you make it only 45Hz, isn't that a little low?
"from the ground up" using a ToF sensor from pmd technologies, so the refresh might possibly be limited due to that.

Re: Nimble Sense time-of-flight 3D camera brings hands into

Posted: Thu Oct 30, 2014 9:04 am
by MSat
Hmm... according to pmd's site, the sensor is 19,200 pixels, and the readout clock is up to 15 megalpixels, so if it can actually sense at that rate, that should provide ~780fps...

Re: Nimble Sense time-of-flight 3D camera brings hands into

Posted: Thu Oct 30, 2014 11:22 am
by rywang
We're designing a new camera module for VR, but you're right that we're using an existing ToF chip from Infineon / pmdtechnologies. 45 Hz is all we can promise right now given the progress on our current hardware revision, but you're right that a higher frame-rate could be achieved in theory, even over USB2. There are a lot of factors influencing the frame-rate, including the brightness of the laser, the exposure time of the camera, the heat of the laser, etc. Hopefully, we'll have better numbers to report when we get our next hardware revision, but we don't want to over-promise!

Re: Nimble Sense time-of-flight 3D camera brings hands into

Posted: Thu Oct 30, 2014 4:02 pm
by MSat
It does seem pretty cool, and the DK2 clip is pretty darn clever. Good luck on the kickstarter :)