It is currently Fri Dec 13, 2019 4:12 pm



Reply to topic  [ 6 posts ] 
 Nimble Sense time-of-flight 3D camera brings hands into VR 
Author Message
One Eyed Hopeful

Joined: Sat Oct 25, 2014 6:25 pm
Posts: 2
Reply with quote
Hi all,

We're building a time of flight depth sensing camera specifically for virtual reality hand-tracking and input. We just launched the project on Kickstarter:

https://www.kickstarter.com/projects/ni ... al-reality

The camera will capture a 3D point cloud across a 110 degree field of view and at a range of 10-70 cm. We're combining this with the world's most robust skeletal hand tracking software to bring hands into VR for input.

Here's a video of how you might use this input in games like Spectre, Technolust and Ethereon.

https://www.youtube.com/watch?v=M6EPo65Yvwg

Looking for feedback and your support!

Thanks!
Rob


Tue Oct 28, 2014 12:43 pm
Profile
Binocular Vision CONFIRMED!

Joined: Tue Jun 26, 2012 2:50 am
Posts: 284
Reply with quote
If you designed the camera from the ground up why did you make it only 45Hz, isn't that a little low?


Thu Oct 30, 2014 5:29 am
Profile
Golden Eyed Wiseman! (or woman!)

Joined: Fri Jun 08, 2012 8:18 pm
Posts: 1329
Reply with quote
Endothermic wrote:
If you designed the camera from the ground up why did you make it only 45Hz, isn't that a little low?


"from the ground up" using a ToF sensor from pmd technologies, so the refresh might possibly be limited due to that.


Thu Oct 30, 2014 8:57 am
Profile
Golden Eyed Wiseman! (or woman!)

Joined: Fri Jun 08, 2012 8:18 pm
Posts: 1329
Reply with quote
Hmm... according to pmd's site, the sensor is 19,200 pixels, and the readout clock is up to 15 megalpixels, so if it can actually sense at that rate, that should provide ~780fps...


Thu Oct 30, 2014 9:04 am
Profile
One Eyed Hopeful

Joined: Sat Oct 25, 2014 6:25 pm
Posts: 2
Reply with quote
We're designing a new camera module for VR, but you're right that we're using an existing ToF chip from Infineon / pmdtechnologies. 45 Hz is all we can promise right now given the progress on our current hardware revision, but you're right that a higher frame-rate could be achieved in theory, even over USB2. There are a lot of factors influencing the frame-rate, including the brightness of the laser, the exposure time of the camera, the heat of the laser, etc. Hopefully, we'll have better numbers to report when we get our next hardware revision, but we don't want to over-promise!


Thu Oct 30, 2014 11:22 am
Profile
Golden Eyed Wiseman! (or woman!)

Joined: Fri Jun 08, 2012 8:18 pm
Posts: 1329
Reply with quote
It does seem pretty cool, and the DK2 clip is pretty darn clever. Good luck on the kickstarter :)


Thu Oct 30, 2014 4:02 pm
Profile
Display posts from previous:  Sort by  
Reply to topic   [ 6 posts ] 

Who is online

Users browsing this forum: No registered users and 9 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Jump to:  
Powered by phpBB® Forum Software © phpBB Group
Designed by STSoftware.