Combing hand tracking Headtracking voice recog in hmd use

Talk about Head Mounted Displays (HMDs), augmented reality, wearable computing, controller hardware, haptic feedback, motion tracking, and related topics here!
Post Reply
Thegameveda
One Eyed Hopeful
Posts: 27
Joined: Fri Mar 22, 2013 10:15 am

Combing hand tracking Headtracking voice recog in hmd use

Post by Thegameveda »

Image

VR is not about the speed of your headtracker alone , VR is going to require a combination of headtracking , voice recog , hand recog and body tracking as well as a little legacy control .
Read online discussions from VR cogniscenti and they all talk of latency ruining the experience.

I have been using hmds the hmzt series, smd ST1080 and Cinemizer OLED with the Zeiss headtracker for an age now . Initially I used the Zeiss headtracker to play and test out PC games on the hmd like so http://the-games-veda.blogspot.co.uk/20 ... acker.html, http://the-games-veda.blogspot.co.uk/20 ... er_12.html

but then I worked out how to introduce headtracking into PS3 and Xbox 360 games ..all PS3 and Xbox 360 games like so http://the-games-veda.blogspot.co.uk/20 ... er_12.html and http://the-games-veda.blogspot.co.uk/20 ... acker.html

but that was not enough , I then sought to combine Zeiss headtracking , LEAP Motion hand tracking , Kinect Voice Recognition and legacy control on legacy hardware namely the Xbox 360 and PS3 ...

here http://the-games-veda.blogspot.co.uk/20 ... -leap.html in a treatise entitled Preparing for VR : Combining LEAP Motion+Cinemizer OLED headtracking+Kinect Voice Recog in PS3 and Xbox 360 games

all of which I can do using the Cinemizer OLED hmd in 3D and or the smd ST1080 in 3D...

to be clear I have never experience any significant latency when combining multiple VR and legacy control methods...check out the blog post for my solution ..no maths PHD or slide rule required...

here are some direct links to some of the videos

[youtube]http://www.youtube.com/watch?v=5qBLWI45rqo[/youtube]

[youtube]http://www.youtube.com/watch?v=0Zq-HEBOB6s[/youtube]

[youtube]http://www.youtube.com/watch?v=U8GP1TBIWWw[/youtube]

[youtube]http://www.youtube.com/watch?v=D-0eXJGKFog[/youtube]

[youtube]http://www.youtube.com/watch?v=25UJNWOsNWk[/youtube]

[youtube]http://www.youtube.com/watch?v=JEzk0y7ahOw[/youtube]

[youtube]http://www.youtube.com/watch?v=1umRjkTjw_4[/youtube]

[youtube]http://www.youtube.com/watch?v=7XUUvsy7UXA[/youtube]

[youtube]http://www.youtube.com/watch?v=Q-RPE7wczCo[/youtube]

My next aim is to combine LEAP Motion , the Zeiss headtracker and the AR ready LCOS display of the smd ST1080 I want to not only track my hand in VR on the hmd , but see my hand through the transparent LCOS display and reach into virtual space to grab and manipulate a virtual object with my actual hand ....after i have finished playing through Halo again with headtracking , hand tracking , voice recog in OLED ghost free 3D...

the point is if I can do this with what is considered legacy hardware , then things are looking good for latency free multiple VR control paradigms ...

there is much more on the blog if you are looking to find out how VR and hmds are evolving and yes i will have the Rift soon...If i had a penny for every time someone asked that ..I'd be richer than Carmack...
Post Reply

Return to “General VR/AR Discussion”