Hi everyone,
I’m working on a new tool tracking project using Rift + Leap Motion. The idea is to build a 6DOF pen that works on any surface. For example it lets you “write” on a physical table while you have a VR headset on. I think this gives the best of both worlds since you can transition between working in 2D as you would on a phone/tablet, or in 3D as you would in Tilt Brush, all with one controller (pen). I want to spend my entire workday in VR, and I don’t see it happening with room-scale apps or midair UIs. I want to get rid of my screen and work mostly at a desk. Unity has a cool experiment with the idea of a table-top interface (1) but they're still using motion controllers - I want to take it further.
I’ve built a working prototype of both the hardware and software side using Leap Motion’s Image API and Rift. Since LM uses active IR the first prototype (image below) didn’t need any electronics, I built it using retro-reflective tape for less than $5. Unfortunately to support more features and tracking systems the latest prototype is a lot more complicated, but LM+Rift is an awesome prototyping platform
The latest prototype has perfect tracking (comparable to Vive controller tracking) at 90fps using Leap Motion. Having the power of 3D input PLUS the efficiency/precision of working on a hard surface feels AMAZING!
Personally I think pen+hand input paired with much higher resolution VR headsets (2) will be the first viable all-day VR workstation setup, and potentially a turning point for professional VR adoption.
The project is tentatively called “Drawboard” and I just put up a site with some more info and a video:
https://www.drawboardvr.com/
I have some funding to work on this idea so I'm looking for people that want to work on this with me. If you have hardware, computer vision, or game engine experience, send me a message.
Finally - I need ideas for applications. So far I've just built a VR whiteboard which is an obvious application for a pen, and works extremely well - but what else should I build? Also interested in ideas for other kinds of tools that could be based on the same tracking tech.
1 https://labs.unity.com/article/carte-blanche
2 https://www.varjo.com/
6DOF Pen Project
Discussion of tools and products that add VR physicality. Samples include VR treadmills, special hand controllers, gesture technology and more.
-
- One Eyed Hopeful
- Posts: 1
- Joined: Thu Nov 30, 2017 10:40 am
Jump to
- Important Reading
- ↳ Get full access to MTBS and its community by registering with the links below:
- ↳ MTBS-Gallery
- MTBS' Official Article Threads & Forum Announcements
- ↳ MTBS Forum Announcements & FAQ
- ↳ MTBS News
- ↳ Neil's Messy Basement
- ↳ MTBS Articles
- ↳ MTBS Editorial User Remarks
- ↳ MTBS Game Review User Remarks
- ↳ MTBS Interview User Remarks
- ↳ MTBS-TV
- ↳ MTBS Member Blogs
- ↳ MTBS Newswire
- ↳ Contest Entry
- General Forums
- ↳ General Discussion
- ↳ MTBS Website Ideas
- ↳ User Contributed Immersive Technology News & Announcements
- ↳ Italian
- ↳ German
- ↳ French
- ↳ Russian
- ↳ Spanish
- ↳ Do it Yourself!
- MTBS Supported Projects
- ↳ Official Vireio Perception
- ↳ Vireio Perception 4.X
- ↳ Vireio 4.X Game Support
- ↳ Vireio Perception 3.X and BELOW
- ↳ Development / General Discussion
- ↳ Game Support
- ↳ Config & Shader Profiles
- ↳ VRBoost Profiles
- ↳ FreePIE
- ↳ Minecrift
- General Virtual Reality Discussion
- ↳ General VR/AR Discussion
- ↳ Game Settings
- ↳ General Discussion
- ↳ VR/AR Research & Development
- ↳ Physical VR Tools
- ↳ 360-Degree VR Filmmaking / Discussion
- Immersive Technology Products
- ↳ HTC Vive
- ↳ Oculus VR
- ↳ Sony PSVR
- Stereoscopic 3D Entertainment, Hardware & Software
- ↳ General Stereoscopic 3D Discussion
- ↳ I'm New To Stereoscopic 3D!
- ↳ 3D Displays
- ↳ 3D HDTVs
- ↳ 3D Monitors
- ↳ 3D Glasses
- ↳ 3D Projectors
- ↳ DDD
- ↳ Best Game Settings (DDD)
- ↳ DDD Tridef Ignition Driver Forums
- ↳ NVIDIA
- ↳ S-3D Game Settings (NVIDIA GeForce 3D Vision)
- ↳ NVIDIA GeForce 3D Vision Driver Forums
- ↳ Nvidia 3D Vision Fixes, Solutions and Troubleshooting
- ↳ Old School S-3D Solution Support
- ↳ Nvidia Legacy Drivers
- ↳ iZ3D Legacy Drivers
- ↳ 3D Console Gaming
- ↳ 3D Movies (Blu-Ray and Theater)
- ↳ GameGrade3D Discussion
- ↳ Stereoscopic 3D Hardware Technical Support
- ↳ Favorite Online S-3D Videos
- Technical Support
- ↳ General Hardware & Software Technical Support
- ↳ General AMD/ATI Discussion
- ↳ General NVIDIA discussion