Arbitrary Surface Projection Mapping - DIY CAVE

This is for discussion and development of non-commercial open source VR/AR projects (e.g. Kickstarter applicable, etc). Contact MTBS admins at if you are unsure if your efforts qualify.
Post Reply
Posts: 661
Joined: Sun Mar 25, 2012 12:33 pm

Arbitrary Surface Projection Mapping - DIY CAVE

Post by zalo »


I thought this would be a good place to share a proof of concept of mine: Arbitrary-Surface Projection Mapping

Inspired by Paul Bourke's article, this project aims to enable the construction of DIY CAVEs using off-the-shelf hardware and game engines. It works by pre-baking the
mapping from projector pixel to world coordinate into the vertex color of a tesellated plane mesh. This world position is then reprojected through the user's viewpoint
camera in a shader, thus warping the projected image to compensate for the perspective/projective distortion of the user's view position.

This technique costs very little (computationally), allows for the use of an on-axis projection matrix, can compensate for curved reflecting surfaces, can trivially be
extended to stereo, and enables the construction/calibration of complex projecting systems using existing VR hardware (Vive and a standard gaming rig).

Here are a couple of pictures (showing what a flat grid pattern looks like before correction, and what it looks like after correction):
Image Image

And here's a short video of poor quality:

User avatar
3D Angel Eyes (Moderator)
Posts: 11394
Joined: Sat Apr 12, 2008 8:18 pm
Which stereoscopic 3D solution do you primarily use?: S-3D desktop monitor

Re: Arbitrary Surface Projection Mapping - DIY CAVE

Post by cybereality »

That's awesome. Even with the potato video quality.

Cross Eyed!
Posts: 117
Joined: Sun Aug 05, 2012 4:19 pm

Re: Arbitrary Surface Projection Mapping - DIY CAVE

Post by Kajos »

This is really awesome.
Could you tell a bit more about it?
Such as, what did you use to build the mirror?
Do you use a camera for correction, or convert coordinates manually?

I always assumed this would be a good way to make short throw projectors.

User avatar
Posts: 2220
Joined: Sat Sep 17, 2011 9:23 pm
Location: Menlo Park, CA

Re: Arbitrary Surface Projection Mapping - DIY CAVE

Post by brantlew »

Cool. Nice project.

Cross Eyed!
Posts: 160
Joined: Mon Mar 02, 2015 3:58 pm

Re: Arbitrary Surface Projection Mapping - DIY CAVE

Post by Jabberwock »

Have you considered using a 3D scanner, such as Kinect, for geometry mapping?

Post Reply

Return to “VR/AR Research & Development”