The Sony Spatial Reality Display shows 3D without glasses. It tracks the viewer's eyes and renders the scene for their exact position, so objects appear to float in front of the screen. Neural Lab's AirTouch adds gesture control from a standard webcam.
The team will build a living terrarium of Testudo inspired terrapins and other creatures. They react to being looked at, scatter or gather when you tap the glass, and can be picked up or fed with a gesture. Visitors scan a code and their phone becomes a feeder, so a group can play at once.
It is built to draw a crowd at Demo Day and Maryland Day and to be a strong portfolio piece: Unity and C#, Sony's Unity plugin, AirTouch, Blender for the creatures, and a small web remote on the club's existing backend. The display, an RTX PC and the webcam are in the XR Lab. This is a new team; the board runs it until a lead emerges.
Roles: Unity developers (2 to 3), 3D artist and animator, Interaction designer (gestures and eye contact), Web developer (phone feeder), Sound and lighting
- Contact
- XR Club board (umd.xr.club@gmail.com)
- Stack
- Unity, C#, Spatial Reality Display SDK, AirTouch, Blender
- Hardware
- Sony Spatial Reality Display, RTX PC, webcam (in the lab)
- Experience
- Unity or 3D art for the core work; any level for sound, web and design