Files | SNAP: Augmented Echolocation

This program, written in C++, uses the open-source libraries OpenCV and OpenAL to get the depth data from the simulator (or hardware depth camera) and convert it to audio. See back end log for details.

plain - 10.12 kB - 09/03/2017 at 01:27

Download

DepthToColorShader.shader

This shader is a script that runs on the graphics card, and reads the depth buffer from the graphics card and turns it into color pixel output. See simulation log for details.

shader - 994.00 bytes - 09/03/2017 at 00:24

Download

DepthCopyScriptNew.cs

Our C# script that runs in Unity, calls our shader to turn depth buffer to color, then reads the color pixels into RAM, and calls the DLL plugin to get that data to the audio generation software. See simulation log for details.

plain - 4.58 kB - 09/03/2017 at 00:23

Download

RenderingPlugin.cpp

This is the main source code from our Unity DLL plugin that copies the depth data from our Unity C# script and provides it via a shared memory interface to our audio generation software. Copied and modified from the Unity graphics plugin example. See simulation log for details.

plain - 11.76 kB - 09/03/2017 at 00:21

Download

SNAP Headset.STEP Concept Headset for the SNAP R200 Prototype. step - 1.51 MB - 10/21/2017 at 08:41		Download
Sightless Navigation Assistance.pdf Overview of project description for 2017 Senior Design team. Adobe Portable Document Format - 214.21 kB - 10/21/2017 at 05:40	Preview	Download

SNAP Controller.STEP CAD model for UP board controller housing. step - 7.79 MB - 10/21/2017 at 05:23		Download
Condensed Snapshot Information.pdf 2017 Senior Design - snapshot of project goals and status. Adobe Portable Document Format - 225.97 kB - 10/21/2017 at 04:28	Preview	Download

RealSense_Hardware_BackEnd_update.cpp This is the hardware prototype back end software, but with center-to-sides audio panning and a little bit of cleaning up. plain - 10.36 kB - 10/20/2017 at 23:43		Download
RealSense_Hardware_BackEnd.cpp This is our Back End depth-to-audio generation software adapted for use with our hardware setup, the RealSense Robotic Development Kit. plain - 8.02 kB - 09/03/2017 at 18:46		Download
SONARBackEnd.cpp This program, written in C++, uses the open-source libraries OpenCV and OpenAL to get the depth data from the simulator (or hardware depth camera) and convert it to audio. See back end log for details. plain - 10.12 kB - 09/03/2017 at 01:27		Download
DepthToColorShader.shader This shader is a script that runs on the graphics card, and reads the depth buffer from the graphics card and turns it into color pixel output. See simulation log for details. shader - 994.00 bytes - 09/03/2017 at 00:24		Download
DepthCopyScriptNew.cs Our C# script that runs in Unity, calls our shader to turn depth buffer to color, then reads the color pixels into RAM, and calls the DLL plugin to get that data to the audio generation software. See simulation log for details. plain - 4.58 kB - 09/03/2017 at 00:23		Download
RenderingPlugin.cpp This is the main source code from our Unity DLL plugin that copies the depth data from our Unity C# script and provides it via a shared memory interface to our audio generation software. Copied and modified from the Unity graphics plugin example. See simulation log for details. plain - 11.76 kB - 09/03/2017 at 00:21		Download