Close

Developing the Proposal

A project log for Babel in Reverse

178 ESP32s under the Manhattan Bridge talking and singing in endangered languages to passers-by

owen-truebloodOwen Trueblood 06/28/2023 at 13:560 Comments

Joe and I were applying to the Downtown Brooklyn Public Art + Placemaking Fund and needed to put together a proposal that explained:

Ideas

The starting point was a list of locations that The Downtown Brooklyn + Dumbo Art Fund had provided for where the funded artworks could be installed. The anchorage space under the Manhattan Bridge had jumped out immediately to us as an especially interesting place for a work.

In the past the archway was closed off to public access and used to store materials for repair work on the bridge, but was restored and opened to the public in 2008. Nowadays it’s used for occasional events but is mostly a quick way for people to get under the bridge, a landmark to meet people at, or a place to sit for a bit. It’s a relatively dark space with a lot of noise from passing trains and construction nearby.

We thought it might suit a sound installation. The varying noise in the space would let our audio “hide” and then reemerge in the moments when the space quiets down. Mostly that’s at night after the trains start spacing out and the construction work has stopped for the day. We wanted to introduce a light component as well because that would let us direct the attention of passers-by to where the audio is playing. And the light could make the space generally more welcoming and highlight the installation.

Joe suggested the idea of reaching out to the Endangered Language Alliance (ELA) to see if we could use their interview audio for the installation. The ELA is a non-profit that was founded in 2010 to document Indigenous, minority, and endangered languages. Over the years they have conducted hundreds of interviews and collected various forms of data, which they share via maps and other projects. Thinking about how we could share that content in the form of an installation led us to the idea for our project.

We would highlight varied backgrounds and lives of New Yorkers by playing audio of them speaking and singing in the many languages spoken around the city. Ideally the installation would provide a chance for city dwellers passing by to be reminded that they live immersed in a vast wealth of human stories and culture. Unfortunately, that purpose grew more urgent over time as the pandemic progressed while we built the project.

Initial Proposal

With a workable concept for the art in our heads our next thoughts were about implementation. How would we approach building an installation that could play back hundreds of voices and produce lighting effects across the fairly large space under the anchorage (~140’x45’)? How could we do that affordably? We would need hardware distributed across the space and a structure to support it. Some careful thinking would be needed to do this within a reasonable budget and in a way we could actually execute.

Structure

Initially we wanted to minimize the structural engineering work that would need to be done, because that was both something that we thought could incur a lot of cost and a kind of engineering work that neither of us had much experience with. We went looking for off-the-shelf structures that would meet the needs and be affordable. The “safe” option was a truss structure like the type that is used to support lights and other equipment on stage for music shows. Our first rough 3D models of what the installation could look like used those.

(By Joe in Rhinoceros)

We didn’t entirely like the look of the frame structure so we kept thinking. It occurred to us that a common structure you see all over NYC could be repurposed to provide the structural support for our art installation. That structure is the common scaffold walkway put in place to protect pedestrians from falling debris when work is being done on the facade of a building. Because of legal and logistical factors these are omnipresent around the city. Our first proposal used a segment of this scaffolding as the host structure for the electronics.

(By me in Blender)

On one hand this was a simple way to get a structure that we could be confident would work, and it would leverage a feature of the city that any resident would recognize to share aspects of their fellow city-dwellers that they might not know. But on the other hand it would mean funneling people through a small, enclosed path that would not make good use of all the space available under the arch. And it might run the risk of people not understanding that it was in fact an art installation rather than just another building project in progress. Despite the issues, initially we pushed forward with this approach because it saved money that we could use to improve the audio experience.

Audio Units

Aside from the structure we needed to figure out how we would deliver the audio. We were mostly starting with the idea that we would hang our sound and light devices on cables like what Joe had done with Spaces within Spaces. We wanted to play back hundreds of different snippets of audio and not have them all blend together. So I started thinking about a reflector that would guide the audio and provide a surface to diffuse and spread the light from each device.

I started researching parabolic reflectors and trying to figure out whether we could use them to direct the sound in specific directions. At the time I was playing with using a visual effects tool called Houdini to do parametric geometry creation for various projects, so I used it to create a parametric model for parabolic reflector geometry. Then I played with the parameters to get a sense of the physical configurations that might be possible.

To be able to have each unit be unique and still be feasible to manufacture I was considering vacuum-forming a thermoplastic on a reconfigurable form, potentially with robotic automation to churn through the hundreds of reflectors we would need. Above you can see the tweaked version of the design tool that I used to think about that possibility.

To make the parabolic reflector work well the speaker needed to face inward and be at a specific distance offset relative to the center. My initial thought for accomplishing this cheaply was to have two PCBs separated by stiff wire. One PCB would be on the back of the reflector and have a connector for data and power. The elevated PCB would have everything else, including the main processor, speaker, and LEDs. It would receive power and data over the stiff wire.

Continuing with the parametric design exercise in Houdini I built up a full model with units hanging off of suspended wires. It was fun to learn about the math for catenary (slack, suspended) wires. And how to instance geometry with variations in Houdini.

One detail I tried playing with was the diffusive properties of the plastic used for the reflectors. I set up a test scene in Blender to try to see if I could get a sense of the different possibilities virtually. After trying a bunch of renders I couldn’t quite get the effects I wanted with my limited CG experience, but the attempt provided some food for thought.

Sensing Visitors

Instead of running all of the audio run at once or having the units run on preset loops we thought it would be more interesting for them to respond to the visitors. But how could we allow for interaction without increasing the cost too much per unit? My first thought was to use some kind of distance sensor that would point downward and detect when someone passed below. For example, the VL53L3CX, which is a really cool miniature time-of-flight sensor that I had been looking for an excuse to use. But a more traditional ultrasonic distance sensor would also likely suffice.

Power

I expected that we would run cabling to hang the units in the installation and this would also be used to carry power and control signals to them. For the bus voltage I chose 48V because it’s commonly used, so power supplies would be cheap and easy to get, it’s not such a high voltage that I’d need to worry too much about direct shock hazards, but it would still be high enough to keep resistive losses in the wiring below an acceptable level. I wasn’t sure how much power each unit would use, but I figured that they might average at least a few watts. With 1000 units that meant we would be drawing at least a few kilowatts.

Control

For control I wanted something simple but reliable and optionally high bandwidth. I knew I could get those properties from RS-485, which is a serial communications standard implemented with differential signaling (meaning common mode noise can be rejected). I didn’t know what the specific serial communication protocol would be exactly, but I knew the general properties it would need to have. Mostly the data would be flowing one way, from a central controller out to the units in the array. The system would require duplex communication for certain operations, like updating the firmware on the units. I wanted to keep as much flexibility as possible to support implementing experiences later that we hadn’t thought of at the start of the project. For the proposal I left the options open.

Budgeting

To estimate the project costs I worked out a detailed sketch of the implementation. I expected the exact details would change as we solved problems along the way, but the basic cost structure was dependent on constraints I thought would be durable. We wanted to make 1000 units, so the main driver of the overall cost would be the price per unit. The other main costs would be the material for the structure, structural engineering services, renting equipment for the installation, and the power supplies, wiring, connectors, and etc. To reach the final estimate I did research to cost options for each of the system components and any labor or services associated with them (e.g. PCB assembly).

Feedback and Final Proposal

Joe and I collected our thoughts, submitted the proposal, and then waited for a response. Eventually we heard back with some follow up questions about details of our proposal, which we took as a good sign. Relatively soon after that we were told that we made it to the interview round of the selection process.

In the interview there was a lot of useful feedback. The most important was about the structure. We had considered that the scaffolding might cause confusion in the visitors, but weren’t sure how significant that issue might be. But in the interview the main critique was that the scaffolding would give the wrong impression of the piece. It wouldn’t look very good, would restrict movement through the space, and might not look finished to visitors. Hearing that made Joe and I decide it was worth whatever the extra complexity would be to make a custom structure. We adjusted our proposal and shared it with the Downtown Brooklyn Public Art + Placemaking Fund, and they accepted it.

We were green-lit to start working on the project. I immediately started working on a more detailed hardware design, which we will look at in the next post.

Discussions