Clubhouse announced Sunday that its rooms will now be infused with spatial audio to give the app’s listeners a richer sense of hanging out live with a group of other people.
While Clubhouse and other voice chat apps bring people together in virtual social settings, the audio generally sounds relatively flat, like it’s emanating from a single central location. But at the in-person gatherings Clubhouse is meant to simulate, you’d be hearing audio from all around the room, from the left and right of a stage to the various locations in the audience where speakers might ask their questions.
To pull off the new audio tricks, Clubhouse is integrating an API from Second Life creator Philip Rosedale’s spatial audio company High Fidelity and blending it with the company’s own custom audio processing, tuned for the chat app.
High Fidelity’s HRTF technology, which stands for “Head Related Transfer Function,” maps speech to different virtual locations by subtly adding a time delay between stereo channels and replicating the way that high and low frequencies would sound entering the ear depending on a sound’s origin.
The result, long used in social VR, gives virtual social experiences a sense of physical presence. Clubhouse’s implementation will be subtle, but noticeable. While the audio processing will “gently steer conversation” to put most speakers in front of the listener, Clubhouse users should have a new sense that people are speaking from different physical locations.
The new audio features rolled out Sunday to the majority of iOS users, reaching the rest of Clubhouse’s iOS and Android users within the next few weeks. The experience will be available to everyone in time, but users will also have the ability to toggle spatial audio off.
Clubhouse will use the same virtual soundstage techniques to give large rooms a sense of sounding large while making more intimate rooms sound like they’re actually happening in a smaller physical space. And because most people use headphones to participate on Clubhouse, most of the app’s users can benefit from the effects possible through two-channel stereo sound.