Binaural Sound in Chuck
After spending considerable cycles last quarter developing a multi-channel class framework in the Chuck programming language, I began to wonder, in the end, how many people would actually be able to hear 16-channel pieces in a space like the ccrma listening room. I then decided it would be interesting to think about 3D audio spatialization over Chuck and a pair of headphones. So, in addition to convincing some friends to port Chuck to the iPhone (stay tuned), I spent some time reading papers on binaural sound models, including the paper published by Phillip Brown and Richard O. Duda in '98 titled "A Structural Model for Binaural Sound Synthesis".
I've come up with two implementations of binaural sound in Chuck now. The first is my own model built on approximations from my research. The second is a work in progress based on the Brown and Duda paper. As you scan the source, you'll notice how trivial it is to create binaural sound by creating a Chuck class that inherits from the BinAural class I've created. The demonstration code goes on to create sound buffers that load up wave files and buzz a bumble bee by your ears while a thunderclap cracks 130 meters above your head. Eventually it starts to rain. All referenced sound files for the demo are also available.
I will come back to this code shortly and finish implementing models for the pinna. Currently, I have ITD, ILD, and HRTF functions.
Version 1.0
Version 1.1
Data files (must be in a data subdirectory underneath Chuck)
BumbleBee
Thunderclap
Rain
I've come up with two implementations of binaural sound in Chuck now. The first is my own model built on approximations from my research. The second is a work in progress based on the Brown and Duda paper. As you scan the source, you'll notice how trivial it is to create binaural sound by creating a Chuck class that inherits from the BinAural class I've created. The demonstration code goes on to create sound buffers that load up wave files and buzz a bumble bee by your ears while a thunderclap cracks 130 meters above your head. Eventually it starts to rain. All referenced sound files for the demo are also available.
I will come back to this code shortly and finish implementing models for the pinna. Currently, I have ITD, ILD, and HRTF functions.
Version 1.0
Version 1.1
Data files (must be in a data subdirectory underneath Chuck)
BumbleBee
Thunderclap
Rain
posted by jcs at 4:12 PM
11 Comments:
Very nice work, Jeffrey!! Keep going with this please. It's very interesting.
BTW, you forgot to post the animal_4f.wav file...
Thanks for your efforts :)
Jeff! Wow. I don't know if you remember me I joined Tumbleweed when we were small, and left for medical school. Now I am doing primary care/injury at Kaiser, living in SF. Sounds like you are going back to find your roots. Good work.
Hi! Can I have your email adress? I need some information of your implementation of the "Brown and Duda" article.
Thanks!
Yesterday I went to the Daniel Pearl Memorial Concert, and loved your music. I would really love to hear it again, so I was wondering if there's any place where I can find out when you will be playing again. I am sorry for posting this here, but I couldn't find your email address.
Thank you very much and congratulations!
Fascinating. Keep it up.
Information discussed on this article is very enlightening and helpful for my project. Thanks for sharing!
Google Adwords
It is wonderful of you to share a piece of yourself to us.
designer swimwear
Shaving creams should not just have a soothing and relaxing effect on one's skin but shaving creams should also nourish the skin like a water to a plant.
There are a lot of fun things to do on Cape Cod. It is an exciting place where you can find amazing beaches, great lodging, good food and wonderful people!
Rhinoplasty is not just a surgical procedure but also an art. The surgeon who will perform the said surgery should be an expert so that the result can give the patient a more pleasing appearance.
Nose Surgery Australia
Post a Comment
<< Home