Let's Talk "Immersion" PT 1

We're hearing a LOT these days about Immersive Audio, and by that, most are talking about the buzzy new "Cutting Edge" 3D Audio, Apple Spatial Audio, Dolby Atmos, etc.

The goal of spatial audio is to create “immersion” by placing our story world 360 degrees around our listener.

While this is exciting (present hype notwithstanding), not much here is actually NEW, let alone "cutting edge,"

ALL of today’s approaches and technologies for spatial audio will deliver to the headphone listener the same result that has existed for decades - Binaural Audio.

From Wikipedia:

The history of binaural recording goes back to 1881 with the first binaural unit, the Théâtrophone.

Skipping ahead a bit

In 1978, Lou Reed released the first commercially produced binaural pop record, Street Hassle, a combination of live and studio recordings.[24]

Many Binaural Audio Dramas have been and still are being produced and broadcast by the BBC. For example, Stephan King's "The Mist" was available in "terrifying 3D Audio" on CD in the early 1990s. Here’s a picture of my copy.

unnamed.jpg

So why all the buzz and interest now? The explosion of Podcasts?

No.

The development explosion in Virtual Reality (VR) and Augmented Reality (AR) was the main driver in my view.

VR/AR product developers quickly realized that while they could fool the eyes with VR headsets, the immersive effect was lacking without corresponding spatial audio. And for that, they turned to the tech that already existed - binaural playback over headphones.

While binaural techniques were well known for many years, there weren't many new tools to do the work. So recently there has been a Renaissance of spatial audio tools being created giving us lots of often very affordable ways to process and deliver Binaural audio to headphones. Naturally, this tech made its way to Podcasts where everything old and busted is NEW AGAIN!

Side note: I've been using binaural audio in EVERY series I've designed starting with Inside The Exorcist in 2017.

More on that and the most obvious set of questions when it comes to using spatial audio - WHY?

Does simply using this tech make our stories more "immersive"?

Is there more to be considered?

I'll cover that in my next article on “Immersion”.

Stay tuned!

THE SOUND OF AFTERSHOCK: Pt 2 - Over The Shoulder Audio

In the previous article, I shared how I borrowed some camera techniques of cinematography to craft the sound of the Aftershock audio drama; in that case, I discussed the concept of ZOOM. Those instances came from being inspired by the performances of those scenes and the way they were written.

Catch up on it here if you haven't read it yet.

This time I'll talk about how I borrowed the "Over The Shoulder" shot for Aftershock starting in Episode 3. Listen to the full episode 3 here:

The “Over The Shoulder” (OTS) shot is very familiar, typically used in exchanges between characters where there is a camera behind the shoulder of each character looking at the other. The director CUTS between character perspectives to enhance the story-telling.  Most of the time OTS shots are ith other shots - but for my purpose, I simply wanted to see if the OTS camera technique could be employed in an Audio Drama.

Holy Over the Shoulder Shot, Batman!

Holy Over the Shoulder Shot, Batman!

Oh hey look - the camera is over YOUR shoulder now!

Oh hey look - the camera is over YOUR shoulder now!

The idea was inspired by the script. It was January 2020 - I was in a plane flying from San Francisco to Burbank to join Sarah Callies, David Harbour, and Mark Ramsey for an Aftershock recording session. I had just gotten the scripts for Episodes 3-6 and was reading through them on the plane. 

In Episode 3 there's an exchange between Wayne and Dover. Instead of them being in the same room - Wayne was handcuffed and behind glass. I could instantly SEE in my mind what this would look like on TV or Film. The camera would likely employ a lot of OTS shots - bouncing between sides of the glass. Sometimes it would be on Dover's side looking at Wayne, other times it would be on Wayne’s side looking at Dover.  

I knew I could make the audio sound like that but I wasn't sure it would play without the visual support. Would listeners "get it"?  When I got to the studio I told Mark & Sarah my idea and they were all for it.  It was just up to me to figure out the HOW.

Here's the very first instance of this OTS technique from Episode 3

Two main things make this work.

First - the ROOM TONE for each room has a different sound. While they exist on the same vessel and need to be similar, they need to be noticeably different.

I knew ROOM TONE wouldn't be a significant enough change for most listeners to track that we were switching perspectives. So I employed a SPEAKER effect for the character on the OTHER side of the glass. 

By shifting room tones back and forth for each character and hearing the other feeling come through a bit of speaker - I knew I had sufficient sonic language to play with this dramatically. 

Here's the following example from a bit later in Ep 3 between Dover and Cassie.

Once this sonic language was established it was used for nearly all the interrogation scenes for the rest of the series.

That left the larger question about WHEN to cut from one room to the other.  In other words - this idea had to go from being a clever sound design technique to an intentional story-telling device.

My general rule for the first pass was to always start these scenes by being IN the room with the DOMINANT character in the exchange. The subordinate character would start on the little speaker in the OTHER room. This reinforced the power-dynamic in the interactions.

Most of the time that meant we started with Dover as he is leading the interrogation. It could SHIFT over the course of the convo - (like in E1 example where Wayne tries to assert his dominance) In all cases I would then use my gut to decide when to bounce back and forth as the drama dictated. 

The producer team of Sarah Wayne Callies, Ben Haber, Mark Ramsey & Patrick Carmen and I would discuss the WHEN and WHY to cut between perspectives. In the end, I kept to my approach for the first pass and then made adjustments about when to switch rooms based on ideas from the team. In later episodes, Sarah felt the technique was so well established that we could use the SPEAKER effect minimally for a few words and just bounce to the other room whenever that character was speaking without the speaker effect - using only ROOM TONE. 

So there it is - the Over The Shoulder shot rendered in Audio Fiction! Did it work for you? Were you able to track it in your mind’s eye or were you wondering …. what is happening? Lemme know.

I'll take more dives into the inspirations for the audio design of Aftershock in the coming weeks!

2020 Buh bye!

Ok 2020, you can go get F√ç∆∂!  now.  

Happy New Year!  I've been extremely fortunate to have kept quite busy in an otherwise miserable year. 

Here are just a few highlights.

ezgif.com-gif-maker+(7).jpg

STATS! STATS! STATS!

According to Podtrac - which measures this kind of thing - six series I created sound for in 2020 were among the Top 25 most downloaded new shows of the year.  They were:

#6 - Dr. Death Season 2 - Dr. Fata
Dr. Death S1 was the most downloaded new show of 2018

#7 - GURU - The Dark Side of Enlightenment

#11 - Blood Ties  - Audio Fiction Drama

#13 - Joe Exotic  - The Tiger King

(technically, we made and published "Joe Exotic" in the summer of 2019 - but it was republished in 2020 to take advantage of the buzz that would be kicked up by the Netlflix Doc. Looks like it worked! )

#16 - Do No Harm - w/NBC News

#18 - Bunga Bunga - The Rise and Fall of Silvio Berlusconi

You may notice all of these series were produced by Wondery which had 11 total new shows in the Top 25 of 2020. They are a hit machine and it's great to get to work with such talented people on these series.  If you're interested in how the sausage gets made I plan on creating a few "Favorite Scene" posts featuring scenes from these series - so be on the lookout for those.

blood-ties.jpg

Surprising to me (in a good way) is the high performance of Blood Ties which is an original Fiction Audio Drama. 

Historically speaking “Audio Drama” has not been as popular for listeners as Documentary / News & Information type series. The performance of Blood Ties is a great sign that the Audio audience is maturing and increasingly willing to turn to Audio content for the same kinds of storytelling they get from TV & Film.  Oh and btw - season 2 of Blood Ties was made remotely during the early months of the Covid-19 lockdown. 

AFTERSHOCK!

Sarah Wayne Callies

Sarah Wayne Callies

While I'm talking about Fictional Audio Drama - this year I completed work on AFTERSHOCK - a 10 episode original Audio Drama starring Sarah Wayne Callies (The Walking Dead, Colony,) David Harbour (Stranger Things, Hellboy, Black Widow) Jeffrey Dean Morgan (The Walking Dead, The Good Wife, Watchmen Film) and several other amazing performers from TV & Film. Aside from a few remaining minor details, I have 10 episodes of exciting, well-acted, highly produced Audio Drama ready for your earholes!  Coming to your favorite podcast App on July 14th!

David Harbour

David Harbour

We created the pilot in early 2019 - got financing for the full series a few months later, got voice actor recording started in late 2019/ early 2020, and then -COVID!!  So the production had to move remote like everything else.  I finished post-production for all ten episodes in Sept 2020. It didn't take every minute of that time to make the series - there were long periods of inactivity due to scheduling conflicts, Covid etc... BUT this series finally sees the light of day on July 14th, 2021.  So be on the lookout for that.  I will definitely post about it.

PODCAST MOVEMENT 2020

The annual huge podcast conference was originally slated to meet in Dallas in Oct but had to move virtual this year. I was fortunate to get to do a short session on Scoring & Music Supervision for Podcasts. I shared the virutal stage with Music Supervisor Scott Velasquez. We talked about our work on Bunga Bunga and took questions from attendees. If you have a pass to the conference, the session was recorded and you can watch it in the PM library.

BRANDED

I worked on a few branded audio projects in 2020 - including a few new ones.  The thing with "Branded" content is that it's very easy for it to play out like a long-form commercial for the brand paying the freight. 

One very note-able exception for me this year is BEING SEEN

300x300bb.jpg

On the surface BEING SEEN is an 11 episode interview series focused on the gay and queer Black male experience. It's hosted by author and activist Darnell Moore. Moore is a Director of Inclusion for Content and Marketing at Netflix. So where is the "brand"? The series is supported by ViiV Healthcare whose primary focus is on HIV care and treatment. They smartly host these conversations which benefit the community rather than making the series about themselves. What's special about the series is the voices and stories told - and each episode is as thoroughly designed and produced as any of the big event mini-series for which I create sound.

My favorite episodes are Episode 4 and 11 but the entire series is ear, eye, and mind-opening.

2021

A lot of things going on already for 2021: more event mini-series with Wondery, AFTERSHOCK will get published a few branded things continue some new ones will launch.

I'm also working on building and leading teams to launch a few new series that are just now starting to take shape. International in scope, these could be very exciting and I can’t wait to get them up and running.

Maybe you and I can collaborate on something?

Let me know - I look forward to hearing from you!

WRITING FOR SOUND - MORE

One of the most dreaded and avoidable listener complaints can be summed up in the phrase “cheesy, canned sound effects”. On the surface, it appears to be a comment about the quality of the sounds themselves. It may also speak to cases where the sound was not artfully employed. But in my experience, that kind of comment is most often about sound effects that are not narratively necessary. And the root cause (over-zealous sound designer notwithstanding) can almost always be traced back to the writing.

famale_computer_silhouette.jpg

I can think back on numerous situations where I felt boxed in by writing that did not leave room for the sound to carry exclusive parts of the narrative load. In many of those instances, the requested sound was mere window dressing to the narration or worse, unnecessarily redundant to it.

An anonymized example:

NAR: Torrential rain drenched the City as Janet and Earl made their way across the busy street, and up the stone steps to their heavy wooden front door.
(sfx: rain - wet footsteps - door opening)

That kind of writing is what you might find in print. Lots of words telling you everything you need to know. So when being “adapted” for audio the sound effect notes are added to the script but the writing itself isn't changed.

It’s easy to mistake this as a scene “written for sound" because of those sound notes. But you’ll notice the narration is already telling us everything and that the requested sounds are now redundant.

While the sound effects in this scene may "dress it up" a bit - this approach leaves a lot of story-telling potential on the table. On the simplest level, the sound can convey all these details of our scene without any narration or dialogue at all.

Rain pounding the street.

Cars slowly rolling over drenched pavement.

Splashy footsteps across the sidewalk and upstairs.

Fumbling with keys, a door opening.

Assuming these scene setting details are important to the narrative of our story we can now see that no narration is needed to communicate them.

So now, with sound telling that part of the story our narration and dialogue is liberated to do something sound alone can’t do - like tell us what someone is saying, thinking, feeling or what they’re smelling, or seeing that’s not making a sound.

When we decouple narration/dialogue and sound design from each other they’re both empowered to perform in complementary ways - we get choreography instead of mimicry, design instead of post-production. Sound used this way isn't as likely to be perceived as "cheesy" or "canned" because it's serving a unique narrative function.

This requires a big shift in how our stories are written. Just as filmmakers are encouraged to "show" rather than tell, audio story-tellers should be equally encouraged to let our audience "hear" rather than be told.

If your scene is really incorporating sound in this way it should feel somewhat incomplete if you read through it without the sound notes. That’s a great sign you have incorporated sound into carrying exclusive parts of the narrative. If that seems like a high bar to clear, well, it is. This is not a well-worn skill, yet. But as an audio-only medium we should be seeking to use sound to its full advantage.

We can begin with thinking about how to tell the story so that sound naturally and organically carries more of the narrative load. What kind of sound? Depends on the story - but writers should be aware that “sound” in reality is physically a verb - it is action - it’s air molecules being excited by a force in an environment. It can be small and subtle or enormously explosive. So then the question becomes what kinds of sounds are important for the characters in our story and our listeners to be hearing. They don’t always have to be the same sounds and they certainly don’t have to be literal. Instead of thinking of sound as “background” to the story think of it as an equal but unique layer through which to weave our story-telling.

A simple way to start is to write the description of the scene and actions like you would normally - but instead of using it for narration or dialogue put that information in the script as a sound design guide. Then write for the narrator/characters knowing the sound is already telling it’s part of the story. Your narration and characters can be aware of that sound or not - it’s incredibly freeing.

Once you've got the hang of that then you can turn to even more artful uses of sound - like portraying subjective points of view, for example.

Some of the more compelling scenes I’ve designed have been for the Wondery series "Imagined Life". An important trait shared among those scenes is that they put the listener in a first-person perspective of a character for whom a physical or emotional condition alters their perceptions. It could be an illness, or joy, grief, injury, or triumph. In that approach, the normal sounds representing the “objective” world can be morphed into a subjective and designed "experience" influenced by their condition. It makes for powerful story-telling that leverages the unique strengths of both sound and voice in an audio only context.

Think about anything that colors or alters a character's perception of events - or characters expressing subjective points of view and memories and you’ve found beautiful and unique opportunities to use sound more creatively in your story-telling.

FAVORITE SCENES: Imagined Life - The Bride

Spoiler alert - this clip reveals the identity of the subject of the episode!

So if you haven’t heard the episode and don’t want to know who YOU are yet, don’t click play.

Otherwise - as always - pop on some headphones and join the journey.

For me this sequence highlights what is special about the show - putting YOU in the experience of another combining drama, tension, tragedy and redemption.

First, we start outside “viewing” this as we customarily might - from a distance in 3rd person. Then we cut to inside the vehicle and now we’re clearly first person perspective. YOU are in the car. Our perspective leaves the car for a bit so we can get a sense of speed and place and then we’re back in the car again until…

Stick around for the end and the reveal - it’s quite touching.

Narrated by the amazing Virginia Madsen

2019 OFF TO AN AMAZING AUDIO START

The latest Wondery mini-series I designed audio for “Over My Dead Body” just hit the pod-verse and the response has been pretty terrific - still at #1 on Apple Podcasts as of this writing two weeks after publishing.

Screen Shot 2019-02-21 at 7.44.11 PM.png

Across the board we tried to approach this story without using the standard True Crime tropes.

For example - there’s no 911 call, victim or even a crime to kick off the series.

Instead of returning to the ominous style underscore I’ve enjoyed creating in previous series this series is outright perky & plucky at times.

All is not so bright though - it’s kind of a slow cooker and it does get dark.

Imagined Life came back from holiday break with a few decidedly more, ummm shall we say controversial characters whose sometimes less than ideal lives we immerse you in. Some of my favorites so far of the series!

In production presently is a very cool series I can’t name yet, written by my frequent collaborator Mark Ramsey. In 6 audio rich episodes we dive into the life of one specific former Undercover agent and their experiences drawn from a 20+ year globe spanning career. Big action and some surprise names in this one.

Also in production is a pilot for an original anthology horror series by Mark Ramsey and myself. This show NEEDS to happen! :)

I’m hearing rumors that POPS! - The Amazing Story of Louis Armstrong staring Reno Wilson might finally be published this year - I will be thrilled to get that out there.

Plenty of other projects in the hopper - a few pilots with some incredible names attached, another season of Inside____ (insert famous movie) and of course expect more crazy true crime stories too!

As always - I’m super grateful to be able to design audio for incredible stories like these - I look forward to sharing even more cool stuff in the weeks and months ahead!

Till then - THANK YOU for listening!

WRITING FOR AUDIO #1

First rule of writing for audio is - you don’t say the sound.

The second rule of writing for audio is - you don’t say the sound!

“The dog barked loudly” (sfx: dog barking loudly)

“His heavy boots pounded across the hardwood floor” (sfx: heavy boots pounding across hardwood floor)

See?

It’s redundant.

Sound tells it’s own story so liberate your narration and dialogue from telling listeners exactly what they’re hearing. Conversely, liberate your Sound Designer from having to put specific sounds to sounds that are said.

You can and should reference sounds in the production notes so the designer has an idea of the environment the scene is taking place, what is happening there, etc… but let sound speak for itself and the narration and dialogue will be free!

Dr. Death series launches to incredible response

Over 36,000 Five Star Ratings (a record) 1000+ raving listener reviews on Apple Podcasts in the first month of release - and already optioned for adaptation for a Television series - DR DEATH has been a wild ride and holds an interesting lesson.

Screen Shot 2018-09-17 at 1.30.55 AM.png

I was fortunate enough to work on last year’s break out hit audio series Dirty John and it was hard to imagine I’d get the opportunity to work on something that connects with such a large number of people that powerfully and that quickly. Enter Dr. Death.

DR. DEATH is 6 episode investigative mini-series about a medical system that failed to protect 33 patients in Dallas. Reported and hosted by Laura Beil produced for Wondery - Sound Design and Production by yours truly.

The series has gotten coverage in The CutPopsugarThe Daily MailVice, Rolling Stone , Esquire among others.

The audio production on this series is more forward, designed and cinematic than public radio journalists and listeners are accustomed or even prefer. It’s the kind of work I most enjoy doing - scoring these stories as I might a film.

It might seem a risky move from a pure journalism point of view - but when it’s done right it can get quality journalism into the ears and minds of people that might not have previously consumed it.

While a few from the public radio corner of the audio space will comment with concern that if the journalism is that good “you don’t need” that kind of sound and production approach - I’d argue the opposite. It’s easy to forget that podcasts are still not consumed by most people (only 17%) and most of those listeners came from the public radio space. That’s a small space, relatively speaking.

If the journalism is that good and important - you absolutely DO need that kind of audio design and production so that it can reach as many ears and minds as possible.

This view feels vindicated by the fact that those concerns are not echoed by listeners in the 1000s of reviews and comments about the series. Instead they comment about how engrossing and terrifying the series is and the need to tell everyone they know about it.

That is how the podcast audience expands beyond the 17% of the population.

But that is not really my aim - my aim is to use powerful sound to make great audio stories resonate with ever wider audiences.

Podcast Movement 2018

YES!  Jeff Schmidt Productions will be in Philadelphia for Podcast Movement 2018!   If see me walking around looking dopey please say hello!  

JUNE 2018 UPDATE!

Lots of work has been going on behind the scenes. The results of which will be hitting your earholes soon!   

First -

IJ_Blog_Large2.jpg

INSIDE JAWS: 

The follow up from Mark Ramsey & I to Inside Psycho and Inside The Exorcist.  7 Episodes of our signature style audio rich single narrator story-telling inspired by the stories behind the making of a classic.  This is a great follow up for the Inside series - and you'll definitely want to bring it to the beach!

Next

POPS! The Remarkable Story of Louis Armstrong: 

Written by Mark Ramsey, acted/narrated by Reno Wilson and audio design by yours truly - this is a mold breaker.  We take the single narrator audio rich approach of the "Inside" series and make it a first person account by Louis himself - from birth to death and 6 episode of goodness in between.  Can't wait for you to hear this.  

True Crime?  Check!  Sept is the release - will share more information as soon as I can.

Several more in early stages. 

Will update as allowed.  

Happy listening!

--jeff schmidt