AI FILMMAKING / LESSON 5 OF 5

Design sound for your three-shot AI scene

A practical guide to using sound, silence and rhythm to give generated images a convincing world.

Download the exercise templates (.md) ↓

Sound gives the scene a place, a rhythm and a point of attention. In this lesson you will build a small soundscape around the arrival, discovery and response.

Before you start

Allow 45–60 minutes. Bring a readable three-shot picture edit from Lesson 4, or use your own permitted scene with one clear discovery. You need an editor with separate audio tracks, headphones and audio assets you are allowed to use.

Your output is a cue sheet, an editable mix and a final scene. Music is optional.

1. Establish the room

Begin with quiet ambience: indoor air, distant traffic or another sound that belongs to the chosen location. Use a consistent bed across the cuts so the envelope insert still feels inside the same room.

Choose an ambience that supports the picture. A busy crowd recording would invent a different environment. Listen to generated source audio before deciding whether to keep, mute or replace it.

2. Add only the actions we need

Place a restrained footstep or clothing movement around the arrival if the visible action supports it. Avoid adding a paper rustle to an envelope that nobody touches.

Align a sound's onset with the visible contact or movement, then watch at normal speed. Adjust by perception as well as waveform position.

3. Shape the discovery through contrast

Try reducing the ambience as attention moves to the envelope, then restoring it after the reaction. Compare that version with a continuous ambience version.

Silence is a relative change, not an obligation to mute everything. Choose the version that makes the event clearer without announcing an emotion the image does not support.

4. Decide whether music helps

Watch the scene before adding a track. If you test music, use a restrained cue and compare with the version without it. Remove music that makes a small moment feel melodramatic or hides useful detail.

Use audio you recorded, licensed or are otherwise permitted to use. Save the source and permission record alongside the project.

Copyable sound cue sheet

CueIn / out timecodeLayerStory purposeAsset and permissionTiming / level note
RoomAmbienceEstablish space
ArrivalActionGive movement weight
DiscoverySilence or contrastFocus attention
ReactionOptional musicSupport the pause

Record which sound crosses a cut and which cue you removed. Update cue timecodes when the picture edit changes.

5. Listen in three ways

First, watch and listen together. Check timing and whether any effect distracts from the discovery. Then listen without looking: does the space remain coherent? Finally, watch muted: the core event should still be readable.

Check on headphones and a small speaker at a comfortable level. Fix clicks, harsh peaks and abrupt ambience changes. Listen to the exported file too; the timeline alone is not the final deliverable.

Independent exercise

Make two sound versions of the same scene: continuous natural ambience, and a version with a deliberate reduction around the discovery. Compare what each makes the moment feel like. Explain which serves your brief better.

Completion check

The scene communicates its event, sound supports rather than masks the action, audio sources are recorded, and the export plays cleanly. Save the cue sheet and editable timeline. Start another scene with a fresh brief to practise the whole sequence.