The Game Audio Tutorial

You might also be looking our old book : "The Game Audio Tutorial", or new book : Game Audio Implementation.
Showing posts with label game music. Show all posts
Showing posts with label game music. Show all posts

Interactive music with WWise

Article on the interactive music system in WWise.
http://www.music4games.net/Features_Display.aspx?id=317

Audiokinetic's increasingly popular middleware is also now fully integrated with the Unreal 3 engine but unfortunately this capability seems only to be available to official developers - Boo !!

Music, Silence, Timbre

Today's post is brought to you by a recent hard drive partitioning disaster and Music4games recent interview with Kevin Reipl.
M4G: What would you like to hear more of from game soundtracks?
Kevin Riepl: More silence, I think a lot of games use music too too much, playing and looping it constantly, under action sequences, under ambient settings, all over. As a gamer, I personally get more engulfed into a game when the sound design takes center stage to convey the environment. Of course I think music is an integral part of gameplay and story, it just seems that its used all too often as a blanket. When voice acting is top notch as is sound design, music can then be brought in to emphasize key story plots or important gameplay sequences.
Kevin's views about wanting more silence in games (or at least less music) is a surprisingly common comment from composers (both for games and films). In a thought provoking discussion (Mike Figgis - Walter Salles - Composer and director : Exploring the collaboration) Mike Figgis describes the over use of music in film like a kind of addiction.
Mike Figgis: ...a really important question for filmmakers is: When do you introduce your first piece of music on the film? And my experience is this, I try now not to put any music on for a long long, long time. Because I know that the minute I use fifteen seconds of music the film has lost its virginity, and has become a kind of sex maniac. In a way it just can’t have enough. And it has worked really well as a virgin up until that point, and then the minute you put something on you kind of go, wow, now it really sounds like a film, let’s get some more of that stuff. And then the temptation is just to wallpaper the entire film with delicious music that you have stolen from somewhere else.
One of music's most important roles in film is realised simply by being there. Stephen Deutsch, (Soundscapes : The school of sound lectures)
‘In most films , the appearance of any music at all is a signifier of emotional content. When the music comes on , we are told that the scene is invested with emotional significance and is different from those scenes which contain no music.’
So by having music there all the time in a game we are actually undermining it's effectiveness. (The increasingly blurred boundaries between 'musical' atmospheres and 'sound design' will have to wait until another post !)

Kevin goes on,
Also, I think video games need to stray away from trying to have the Hollywood sound. That certain sound that has become sort of a ‘brand’ in Hollywood is now heavily leaking into games and is causing many upon many of the games out there to sound very similar. Now don’t get me wrong, I am not saying there is anything wrong with that style of music and by all means I am all for and love cinematic epic style writing and some games indeed call for that, but I honestly think if the industry as a whole had more confidence in being who they are and stopped trying to emulate film, it would allow composers more freedom and a wider palette to provide a signature sound for a game. Also, I think as an industry we have already met the standard of film and have passed it. Video games and film need to now head off in their own respective evolving direction.
I'm not one of those people who think that the only real 'game music' was from the glory days of 8-bit chip tunes but I think the point is well made. I was struck by how widespread the homogenisation of the 'Hollywood' score towards the orchestral template is when I tried to think of a single 'blockbuster' hollywood film in recent years that didn't have a full orchestral score (+ the obligatory pounding percussion) - I couldn't. If we look at the top grossing movies 2007 you can see what I mean (I can't speak for 'Wild hogs' as I haven't seen it and, unless trapped at 30,000 feet in some sort of in-flight-movie-hell, probably never will). (See also the USA top 100 box office films). In aspiring to create the 'blockbuster' game (particularly 1st / 3rd person shooters) it seems like game directors and producers are adopting a similarly myopic stance.

In the music history class during my first degree we were once given an assignment - 'Write the history of western music on the back of a postcard'. (I'm a great believer that if you really, truly understand something that you should be able to explain it simply and concisely - otherwise you don't really understand it, so this is in my view a great assignment to do on any subject !). Being immersed in the detail of music history at the time of course I thought it impossible, and failed miserably. Now however I think I may have at least a stab at fitting it onto the back of a postage stamp instead. The history of western music perhaps goes as follows :

Rhythm, Melody, Harmony, Timbre.
Discuss.....

I think that in the age of timbre it is time that game producers had the confidence in their composers to allow them to use a wider palatte of instrumentation and sound. It's interesting to note how the film soundtracks that have explored this have become so influential (I'm talking about 'scored' movies here - not ones that use a lot of soundtrack music).

Morricone's 'westerns', Vangelis 'Blade Runner', Mancini's 'Pink Panther', Bernard Hermann's 'The day the earth stood still', and 'Taxi driver' (not to mention the unusual use of strings in 'Psycho') and other iconic scores are characterised not purely on their melodic / harmonic / rhythmic approach but by their instrumentation.

So a call for less music - more timbre ?

How does all this relate to my personal hard drive tragedy ? Well the drive that went down was the drive called 'Patches' that, in addition to having various commercial sample banks (which given endless patience I can reinstall), had numerous sample patches that I'd put together over the last few years. So given this discussion maybe it's a good impetus to get out the mic and start creating some new ones instead of reaching for the nearest 'Orchestral sample patch 101' ?

Nobody likes to hear 'it's in the post'

In a recent article in gamasutra by Alexander Brandon 'Next Gen Audio Square-off', Gene Semel, audio director of SCEA says,
'I foresee more robust real-time logic systems that will allow sound designers and production directors to actually make decisions and mix the game at a "post-production" like stage of development. '
Looking at examples like Scarface (Rob Bridgett Gamasutra postmortem, + mix magazine article here) the opportunities for 'mixing' the game audio soundscape, as opposed to treating it in the fixed way that has traditionally been the approach up until now, are really exciting.....

Scarface GDC 2007


(Another interesting discussion on game mixing on gameaudiopro here)

However we need be be careful not to wish the 'post-production' role upon ourselves anytime soon. (I'm pretty sure this is not what Gene really meant but let's discuss it anyway...). As I discussed in my related blog post what is needed is better , earlier integration with the planning and development stages, not to ape the unhealthy practices of many films.

Over on 'Sound-article-list' Randy Thom suggested reading an article from Film Journal International,
'Setting the scene : Inside the world of the production designer'
'Below is a link to an article on Production Design. Trying to imagine what it would be like as a sound designer to be taken even ten percent as seriously as a production designer, I think it's useful to learn as much as possible about their process with the director.'
(Read the full thread here)
Bob Kessler sums up a typical scenario,
'I work primarily on lo/no/micro budget projects. Most of the time I am retained after the first edit is completed, and that happens when the client realizes that there is more to sound than having an unpaid first-time PA with nothing better to do hold a cheap mic on a broomstick somewhere in the vicinity of the talent. That being the case I spend the bulk of my time doing noise reduction or incredibly painful ADR sessions and then adding what touches I can before a quick mix. On those rare occasions when I am consulted before shooting begins I mostly spend my time lobbying for them to hire a competent production sound team.'
Dave Stone also describes how the structure of film-making and the concept of sound as a post-production process mitigates against creative involvement.

It was refreshing to read Sande Chen's excellent article on Gamasutra and the call for a multidisciplnary approach.
'By espousing this multidisciplinary approach to narrative design, developers can elevate the art of game development as well as increase the bottom line. Meaningful games require advance planning, but players benefit much from the integration of story, art, gameplay, sound, and music. Using themes, narrative designers ensure that each play experience is not only immersive, but also a meaningful one....
If we're going to build really powerful games, we need interdisciplinary teams," says Sheri Graner Ray. As a freelance game designer and production consultant, Ray knows firsthand the level of collaboration that can occur when artists, writers, designers, programmers, and composers work together....

As with the narrative designer, Ray recommends bringing in a sound designer and/or composer early as part of an interdisciplinary team. She understands fully the power of sound and music in games. Just recently, she heard the notes from a once-favorite game and experienced an emotional pull back to those times. "I almost got misty over it," she recalls. "It was like a family reunion." Truly, the emotional heartbeat of a game can be heard through its music and sound design. Narrative designers can work with composers and sound designers to strengthen the emotional connection so that players always have a powerful and meaningful experience.'
So at a time when the technology seems to finally be there to allow us to play an equal role in the storytelling within games let us not be relegated to the 'post' production model of film.

I'll leave the last words to John Broomhall from this Music4games interview.
'I believe game audio pros have always taken inspiration from all other media. Looking at movies in particular, and thinking about the craft and artistry of sound design, there’s 80 years of development that I’m sure all of us in audio have drawn upon. It’s very exciting that, as technology barriers and constraints fall away, we’re all on more of a level playing field technically - and it’s the power of ideas that really matters. Whether film or games, we are all creating stories, emotional moments, intense action and drama – and sound is an amazing tool to deploy. ........

A few years back, it was a huge blast simply to bring virtual worlds to life – and realism was the watchword. As time progressed, we became able to create a dense literal description of the world with carefully placed sound emitters and x, y, z co-ordinates in 3D geometry spaces, sporting scientifically accurate acoustic reflections and reverberation. ......But what about the subjectively chosen sound treatments that are used purely to enhance and underscore drama and narrative? How many games have fully explored the potent force of sound that tells a story, provides exposition and characterization, leads navigation and drives primal emotional responses – sound that works beyond the literal using metaphor and suggestion?........
It seems to me that we have a job of evangelization to do and that’s something that needs to happen in every developer all over the world, week-to-week.'

Game Sound Book

Karen Collins (of Gamesound.com) has written a rather good book !
I can highly recccommend it as probably the most academic (in a good way !) book on the subject so far. Particularly strong on dynamic and interactive music techniques it's a must read for anyone interested in game audio.


Richard Jacques On Game Music's Past, Present, And Future

Gamasutra - Staying In Tune: Richard Jacques On Game Music's Past, Present, And Future

There's some implicit criticism here from the interviewer of the current trend toward ochestral scoring of games in favour of what is referred to as a more 'iconic' style. I'm not really sure what is meant by this but I'm guessing it's an argument in favour of game music sounding like 'game music'.
I can remember the theme songs of those older games, and part of it is, as you said, probably because I had to play through the levels so many times.

RJ: Yeah, the exposure...

But still, it's somewhat disturbing to me that I can't call to mind the music of recent games, a lot of them. Exceptions are like Halo, but that's partially because you have to wait on that loading screen for such a long time.
I'd certainly support as wide a variety of scores as is appropriate to the games but I think we should remember that game music, like film music, is part of a unified experience. Perhaps if you can clearly remember the themes then it is drawing attention to itself too much ?

I don't think music in games is going to be as memorable or invest itself with real emotional meaning until it is truly 'interactive' and at one with the scene' rather than 'reactive' (see 'Hellgate London" post below!).

Hellgate London - Music 'Interactive' or 'Reactive'

Music4games great article on the music for Hellgate London by David Steinwedel.

Where our system shines is in micro-managing music. It allows for constant music cue changes according to the scope of a battle and how it’s going for the player. We can write cues and stingers for specific actions and conditions and switch to them instantaneously. As our audio programmer says, “It’s a good reactive music system.” And he’s right in most cases. However there are times when music needs to be proactive, looking ahead at what’s coming.

Here's the challenge of 'interactive' music. How do you build toward and anticipate an event (as film music does so effectively) when the player is in control, and therefore you don't actually know when that event is going to happen ?

I was playing Half Life 2 : Episode 2 recently. Excellent game and great, very sparing, use of music. However the game / music symbiosis remains clumsy. When the 'bad guys' appear the music kicks in. Great - this works really well, giving a real emotional significance to the encounter (in contrast to most of the game which is played without music). And when I kill the last one the music fades out. But we need this to work better. I want the music to hit a climax at the exact moment of my coup de grace and then subside as the creature falls to the ground. How can we possibly do this with the music? My last bullet is not going to coincide nicely with a beat or barline. No, what the designers need to do is to actually engineer the music / game to work together. Do I really know exactly how many bullets will kill it ? Will I notice the difference between 17 and 19 ? Would it matter if the game engine actually said - well officially this monster should die right now but I'm just going to hold off for .75 of a second until that point comes along and then do it - BANG ! A gold star to the brave composer who suggests that to their producer !

Here's an example from the otherwise brilliant Half Life 2 Episode 2 of the problem.

Mario music crazyness !

Amazing but conclusive proof that some people have far too much time on their hands !



Custom mario levels by IsoTkh
Discovered courtesy of boing boing and Tom Jackson.

Related but unrealated - Mario composer Koji Kondo discusses his approach to composition.
Mario Maestro shares his secrets (GDC 2007)

Troels B. Folmann

Interviews discussing his approach to composing music for games.
Courtesy of FilmSoundDaily.org

Generative music for games

Some have argued that to be truly reponsive, and indeed interactive, music for games will need to be increasingly based on generative systems. Existing systems are already 'generative' in the sense that they generate new content based on rules (even if that is just to the extent of recombining randomly chosen elements). Perhaps we'll see a more low level example of generative game music in the procedurally based 'Spore'



GameSpy: The Beat Goes on: Dynamic Music in Spore

Will Wright and Brian Eno interview



In other news on the generative front is the announcement of new formats for 'Interactive Music' Computer Music. Perhaps people are bored with the idea of music as a fixed, repeatable phenomenan. Instigated by the advent of sound recording 130 years ago perhaps this was just a curious blip in the history of music. Brian Eno puts it better than I could.

"Until 100 years ago, every musical event was unique: music was ephemeral and unrepeatable and even classical scoring couldn't guarantee precise duplication. Then came the gramophone record, which captured particular performances and made it possible to hear them identically over and over again.
But now there are three alternatives: live music, recorded music and generative music. Generative music enjoys some of the benefits of both its ancestors. Like live music it is always different. Like recorded music it is free of time-and-place limitations - you can hear it when and where you want.
I really think it is possible that our grandchildren will look at us in wonder and say: "you mean you used to listen to exactly the same thing over and over again?"

(More on generative music here and here. Noatikl, generative music software and heir to Koan here)

It could be argued that a similar situation is arising with 'passive' film watching vs 'interactive' gameplaying. (I'm sure you've all read the comparisons of GTAIV's opening weekend profits / Hollywood movies etc). Obviously it's not that these forms are going to suddenly die out (after all people still paint don't they ??) but I'd be surprised if interactive gaming has not replaced film as the mainstream lesuire activity within the next 50 years. .. I digress..



Given that the kind of manipulation offered by these formats (MPX4, MT9) would necessitate the avaiability of multiple audio channels (and consequently imply huge file sizes) I can't help thinking that this might imply the return of midi ! It would seem crazy to maintain the current approach of :

Indeed this very issue was raised by Jason Page and Michael Kelly (of Sony computer entertainment) in their suggestion that Midi is the future of game audio.



Some more discussion of this topic here (including an answer to the old "but midi sounds rubbish" chestnut !)



The most exciting / promising development afoot from real control over interactive music (strictly 'generative' or not) is of course the development of the ixmf format. There are many people looking forward to the first implementation of a tool for this - although this may take some time to appear ! In the meantime we can pine over the much neglected DirectMusic Producer.

Unreal Tournament 3 - Sound and Music

Lately I've been getting up to speed with the new Unreal engine's sound and music capabilities.
Much more user friendly than UT2004 and with real scope for some interesting projects.

Interview with the composers

Game Music goes mainstream !

The Guardian had an article on game music last friday.

I have to agree with them that Bioshock's use of diegetic music is very effective at adding a real depth to the world. I don't think I've come across as good an example of the use of source music in games since Mafia's evocative use of Django Reinhart. It will be interesting to see how roles such as the Music supervisors used in film may start to emerge for games as well.

Mix Online - New game audio supplement

Mix Online are apparently starting up a game audio supplement - the first sample of which is here.

Feb issue out here

Mix Game Audio Homepage.

+ Short podcast on games audio here courtesy of The reboot.

Trigger Happy (The inner life of videogames) FREE!

News courtesy of wemakemoneynotart that Steven Poole's excellent book 'Trigger happy' has been made available for free download. A link to the download + copies of all of Steven's articles for Edge magazine are available here.

'Trigger Happy is a book about the aesthetics of videogames — what they share with cinema, the history of painting, or literature; and what makes them different, in terms of form, psychology and semiotics. It was first published in 2000; this is the revised edition with the Afterword written in 2001. It’s offered under a CC license, for a limited time only. I’m not sure how limited that time will be, so grab it while it’s hot.'
Links have a habit of changing / disappearing. I have done my best to make sure these are correct but do not take any responsibility for what might be at the end of them ! Please let me know if any are not working and I will do my best to update them.