- - - SITE IN PROGRESS - - -
I'm pretty into sound design. It's amazing how, with society embracing digital audio interfaces and mediums, we can transform sound in any way imaginable. Morphing any waveform into something entirely different by changing its shape opens up endless possibilities. We can craft diverse soundscapes and atmospheric effects, or even just get a consistent guitar sound that never goes out of tune. Along with this, we've seen the recent rise of deepfake AI voices, where anyone equipped with the right tools can train software to mimic someone else's voice.
I've developed a good familiarity with using DAWs (Digital Audio Workstations) in my spare time. It all started with a year of experimenting with FL Studio, and I've now spent almost two years getting to grips with the more advanced DAW, Ableton Live. Collaborating with another audio technician or designer really excites me, as it would open up opportunities for larger and more polished audio and animation projects, making them seem more within reach. For the current project, though, our musician will be the one deciding on the audio.
When this brief about collaboration in audio for animation came up, I already had ideas about the genre or tempo that would suit my animation style. I'm leaning towards high-tempo sounds, like Drum and Bass or Dubstep, for that edgy vibe. Most of my animations lean towards sci-fi, and I think these modern music genres really call for abstract or sci-fi visuals to match.
Synergising the timing between audio and video senses can assist at forming a cohesive animated piece of music. An example would be visual shapes colliding upon impact when sounds such as loud fast impacts occur, like maybe a crash symbol of a kick of a drum or just a spike in volume.
I find animation is often about recreating and injecting life into stillness. life consists of many senses and to recreate a realistic and complete representation of aspects of reality its often benefitial to include as much information to our senses as possible, animation with muted audio is often dry and can loose context, especially in film production.
If I had to categorize and state a few favorites:
Liquid/Neuro/Jump-up/Jungle Drum and Bass.
Melodic Dubstep.
House.
Garage.
A famous producer named IMANU is a technical genius when it comes to music production and his visualizers. It turns out he also has a similar opinion to mine that nowadays there has been such a clever merge between music genres that often now genres are just based down to the tempo of the track.
A euphoric visualizer by IMANU:
www.youtube.com. (n.d.). IMANU - Empress. [online] Available at: https://www.youtube.com/watch?v=KkM4cf-dRJY&t=29s [Accessed 2 Feb. 2024].
At exactly 1:35 in the following video on the right, he gets asked the question of what genre he will be making, to which he states; "What even is a genre anymore, it's just a tempo right?"
I feel I would agree with this statement, with modern music such as his often falling on the boundaries of typical categories.
www.youtube.com. (n.d.). Studio Secrets with...IMANU | @Beatport x @Plugin Boutique. [online] Available at: https://www.youtube.com/watch?v=KMDRe8Stb-4 [Accessed 14 Nov. 2022].
These are the main softwares and tools that Music producers use when doing digital sound production or combining their live sounds. Similar to how animators use the professional software Maya for their digital work.
Ableton - What I currently use.
Logic Pro - What Ravensbourne University students use.
FL Studio - What I started on.
Our current project involves an intriguing intersection of music production and sound design with the art of animation. Our challenge is to craft an animation inspired by the compositions from the music classes at Ravensbourne University. This endeavor demands a creative visual interpretation of the provided music. I feel it's essential for animators to have a nuanced understanding of the interplay between audio and visual elements in film and animation. Such knowledge is not only relevant but vital in crafting animations that are both visually engaging and harmoniously aligned with their soundtracks.
Sound Wave Shapes:
I've decided to focus on various sound wave shapes, including Square, Sine, Sawtooth, and Triangle waves. My rationale stems from the belief that while much of audio perception is subjective, certain aspects are objectively discernible. Take basic tones of different sound waves, for example. Each wave shape visually correlates to its sound texture. For instance, a harsh, jagged-looking wave typically produces a correspondingly sharp sound, commonly used in genres like jump-up drum and bass to build tension. Square waves, characterized by a somewhat flat yet harsh tone, are often employed in song leads and riffs to capture attention. Sine waves, mirroring the smooth, curved lines, closely resemble the human voice and are frequently used in softer instruments or as audio 'pads'. Utilizing this knowledge, I plan to incorporate these wave shapes in my animation, matching them with sounds that closely resemble their waveforms.
Audio Effects:
In digital audio production, effects like reverb and delay are crucial. They contribute to a more realistic sound by mimicking how sounds naturally tail off in the real world, rather than ending abruptly. This is particularly effective when integrating digital sounds into animation. Equalizers, another common audio effect, adjust specific frequency ranges within the audio spectrum. They can enhance high or low ends of sounds and are also used to modulate speed, rhythm, and even create reverse or rewinding effects, often yielding a futuristic sound. These effects are invaluable when incorporating sci-fi elements into visuals.
Overall, my objective is to use these sound wave shapes and audio effects strategically in my animation to create a visually compelling piece that resonates with the accompanying music.
Stack Overflow. (n.d.). Identifying common periodic waveforms (square, sine, sawtooth, ...). [online] Available at: https://stackoverflow.com/questions/1141342/identifying-common-periodic-waveforms-square-sine-sawtooth [Accessed 24 Jan. 2024].
applications, using all aspects of the marketing mix H. particularly enjoys writing content about product, Nuisance, I.N., Noise, O. and Pollution, E.N. (2018). What’s the difference between echo and reverberation? [online] NoiseNews. Available at: https://www.cirrusresearch.co.uk/blog/2018/03/whats-the-difference-between-echo-and-reverberation/.
Star Wars:
I feel the sound designers for Star Wars have not only been responsible for a huge part of its success but its also a major contributor to the immersiveness of the movies. Drawing sounds for future landscapes and atmospheres is a challenging area as we have to imagine what certain sounds may sound like in the future, all the way from spaceships flying at full throttle, to the sounds of lightsabers activating.
I think Ben Burrt deserves praise for his imaginative sound design throughout the Star Wars trilogies.
One of my biggest favorites in music that also features animation has got to be the artist called Flume.
I feel like his creations travel beyond simple sounds but into a world of intense emotion and sensory overload, and etherial, overwhelming, which feels like you are being sent into another dimension. I am in awe of his creations.
His music video titled Palaces featuring Damon Albarn, or his piece titled Escape featuring KUČKA & Quiet Bison, I find his pieces such as these are often masterpieces beyond comprehension and hard to describe with words. I will try to break down certain aspects of his works and why they appeal to me and why they synergize beautifully with the audio as well as why it appeals to others.
www.youtube.com. (n.d.). Hi This Is Flume [Mixtape Visualiser]. [online] Available at: https://www.youtube.com/watch?v=7TML_MTQdg4&t=697s [Accessed 13 Apr. 2024].
"Palaces," crafted by Flume and featuring Damon Albarn, delves into themes of transience and the pursuit of fleeting grandeur. The song artfully navigates the concept that life's seemingly magnificent moments are, in reality, ephemeral. Through its lyrics, Flume and Albarn engage the listener in a reflection on the pursuit of splendor and its inherent impermanence, suggesting that what we often regard as palatial experiences are but brief interludes in the grand scheme of life.
The music video for "Palaces" weaves a vivid tapestry of sound and sight, featuring abstract visuals and a parrot that dives deep into the themes of luxury's fleeting allure. It's a creative exploration that nudges us to rethink our pursuit of opulence and the real essence of our desires. This blend of Flume's electronic artistry with Albarn's moving vocals, set against thought-provoking, and flashy imagery, transforms the piece into a contemplation on life's transient highs, reminding us to cherish the now and the fleeting nature of grand moments.
In the track "Escape," Flume collaborates with QUIET BISON and KUČKA to deliver a narrative on liberation and self-discovery. The song profoundly resonates with its theme of transcending past limitations and embarking on a new chapter of life. It feels as though the artists are extending an invitation to the audience to partake in this journey of renewal and finding oneself.
The blend of Flume's cutting-edge electronic beats, QUIET BISON's innovative sounds, and KUČKA's ethereal vocals is exceptional. This combination not only pleases the ear but also encourages introspection, prompting listeners to contemplate their future paths. Moreover, the music video, with its depiction of birds in conflict, serves as a poignant symbol for the internal struggles we endure in our quest for freedom and new beginnings.
Thus, this song, coupled with its video, transcends mere auditory and visual enjoyment. It stands as a compelling reminder that music possesses the remarkable capacity to guide us through life's fluctuations, inspiring us to grow and welcome the transformations we encounter.
Even when he adds a simple image of a graph, halfway through these vivid videos, it somehow makes it better, through our subconscious reflections on what it means to gain in life, how we rank ourselves, what we value, and contemplate where we are we even going. --->
www.youtube.com. (n.d.). Flume feat. KUČKA & Quiet Bison - ESCAPE (Official Music Video). [online] Available at: https://www.youtube.com/watch?v=lup6uoiet5Y [Accessed 11 Nov. 2023].
To mention some other notable inspirations for creative music visuals i would say have insipred my project are these unique videos:
A very abstract and slightly dystopian 3D animated music video from the works of IGORRR. This video is a great example of how a video can go to great lengths of creativity that may not be at all expected when listening to just to audio but when watching alongside it really engages the viewer and makes them feel more interested about the meaning or depth and question more as to what it is trying to communicate.
www.youtube.com. (n.d.). IGORRR - VERY NOISE. [online] Available at: https://youtu.be/Osqf4oIK0E8 [Accessed 13 Apr. 2024].
Here is another notable creation, called Origami created by Rone.
This video is a great example as how we can use basic shapes and colors to illustrate a story alongside the music. It really feels like your travveling along in time with this biomorphic simplified being in a universe of intense and limitless feelings. I am in awe of this piece as i feel that even though the visuals dont always land and move on every beat, that they still communicate with the music and lay down facinating visual scenes to listen and captivate you with.
RoneOfficialVEVO (2018). Rone - Origami (Official Video). YouTube. Available at: https://www.youtube.com/watch?v=hVv331iLMXM [Accessed 13 Apr. 2024].
Here is a funky creation by Rusko named Woo Boost. A famous classic dubstep tune. which even today stands out for its almost retro sound, but particularly to me for its very simplistic use of a green screen and layered shapes to create a very interesting video formed from editing simple reflective diamond shapes flying across the screen and having the musician standing in front of a simple coloured green screen, he has creative visuals which compliments the audio and brings it to life more.
www.youtube.com. (n.d.). Rusko - Woo Boost [Music Video]. [online] Available at: https://www.youtube.com/watch?v=WtMlB-BEMso.
I have found out from making this project that good planning is required to execute detailed and hyperrealistic animation within Maya. I was slightly put down at the rendering potential witin maya, for parts of this project i heavily considered transfering to Unreal Engine to use their render as it runs so much more efficiently. unfortunately bounded by the Arnold inbuilt denoiser imager; Noice, which was almost 20 times slower at rendering than Nvidia's default denoiser, but was the only one that comes with Maya that works across multiple rendered images within a sequence, which is crucial for creating coherent blending between frames and reducing pixel flickering.
This process of having to go back and forth rendering images to calculate how many frames i would need to spend time rendering.
Let's say 1 image frame takes 1 minute to render with realistic lighting, and you want a 60fps animation; that's 1 hour of rendering for only 1 second of your animation. so for a 2-minute video it would take 120 hours, which is a ridiculous amount of time. so I had to rethink how my visuals were displayed and created multiple times, as all of it was lighting-based, so required lots of light ray bounces, and plenty of reflections.
Part of primary research involves exploration. And I feel one who wants to do reasearch in this area, may go to music events- containing displays and visualisations to help get a better grip or understanding on what aspects other creators and listeners prefer or suit better alongside audio various tracks.
My primary research here involves first hand experience with music festivals and clubbing events from Ministry of Sound to Electricity Festival. These places need coherant and complimentary visuals to go alongside the audio at these places to keep the vibe going using visuals as a catalyst with the music and make them 'feel' it more. I also enjoyed doing my research as it creates a great oppotunity to find likeminded individuals.
I feel I would have to give credit to the Ministry of Sound for the unique and also iconic logo, recognised by many. Which although i did not use it as a reference when creating my disco ball and diamond rings. I feel I could be subconsciously replicating aspects of these visuals I have seen previously at events, and gradually moving towards these types of visuals that fit the dancy housey music.
Many of people I have showed and asked for feedback were quick to state it reminded them of the Ministry of Sound logo with the iconic rings around the disco ball. but to my surprise they aren't even full rings as I remembered they were two crests with words on either side of the disco ball shown here. In my opinion, the Ministry of Sound have done a great job of creating an iconic and recognisable logo helpful for identifying their brand and the only real similarity here to mine is that there's a disco ball.
I've delved through many different tutorials online to get a better grip on how you control and manipulate particles from simulations.
The following tutorials serve as great steps to understanding the technical aspects and the different mediums that MASH Nodes can be used for.
Understanding motion trails and reflections and emission is where i would say most of the care needs to take place when making flashy music visuals.
I feel this is due to the repetative nature of reverb, echo and delay effects that are frequently used on modern music, these effects when visualised often stem away from simple blocky shapes and fall into more nuanced detailed aspects of animation which you have to me more delicate with as each attribute may be connected to not one, but multiple shapes so would require much more precition and trial and error when dialling in the numbers through the attribute editor to control the array of flickering lights or vibrating particle systems.
Here is a great tutorial from T J Cousler on YouTube, who explains how to arrange your simulated points. And another video tutorial from Pogo Motion who goes more in-depth with the actual sound linking.
www.youtube.com. (n.d.). Sound Visualization Workflow in After Effects and Maya. [online] Available at: https://www.youtube.com/watch?v=cFGNShzvY_U&t=1100s.
www.youtube.com. (n.d.). MASH Audio Node - Maya Tutorial. [online] Available at: https://www.youtube.com/watch?v=c-NvAO7b5K0&t=773s [Accessed 13 Apr. 2024].