So having established how I was going to build my dataset and that I was going to use pix2pix (initially at least) I need to work out how I was going to convert the audio to a spectrogram image that could be run through pix2pix and then converted back to audio. Converting the audio toContinue reading “Audio to Spectrogram and Back”
Author Archives: dcoopernz
Creating the AI
One of my main goals for this project was for the sound generated to be unique to each audience member. My solution to this was to use their face (or visage) as the input for the sound generation. I initially had ideas around using a camera to read biometric information then utilise a sonification processContinue reading “Creating the AI”
The Arm
The project consists of two main components, the AI model that generates the audio, and the arm mounted camera which interacts with the audience by tracking and following their face. The arm is inspired by any number of examples in science fiction (such as the Ralph MaQuarrie example from Star Wars here). There are aContinue reading “The Arm”
Time to get stuck in.
After many delays due to Covid and life and such, this is the year I get this project done. My initial goals for the project are for it to be interactive and for the sound it generates to be specific to person interacting with the piece. To do this I aim to utilise a cameraContinue reading “Time to get stuck in.”
Introduction
Hi, my name is Dave Cooper and the purpose of this blog is to document the progress for my project as part of my masters of creative practice.