After many delays due to Covid and life and such, this is the year I get this project done. My initial goals for the project are for it to be interactive and for the sound it generates to be specific to person interacting with the piece. To do this I aim to utilise a camera mounted on a robot arm which will track and follow the participants face. A trained AI model will then generate an output based on the image from the camera. There are number of challenges for me to overcome:
– creating the dataset to train the AI model
– the training of the model.
– building and designing the robot arm
– programming the actions of the arm
All of these things I am to document on this blog as I work through the project.