ོ࿐˖✶⊹₊𖦹 W.8 MORE IDEATIONS 𖦹₊⊹✶ ࣪˖࿐ོ




IS IT POSSIBLE TO TRANSLATE A DRAWING TO SOUND?

ꕀ My thought process

  • ✲ translating drawing to sound
  • ✲ animate the drawing
  • ✲ combine sound with animated drawing
  • ✲ personalised memory artwork

I've found a few other options like remusic, vidnoz etc. but I feel hugging face works the best. There were also a few models to choose from like AudioLDM-2, Riffusion, Mustango and Stable Audio Open." After a few generated attempts, I personally think AudioLDM-2 sounds more like my memory.
remusic
hugging face 2.0
  • The soundwave drawing in Experiment 3
  • Hugging face v2 auto generates description and a short melody based on drawing. The sound was softer at the start as well as flunctuations in the middle, and a sudden loud sound towards the end
  • I discovered FL Studio software that shows a soundwave using wavecandy. It is very similar to the one I've drawn in Experiment 3





USING TOUCHDESIGNER

ꕀ My thought process

  • ✲ to create an audio-visual experience
  • ✲ using colours from the drawing
  • ✲ making it abstract?

I've discovered a new function where I can import a colour palette component into touchdesigner which makes the colour picking and animating process much easier.

The colours used in this animation are the same as the ones in the hand-drawn soundwave from Experiment 3 previously.

touchdesigner workspace






EXP. 5
MEMORY BALL POSTER


I feel that the results are quite aesthetically pleasing, but that’s as far as they go. I’ve realized that I might have been too immersed in this project that I haven’t taken a step back to see the bigger picture.

I need to ask myself this question:
Will the people who don't know about my project understand what I'm doing?

Initially, I considered creating a series of posters with different animations to illustrate memories from various people. However, I now feel that this approach might be too shallow, lacking the therapeutic depth or meaningful impact I’m aiming to achieve.



an audio-reactive ellipse that moves according to the audio that was previously generated by huggingface AI




Mockup of poster that provides description of the memory with a QR code which will show the animated poster after being scanned.




Moving Forward to Week 9

Andreas mentioned that prototyping includes ideation and under ideation, there are probably experimentations we did that don't meet the expected outcome but we can still add them into our dissertation first then re curate it later.

Start working on dissertation
Reflect on progress, rethink the current direction and come up with more conceptualised ideas that relates more to my objective.