Paint-style experimental synthesis VST

Discussion in 'Software' started by toni_aguirre, Jan 25, 2015.

  1. toni_aguirre

    toni_aguirre Newbie

    Joined:
    Jul 6, 2014
    Messages:
    24
    Likes Received:
    1
    There's a technique in photography for achieving glitch effects that consists in loading a picture in Audacity as a raw archive, editing (EQ,delay,reverb, anything) the sound and then exporting back to .bmp to get a glitch image. It can also be done backwards: exporting in audacity a .wav as a .bmp (it's not that easy, but I managed to do so by extracting the header of a bmp, exporting as .raw and change it to .bmp), edit it in Paint and exporting back to wav (usually you will get a shit). This process takes a while, and I was wondering if someone that knows a little bit of programming can help me to do a converter from .wav to .bmp to make it faster. If it is an easy task, I would love to make a VST with an open-source Paint to use it as an experimental synthesis technique. I want to remark that this is not effect that is used in Iris, which edits the spectrum, it's very different. If it is useful we can submit it to KVR developers challenge as an Audiosex community plugin. I've ended my exams for now, and I have time to learn by now. This is how the glitch images are done. https://www.youtube.com/watch?v=ODVqhMenF4E. This is how color red sounds with this technique. https://mega.co.nz/#!fVoQHBTb!MlndB_gJBEnhZBpSlISYoQqxqtuZ5DWIYJREVVP8q6M. And this is a simple Haas effect utility plugin I made in Flowstone, I've incorporated dry/wet knobs and different delays for L/R so you can get different comb filters in L/R https://mega.co.nz/#!qBpCkDhb!ApGvnixx3aLz-YZV30mZOKgHgjoj91Qumcrv2U7e9ic.
     
  2.  
  3. junh1024

    junh1024 Rock Star

    Joined:
    Jul 28, 2011
    Messages:
    1,396
    Likes Received:
    433
    WAV <> BMP you'll prolly need to do some FFT & iFFT along the way. You'll prolly need to decide the resolution of picture conversion and some other parameters.

    http://photosounder.com/ < there's this, which is the same concept available commercially.
     
  4. angie

    angie Producer

    Joined:
    Nov 26, 2012
    Messages:
    396
    Likes Received:
    112
    Location:
    Milano
    I don't think that the image in the video linked by toni is read like a spectrum to be trasformed with an iFFT but the image is read like a matrix of 1280 x 720 and the colour information of each pixel is somewhat related with the value of the sample. I'm a bit skeptical about the predictability of the result of such operations, they have a lot of appeal but not all that practical utility but hey this is my opinion :mates:
     
  5. LunaX

    LunaX Member

    Joined:
    Dec 28, 2013
    Messages:
    113
    Likes Received:
    7
    this is very interesting, though i have no idea how to covert wav <> bmp..but i will test the dll later tonight.. :wink:
     
  6. LunaX

    LunaX Member

    Joined:
    Dec 28, 2013
    Messages:
    113
    Likes Received:
    7
    toni_aguirre, your plugin is good.. here are some samples i've tested with - download here
     
  7. junh1024

    junh1024 Rock Star

    Joined:
    Jul 28, 2011
    Messages:
    1,396
    Likes Received:
    433
    Ah, right, ignore my previous post, - I didn't watch the video. Now, that sounds relatively easy to do, playing with headers and interpretation. You could probably make a CLI exe, drag & drop via .bat. A VST GUI & file handling in VST would probably be the hard bit.
     
Loading...
Similar Threads - Paint style experimental Forum Date
Anyone using Soundpaint? Film / Video Game Scoring Nov 22, 2022
What is the deal with 8Dio and Soundpaint? Software Nov 19, 2022
Face Painting Videos Music Oct 12, 2022
8Dio - SoundPaint - what do you think? Software Nov 6, 2021
8Dio release Soundpaint with free 1928 Vintage Grand Steinway expansion Software News Nov 3, 2021
Loading...