Tools for Cleaning up AI audio

Discussion in 'Mixing and Mastering' started by curtified, Jul 9, 2024.

  1. curtified

    curtified Rock Star

    Joined:
    Feb 3, 2015
    Messages:
    650
    Likes Received:
    441
    :dont: What this thread is not for. Discussing feelings on current state of AI audio. There are other threads you can voice your opinion on that.:dont:

    What this thread is for. Is I wanted to compile a list of tools people are using to fix the current state of AI audio. Over time these algos will sound better but currently only a good year into this this tech. A lot of the outputs are distorted, highs are cut, they have that underwater "chrip" sound. I was wondering if anyone has some suggested plugins or tools they are using to get better quality audio out of these AI algos.

    Here are what I have been using with good results:
    Zynaptiq - Unchirp:

    This plugin was made to improved poorly encoded mp3s streaming music etc. It helps with that "chirp" sound that is in current AI music. Also helps bring back that uppper high end that has been cut off in most AI music.

    Zynaptiq - Unfilter:

    This helps bring out some of the filtered content that might be buried within the diffusion process of generating AI music.

    A few other plugs in my chain that help clean things up are. Gullfoss, Wavesfactory - Equalizer and Spectre.

    I was hoping for something like Khaelis - UNOV to remove some distortion artifacts. but that plug seems to be snake oil. Is there anything similar?
    https://www.kvraudio.com/product/unov-by-khaelis

    One last one I like is Ozone - Master Rebalance. It can help bring vocals more forward in the mix.

    I would love to hear about any other plugins you guys might suggest to help in this process.
     
  2.  
  3. guns and gold

    guns and gold Member

    Joined:
    Feb 29, 2024
    Messages:
    23
    Likes Received:
    11
    never had much success with Unchirp but I salute your ingenuity in resurrecting it! :cheers: Can you get stems on these projects? EQ has worked wonders in the processes of cleaning old interview/dialogue passages using ai... not 100% 'underwater' artifact removal (yet), but pretty convincing masking. Rx11 also useful to a degree - interesting thread :wink:
     
  4. curtified

    curtified Rock Star

    Joined:
    Feb 3, 2015
    Messages:
    650
    Likes Received:
    441
    yeah unchirp has been hit or miss. Its hard to find out how to use it online. Ive played around with some settings but one tweak one way effects the sound. Its a delicate balance.

    Yeah you can use any of the stem seperation algos out there to get stems. But these arent 100% yet either. So boosting can bring out those underwater artifacts in the stems.

    Its an amazing time to have all of these tools! They are just in the early stages.
     
  5. curtified

    curtified Rock Star

    Joined:
    Feb 3, 2015
    Messages:
    650
    Likes Received:
    441
  6. shinyzen

    shinyzen Platinum Record

    Joined:
    Sep 28, 2023
    Messages:
    448
    Likes Received:
    283
    ive been using stem splitters, then audio to midi and replacing everything lol
     
    • Like Like x 2
    • Funny Funny x 2
    • Useful Useful x 1
    • List
  7. Lieglein

    Lieglein Audiosexual

    Joined:
    Nov 23, 2018
    Messages:
    969
    Likes Received:
    553
    So you first want to use ai tools, and then fix the outcome? :unsure:
     
  8. curtified

    curtified Rock Star

    Joined:
    Feb 3, 2015
    Messages:
    650
    Likes Received:
    441
    Yes per my original message above. I want to improve the audio quality of the current state of AI audio outputs.
     
  9. clone

    clone Audiosexual

    Joined:
    Feb 5, 2021
    Messages:
    6,789
    Likes Received:
    2,965
    This is great for fixing mixes and making alternate mixes. Obviously for remixes, too; but that is just to get starting samples. For fixing mixes it is extremely helpful. You are either almost re-tracking the parts, or just supplementing and backing them up. In Logic, you create a duplicate of the track, press E to open wave editor, analyze the audio for flex editing, switch it to Flex Pitch and then Create Midi Track from Flex Pitch Data. Load your new instrument on that new track and you are ready to go. It takes less time than it did for me to type this. (after separation). I'm not using Logic 11 yet.
     
  10. curtified

    curtified Rock Star

    Joined:
    Feb 3, 2015
    Messages:
    650
    Likes Received:
    441
    Awesome! I use Rip-X, EZkeys, EZbass, even moises to convert to Midi from generated content.

    https://huggingface.co/spaces/Audio-AGI/AudioSep
    and
    https://tuanziai.com/en-US

    these are kind of cool for isolating just a spacific instrument in generated audio
     
  11. WillTheWeirdo

    WillTheWeirdo Audiosexual

    Joined:
    May 18, 2014
    Messages:
    471
    Likes Received:
    584
    Location:
    On the Beach
    I've found running ANYTHING the computer generates, especially the modern stem separated machine learning generated audio, through real tube hardware, it really adds to the audio in a very pleasing way. I've had good success with the Coil Audio 286a preamp in line mode (dialed in) and the Black Box HG-2 (the low setting with alt tubes shined) easily tame that fake digital top end and allow for the mid to be harmonically enhanced, thus becoming usable in modern song production.

    There was a noticeable before and after hitting the tubes, never have tubes shined more IMHO.
     
  12. curtified

    curtified Rock Star

    Joined:
    Feb 3, 2015
    Messages:
    650
    Likes Received:
    441
    thats genius! I bet those tube harmonics help soften and create some of that top end in a more natural way.. Ill try to sum through my dangerous D-box.. its the closest thing at my disposal right now
     
  13. Djord Emer

    Djord Emer Audiosexual

    Joined:
    Sep 12, 2021
    Messages:
    881
    Likes Received:
    712
    No really a solution to your problem but I find that people don't really notice the typical AI artifacts, I've experimented in some gigs and people were for the most part completely unaware.
     
  14. clone

    clone Audiosexual

    Joined:
    Feb 5, 2021
    Messages:
    6,789
    Likes Received:
    2,965
    The "bandmate" function they added to EzKeys2 is very good. I'm usually fixing bass with the Midi channel so I use Modo Bass 2. For more complicated detection, Melodyne is apparently the preferred method by many people. I'm just not a big fan of the program itself. But they say it will do polyphonic detection, which is not something Logic is great for. EzKeys can still get some decent results from more complicated audio files.

    Melodyne seems to be preferred by people doing this stuff with guitar parts.
     
    Last edited: Jul 10, 2024
  15. COLLASOUL73

    COLLASOUL73 Noisemaker

    Joined:
    Jun 14, 2021
    Messages:
    6
    Likes Received:
    3
    After reading this I ran into the Techivation AI-Clarity Plugin..I also use Chirp with like you said hit or miss. Rob Papen UniMagic works too but probably the end result is too vivid in some cases but tends to be enough.
     
  16. curtified

    curtified Rock Star

    Joined:
    Feb 3, 2015
    Messages:
    650
    Likes Received:
    441
    Man thanks for suggesting AI-Clarity! this really helps fix the "boxieness" of the sound. Seems like UniMagic is adding some unison reverb delay space. Its now part of my clean up chain!
     
Loading...
Similar Threads - Tools Cleaning audio Forum Date
Plugin Alliance AAX - Legit Pro Tools - OSX - 2024 Mac / Hackintosh Tuesday at 8:45 AM
Where find pro tools session??? Pro Tools Jul 6, 2024
Subscriptions | Studio One+ Pro | Slate Digital | Output | Protools | Antares | Sonarworks Selling / Buying Jun 26, 2024
WTB Sylenth1 / Electra X (3) / Pro Tools Selling / Buying Jun 24, 2024
Checking Out: Beaufort by Orchestral Tools Software Reviews and Tutorials Jun 23, 2024
Loading...