The "delossyfiers" advent

Discussion in 'Ai for Music' started by forart.it, Apr 24, 2025.

  1. forart.it

    forart.it Kapellmeister

    Joined:
    May 5, 2023
    Messages:
    87
    Likes Received:
    49
    As a computer tech and audio enthusiast, I have been interested in the so-called "Artificial Intelligences" (actually machine learning and transformers, nowdays) and I have collected some interesting free/open resources for the HyMPS project in the AUDIO section \ AI-based page.

    Among these, in the Enhancers subsection, I had collected some self-called "restorers" that have - through statistical inference - the goal to regenerate close-to-lossless from compressed audio files (e.g. MP3).

    For some time I was relatively uninterested in them (in the meantime I helped an Intel engineer choose which upscaler to bring into their OpenVINO™ AI Plugins for Audacity) but recently I discovered that Apollo models has obtained quite interesting qualitative results:
    [​IMG]
    [​IMG]

    This model - named MP3 restore - has been trained to "delossify" < 128Kbps sources and can be tested here:

    - https://huggingface.co/spaces/patriotyk/Apollo
    - https://colab.research.google.com/g...lob/main/Apollo_Audio_Restoration_Colab.ipynb

    ...it would be very interesting to organize a so-called "blind test" (in addition to a null one of course) to fully understand its effectiveness in relation to various musical genres.
     
    • Interesting Interesting x 10
    • Like Like x 3
    • Useful Useful x 1
    • List
  2.  
  3. paul_audioz

    paul_audioz Kapellmeister

    Joined:
    Feb 21, 2023
    Messages:
    155
    Likes Received:
    62
    I always admire people explaining new things. Unfortunately I don't have a clue what this is about, but thank you for trying!
     
    • Funny Funny x 7
    • Agree Agree x 1
    • List
  4. stopped

    stopped Platinum Record

    Joined:
    Mar 22, 2016
    Messages:
    741
    Likes Received:
    278
    some of my favorite music was only ever released in 128 (or 24 even :snuffy:) so this is interesting to me, thanks!
     
  5. Shiori Oishi

    Shiori Oishi Platinum Record

    Joined:
    Oct 21, 2023
    Messages:
    490
    Likes Received:
    275
    Will I live long enough to witness Aja-quality 1970s afro-rock?
     
  6. ddpp

    ddpp Member

    Joined:
    Dec 11, 2021
    Messages:
    28
    Likes Received:
    11
    Thanks for sharing.

    Excited to try this on 64kbps punk and hardcore.
     
    Last edited: Jun 23, 2025 at 8:20 AM
  7. forart.it

    forart.it Kapellmeister

    Joined:
    May 5, 2023
    Messages:
    87
    Likes Received:
    49
    • Like Like x 1
    • Interesting Interesting x 1
    • List
  8. forart.it

    forart.it Kapellmeister

    Joined:
    May 5, 2023
    Messages:
    87
    Likes Received:
    49
    AudioSR and Delossifier null test comparison:
    [​IMG]
     
  9. ArticStorm

    ArticStorm Moderator Staff Member

    Joined:
    Jun 7, 2011
    Messages:
    8,294
    Likes Received:
    4,324
    Location:
    AudioSexPro
    i am wondering if we ever will be able to restore after stem separation the fuzzy tails, basically that part of the audio, which got lost due to interferences in the mix itself. If we could, there would be perfect stems possible, in studio quality.
    (It feels like this is similar to how delossyfiers might work? or i am mistake?)

    still impressive that its possible to add quality loss back ...
     
  10. Skaunker

    Skaunker Kapellmeister

    Joined:
    Apr 3, 2015
    Messages:
    82
    Likes Received:
    45
    [​IMG]
     
  11. Legotron

    Legotron Audiosexual

    Joined:
    Apr 24, 2017
    Messages:
    2,329
    Likes Received:
    2,243
    Location:
    Hyperborea
    I tried it on 1901 wax cylinder recording(40kbps/22kHz) and other (64kbps/22kHz) mp3
    And it did not work at all, probably trained with higher bitrates
     
    • Interesting Interesting x 2
    • Useful Useful x 1
    • List
  12. Dom_Perignon

    Dom_Perignon Kapellmeister

    Joined:
    Mar 17, 2025
    Messages:
    110
    Likes Received:
    50
    Interesting! Thanks for this "so called" infos
     
  13. Smeghead

    Smeghead Audiosexual

    Joined:
    Jun 25, 2024
    Messages:
    1,368
    Likes Received:
    679
    I started reading this post and I thought you were joking but then I realized you're not, are you! If it had worked I would definitely have wanted to hear what that sounded like.
    Are we talking about the kind of stuff that Peter Jackson was using to restore dialogue for the Get Back documentary? I don't have a leg up on this kind of tech at all yet.
     
  14. canbi

    canbi Kapellmeister

    Joined:
    Jun 12, 2023
    Messages:
    189
    Likes Received:
    61
    its not lossy
     
  15. ClarSum

    ClarSum Kapellmeister

    Joined:
    Aug 24, 2023
    Messages:
    108
    Likes Received:
    54
    For those not interested in using gcollab or hugginface, MVSEP added the Apollo models a while back and recently the AudioSR and FlashSR models. They also have an explanation of what they do with demos and user generated demos on their news page here or the direct links Apollo with demos and AudioSR/FlashSR info.

    @ArticStorm Had a similar thought to you, in that if it adds high end to compressed files let me try it on stems. I've run various types of separated stems through them and it varies depending on how useful the additional high end frequencies are, like additional transient info on drums and some vocal stems return added intelligibility.
    To further your point maybe the generative audio models could be good at re-synthesising missing content from isolated stems if given context. Suno and Udio already allow you to remix or extend any uploaded audio, so maybe they could be tuned to focus on restoring missing info, just a thought.
     
    Last edited: Jun 24, 2025 at 12:38 AM
    • Interesting Interesting x 1
    • Love it! Love it! x 1
    • List
  16. ArticStorm

    ArticStorm Moderator Staff Member

    Joined:
    Jun 7, 2011
    Messages:
    8,294
    Likes Received:
    4,324
    Location:
    AudioSexPro
    @ClarSum thanks for looking at this. It is a question, which is in the back of mind since the early results i heard from AI Stem creation/separation.
    Maybe it might be integrated in the future, would further improve the whole method.
     
    • Agree Agree x 1
    • Interesting Interesting x 1
    • List
Loading...
Loading...