UVR5 the Best AI stem separation algo?

Discussion in 'Software' started by curtified, Feb 27, 2023.

  1. korgrog

    korgrog Member

    Joined:
    Sep 13, 2011
    Messages:
    185
    Likes Received:
    7
    I am not ranting ,I can usually figure these things out ,even on the other site, sometimes it takes a while but I can figure them out
    I have zero programming knowledge ,but I get there .This is the first time I have run into a situation where nothing works
    The latest from Colab
    /content/MVSEP-MDX23-Colab_v2
    GPU use: 0
    started!
    usage: inference.py [-h] --input_audio INPUT_AUDIO [INPUT_AUDIO ...] --output_folder OUTPUT_FOLDER
    [--cpu] [--overlap_demucs OVERLAP_DEMUCS] [--overlap_VOCFT OVERLAP_VOCFT]
    [--overlap_VitLarge OVERLAP_VITLARGE] [--overlap_InstVoc OVERLAP_INSTVOC]
    [--weight_InstVoc WEIGHT_INSTVOC] [--weight_VOCFT WEIGHT_VOCFT]
    [--weight_VitLarge WEIGHT_VITLARGE] [--single_onnx] [--large_gpu]
    [--BigShifts BIGSHIFTS] [--vocals_only VOCALS_ONLY] [--use_VOCFT USE_VOCFT]
    [--output_format OUTPUT_FORMAT]
    inference.py: error: argument --input_audio/-i: expected at least one argument

    I tried to install your run.bat on its own ,just opens in notepad ,ran it as administrator ,black screen pop up then disappears
    tried to run it in Python 3.12 always some error ,tried to run it in Colab always some error
    I have run a lot of, lets say different software on my machine ,if I do not trust it I make a complete backup first ,any time the install was
    doing something else ,,it would ether not run or seem to run a little messed up and infect my machine ,so you can understand my
    suspicion when nothing worked
    Now as to this mentality, this chastising inference, that permeates this site, I am just trying to get your program to work
    I appreciates the work you put into it ,I could not do it . I wish programmers after writing a program would go and get someone living
    In a refrigerator box, sit them down in front of a computer and say, run this program ,does it make sense to you ,can you go thru it in a
    understandable order, if they can then your program is a success. Programmers think like Programmers and Common sense is anything
    but common, If you have ever tried to teach anything to anybody you will learn that quickly ,,Common Sense, biggest load of BS ever
    pushed ,just like all the other BS we have to live thru
    Really wanted to try how good your work is ,,can not get it,, to work anywhere
     
    • Interesting Interesting x 1
    • List
  2. ALLinONE

    ALLinONE Newbie

    Joined:
    Mar 6, 2018
    Messages:
    3
    Likes Received:
    0
  3. deton24

    deton24 Member

    Joined:
    Jun 23, 2023
    Messages:
    9
    Likes Received:
    14
    You can find it in Download Center on the list of models.
     
  4. ALLinONE

    ALLinONE Newbie

    Joined:
    Mar 6, 2018
    Messages:
    3
    Likes Received:
    0
    Already figured out - there you need to enter the VIP code for additional models to appear.
     
  5. jarredou

    jarredou Guest


    There's no 'run.bat' in my fork:
    upload_2024-3-19_0-2-41.png



    -----------------
    "inference.py: error: argument --input_audio/-i: expected at least one argument"

    means you have not provided any audio input file to be separated by the script, so of course, the script can't work.


    PS: I'm not a programmer, it's not a business. I'm just a musician creating, maintaining nd updating all these musical-related colabs adaptations on my free time, for free, to be used for free, by anybody, with public source code and models. Thousands of people are using the Colab notebook without any problem and are getting their separated audio with a bunch of clicks. So, once again, stop your stupid rants against other people just because you make mistakes. You are also free to not use it if you don't like it.
     
    Last edited by a moderator: Mar 19, 2024
  6. jarredou

    jarredou Guest

    A new UVR beta has been released in Audio Separation discord with new models based on ByteDance's algo which was reproduced from scratched an open-sourced recently.

    Highest SDR score we've ever seen for vocals/instrumental stem.

    These models will be implemented in few days in upcoming update of my colab fork, with some other optimisations.

    They are also already available on mvsep.com & x-minus.pro (UVR-Online)
     
  7. Choosename

    Choosename Platinum Record

    Joined:
    Nov 24, 2023
    Messages:
    515
    Likes Received:
    216
    Location:
    Milky way
    Can you share the link?
     
  8. deton24

    deton24 Member

    Joined:
    Jun 23, 2023
    Messages:
    9
    Likes Received:
    14
    https://colab.research.google.com/g...23-Colab_v2/blob/v2.4/MVSep-MDX23-Colab.ipynb
    https://mvsep.com/
    https://x-minus.pro/

    https://github.com/TRvlvr/model_rep...UVR_Patch_3_29_24_5_11_BETA_full_roformer.exe

    In UVR use overlap 2 to alleviate some issues with clicking (increases separation time).
    OpenCL is not functional for BS-Roformer yet (so AMD/Intel GPUs acceleration).

    For more info, check the last entries in news section of:
    https://docs.google.com/document/d/17fjNvJzj8ZGSer7c7OFe_CNfUKbAxEh_OBv94ZdRG5c/
     
    • Like Like x 2
    • Agree Agree x 1
    • List
  9. ALLinONE

    ALLinONE Newbie

    Joined:
    Mar 6, 2018
    Messages:
    3
    Likes Received:
    0
    Is there any way to attach mel-roformer to uvr?
     
  10. GeekedGlitch

    GeekedGlitch Ultrasonic

    Joined:
    Jun 13, 2023
    Messages:
    94
    Likes Received:
    25
    Hey guys, sorry for probable off-topic:

    What is the best voice conversion AI currently? By that I mean models which you feed with some specific voice tracks, and after that it can convert some other voice into that first one

    I've heard really good musical implementations of that, is there any good guide on it? Thanks!
     
  11. Legotron

    Legotron Audiosexual

    Joined:
    Apr 24, 2017
    Messages:
    2,181
    Likes Received:
    2,113
    Location:
    Hyperborea
  12. Dyslexicon

    Dyslexicon Noisemaker

    Joined:
    Mar 19, 2023
    Messages:
    23
    Likes Received:
    4
    RVC is surely the best Modeler at the moment.
    >> Can anyone point me to a Colab where I can Train my own models with RVC and then apply them to target audio?
    I dont own an NVIDIA GPU so will need online processing if there is a working Colab.
     
  13. deton24

    deton24 Member

    Joined:
    Jun 23, 2023
    Messages:
    9
    Likes Received:
    14
  14. GoofGoober

    GoofGoober Newbie

    Joined:
    Sep 3, 2024
    Messages:
    1
    Likes Received:
    2
    Hey Deton I checked out ur google doc, couldnt find too much on separating electric guitar solos from backing electric guitar, i know its kind of a niche use case but any pointers here? thanks!
     
  15. GeekedGlitch

    GeekedGlitch Ultrasonic

    Joined:
    Jun 13, 2023
    Messages:
    94
    Likes Received:
    25
    Is it hard to train a model based on orchestra parts, such as different winds, different strings, choir, etc.?

    Probably will be much harder ,since in the orchestra recording director often uses main microphone pair (picking up the whole orchestra playing) not only as a reference, but also as a main source. So obtaining high quality separate stems (even of groups of instruments) without leakages would probably prove itself impossible.
     
  16. aleksalt

    aleksalt Producer

    Joined:
    Jul 1, 2013
    Messages:
    383
    Likes Received:
    105
    What about Intel OpenVINO AI for Audacity? Did one use it already?

     
  17. shinyzen

    shinyzen Rock Star

    Joined:
    Sep 28, 2023
    Messages:
    678
    Likes Received:
    455
    you could train on recordings of individual sections or soloist.
     
  18. Dyslexicon

    Dyslexicon Noisemaker

    Joined:
    Mar 19, 2023
    Messages:
    23
    Likes Received:
    4
    Is there a Colab with full Demucs4 functionality, ie --shifts, --overlap, etc sliders? That also can select the various Demucs4 models ie, htdemucs_ft, demucs_mmi, demucs_6s, etc?

    Need fine control over settings so UVR online and MVSEP.com arent gonna cut it.
    Big thanks to anyone who can point me to one.
    @Jarredou maybe you could add this to your master collection of models Colab if youre reading this :wink:
     
  19. zadiac

    zadiac Kapellmeister

    Joined:
    Jun 9, 2022
    Messages:
    123
    Likes Received:
    60
    It is better. Ripx just has additional functionality, but the stem separation is better in UVR. I have compared the two with various songs.
     
Loading...
Loading...