Platforms for using AI to make plugins/synths

Discussion in 'Ai for Music' started by Reploid, Jul 20, 2026 at 6:31 AM.

  1. Reploid

    Reploid Noisemaker

    Joined:
    Apr 18, 2016
    Messages:
    19
    Likes Received:
    4
    Someone recently linked to these two platforms which let people use LLMs to build and modify plugins:

    https://patchwerk.dev

    https://artistsindsp.com

    Can't speak to the quality or utility of either of them, but this sort of thing seems like it could at least in theory become an interesting new field. Is anyone aware of any other systems like these?
     
  2.  
  3. flier0244

    flier0244 Ultrasonic

    Joined:
    Jan 25, 2026
    Messages:
    76
    Likes Received:
    33
    I don't know what OS you're using.

    - Choose your AI model(s) as your backend (keep it local and open-source if your system is capable. If your system isn't capable, then you pay for cloud-based access.)

    - Choose your frontend (PowerShell, VS Code, or something else.)

    There are too many options to list.

    If you're interested in trying it, just wrap your head around those two fundamentals (backend/frontend) and then start investigating to form your own preferences.
     
  4. Obineg

    Obineg Rock Star

    Joined:
    Dec 7, 2020
    Messages:
    1,140
    Likes Received:
    381
    i will never get why it could be interesting to let others do the work and then pretend you had made something.
    furthermore, why make something which existed before already? isn´t it far more interesting to make something completely new? with custom ideas and custom code?
     
  5. shinyzen

    shinyzen Audiosexual

    Joined:
    Sep 28, 2023
    Messages:
    1,706
    Likes Received:
    1,013
    you can make something new, with custom ideas and code using coding agents.
     
    • Like Like x 2
    • Agree Agree x 1
    • Love it! Love it! x 1
    • List
  6. Obineg

    Obineg Rock Star

    Joined:
    Dec 7, 2020
    Messages:
    1,140
    Likes Received:
    381
    unfortunately that is not what people do.
     
  7. flier0244

    flier0244 Ultrasonic

    Joined:
    Jan 25, 2026
    Messages:
    76
    Likes Received:
    33
    Tell me you're being ignorant without telling me you're being ignorant.

    Do yourself a favor... Stop commenting on AI-related posts until you've gained some firsthand experience.
     
  8. Obineg

    Obineg Rock Star

    Joined:
    Dec 7, 2020
    Messages:
    1,140
    Likes Received:
    381
    everyone can tell that from the software which has been published.
     
  9. manicmazda

    manicmazda Noisemaker

    Joined:
    Aug 31, 2013
    Messages:
    10
    Likes Received:
    3
    Claude inside of VS Code is a pretty powerful setup for creating your own plugins and with some gentle persuasion can even be used to reverse engineer old plugins and port them to modern, cross-platform JUCE versions.
     
    • Like Like x 1
    • Interesting Interesting x 1
    • List
  10. Reploid

    Reploid Noisemaker

    Joined:
    Apr 18, 2016
    Messages:
    19
    Likes Received:
    4
    OP here. To be clear, I already know how to make/modify VSTs with LLMs. I make tons of software at work and at home with Claude Code and Codex CLI. I am just interested in compiling lists of these new platforms, because they're interesting concepts and might offer a way for tens of thousands of beginners to create their own plugins.
     
  11. flier0244

    flier0244 Ultrasonic

    Joined:
    Jan 25, 2026
    Messages:
    76
    Likes Received:
    33
    What's your experience with Claude/Codex? I use Grok Build/PowerShell, which is generally good; however, I had encountered reasoning issues before the 4.5 update. How's the cost? I'm paying $30 USD per month for SuperGrok. I would love to use SuperGrok Heavy, but the jump in price is freaking huge!

    I'm keen to have a go at this new Kimi K3, but I'm not rushing... I'm sure you know how it is... The next latest and greatest model is always just around the corner, haha. It's never-ending.
     
    Last edited: Jul 21, 2026 at 3:39 AM
  12. Utada Hikaru

    Utada Hikaru Producer

    Joined:
    Dec 8, 2015
    Messages:
    175
    Likes Received:
    114
    Maybe I can finally create a Sampler that has all the features I always wanted, and can support old, legacy sample formats, as well as audio files. :bleh:
     
  13. Poiuy

    Poiuy Ultrasonic

    Joined:
    Oct 3, 2020
    Messages:
    66
    Likes Received:
    39
    Aside from generating AI slop to make a quick buck - like another "most analog EQ of all analog EQs which you can't live without" - there are other much more interesting AI uses for coding. People who work in some professional field often face real-life problems which have never been properly addressed just because that people who can actually code stuff, even if they do have some idea of this professional field, have no idea about those problems you can only face once you're deep into this field. And it's quite rare that you're deep into two professional fields at once - can program plus do audio. That's why there are collaboration between producers and programmers to address a problem producer faces by the mean of good programmer who does what he told. Now you don't need to be a famous producer in order to address your own problem or enhance the workflow - instead of searching for a programmer to implement your idea you implement it yourself with the help of AI. Along with the slop I'm sure there will be surge of fresh ideas too. For instance, it took me about 30 minutes including installing Visual Studio, to write a vst that addresses a problem I've been having with my DAW for ages. Granted, not everyone thought of it as a problem, probably not enough people asked the developers to fix it and it was just my particular problem after all. Nevertheless it took me 30 freaking minutes and zero budget to solve it without any code knowledge.
     
  14. ELJUNTADERO2022

    ELJUNTADERO2022 Platinum Record

    Joined:
    Jun 10, 2022
    Messages:
    582
    Likes Received:
    188
    Thissss, please if u use AI for creating, CREATE SOMETHING USEFUL AND STOP FLOOD WITH AI SLOP, if u r having those ideas (i referred "u" as the person who read this and think about this not u directly Obineg hehe) :P
    THIS is interesting!! and useful way to use AI. love it
     
  15. tzzsmk

    tzzsmk Audiosexual

    Joined:
    Sep 13, 2016
    Messages:
    4,583
    Likes Received:
    2,865
    Location:
    Heart of Europe
    VS Code with "Continue" (AI) plugin and mix of local/online AI LLM backends connected is probably all you need
     
  16. flier0244

    flier0244 Ultrasonic

    Joined:
    Jan 25, 2026
    Messages:
    76
    Likes Received:
    33
    I sometimes fire-up Grok and ask it to monitor my system behavior and report any issues. It informs me and has been helpful.

    The writing is on the wall. Anyone with a bit of firsthand experience can see where this is headed... I'd love to test an AI-generated Operating System.

    Akin to a 3D printer, we'll be generating disposable apps to serve a temporary purpose... a function.
     
    Last edited: Jul 21, 2026 at 4:01 PM
  17. canbi

    canbi Producer

    Joined:
    Jun 12, 2023
    Messages:
    294
    Likes Received:
    77
Loading...
Similar Threads - Platforms using plugins Forum Date
platforms for donations Internet for Musician Feb 19, 2026
Different audio quality on different music platforms Working with Sound Jan 24, 2026
Navigating Equity Management Platforms – Best Practices? Software Oct 29, 2025
streaming platforms / distributors / streaming your own music Lounge Feb 18, 2023
Perceived Loudness|Mastering For platforms|Clarity|Gain Staging Education Oct 22, 2021
Loading...