Polymath
Polymath uses machine learning to convert any music library (e.g from Hard-Drive or YouTube) into a music production sample-library. The tool automatically separates songs into stems (beats, bass, etc.), quantizes them to the same tempo and beat-grid (e.g. 120bpm) and analyzes musical structure (e.g. verse, chorus, etc.), key (e.g C4, E3, etc.) and other infos (timbre, loudness, etc.). The result is a searchable sample library that streamlines the workflow for music producers, DJs, and ML audio developers.



Use-cases
Polymath makes it effortless to combine elements from different songs to create unique new compositions: Simply grab a beat from a Funkadelic track, a bassline from a Tito Puente piece, and fitting horns from a Fela Kuti song, and seamlessly integrate them into your DAW in record time. Using Polymath's search capability to discover related tracks, it is a breeze to create a polished, hour-long mash-up DJ set. For ML developers, Polymath simplifies the process of creating a large music dataset, for training generative models, etc.

How does it work?

• Music Source Separation is performed with the Demucs neural network
• Music Structure Segmentation/Labeling is performed with the sf_segmenter neural network
• Music Pitch Tracking and Key Detection are performed with Crepe neural network
• Music Quantization and Alignment are performed with pyrubberband
• Music Info retrieval and processing is performed with librosa

More info:
https://github.com/samim23/polymath

 

Very interesting, how can we see this working?

 

Hope they develop this into an easy to use app. Anyway simple way to work this out without getting into code ?

 

Since I suck on coding and know very little about it, but how much effort would it need to make an app with UI from this.

 

Ive seen a lot of ai stuff like this... where its code based. You would think someone intelligent enough to create some crazy stuff like this would also be able to make a ui or know someone who could make a ui... its interesting

 

A glorified sample slicer. Not impressed

PS. Just joking, don't kill me

 

I could not get this to work.. syntax error or something when trying to install.
Is the docker thing easier to manage?

 

Just to let you. I talked with the developer in discord and he said that there will be non-tech/coder version of this in the near future