TuneFlow is a next-gen DAW that aims to boost music making productivity through the power of AI. Unlike traditional DAWs, TuneFlow has a plugin system designed to facilitate music production in almost all areas, including but not limited to song writing, arrangement, automation, mixing, transcription...... You can easily write your own algorithms or integrate your AI models directly into the song-making process. tuneflow-py is the Python SDK of TuneFlow plugins.
pip install tuneflow-pyCheck out the SDKs in other languages:
- Typescript: https://www.github.com/tuneflow/tuneflow
- Other: Contributions welcome!
The core idea of TuneFlow's plugin system is that you only care about the data model, NOT the implementation. A plugin's only goal is to modify the song, and the DAW will apply the changes automatically.
Unlike traditional DAW plugins where you can only process MIDI/audio signals from one track, this plugin system allows you to access and modify any part of the project, which is perfect for integrating complex algorithms and AI models.
What's more exciting is that this execution model allows remote processing, which means you can write and test your plugin locally and deploy it anywhere you like, and the DAW can run your plugin through simple network requests.
Below is an illustration of the plugin execution flow:
Visit https://help.tuneflow.com/en/developer for developer documentation.
Generate speech, sound effects, music and more from text prompt.
Repo: https://github.com/tuneflow/AudioLDM
Transcribe a singing vocal from audio to MIDI. Works with background noise or music.
Repo: https://github.com/tuneflow/singing-transcription-plugin
Separate a raw music audio clip into vocal, drums, bass and others.
Repo：https://github.com/tuneflow/tuneflow-plugin-demucs
Generate a drum pattern with the given style and optionally a melody midi.
Repo: To be updated.
For a comprehensive of example plugins, check out https://www.github.com/tuneflow/tuneflow-py-demos
Checkout contribution guidelines.