Fine-Tune Your Music Generation with the sakemin/musicgen-fine-tuner Actions

24 Apr 2025
Fine-Tune Your Music Generation with the sakemin/musicgen-fine-tuner Actions

Integrating music generation capabilities into your applications has never been easier with the sakemin/musicgen-fine-tuner. This powerful set of Cognitive Actions allows developers to fine-tune MusicGen models using custom datasets, enabling the creation of unique musical compositions. With enhancements in controllability and efficiency, these actions allow infinite music generation, making them ideal for applications in entertainment, gaming, and content creation.

Prerequisites

Before you start using the Cognitive Actions, ensure you have:

  • An API key for accessing the Cognitive Actions platform.
  • Basic knowledge of how to make HTTP requests and handle JSON data.

Conceptually, authentication can typically be handled by passing your API key in the request headers.

Cognitive Actions Overview

Fine-Tune MusicGen Models

Description: Fine-tune MusicGen small, medium, and melody models using custom datasets. This action includes stereo model options and enhances controllability and efficiency, allowing for infinite music generation.

Category: music-generation

Input

The input schema for this action is detailed below. Here’s a practical example of the JSON payload needed to invoke the action:

{
  "topK": 250,
  "topP": 0,
  "prompt": "80s rock music with grunge bass, overdriven guitar and hard drum beats",
  "duration": 50,
  "audioInput": "https://replicate.delivery/pbxt/Ji88eCq8hjBvrVViys57a7PH8pZXHqKF3azoRa3Y6pgQx6OX/KeepItReal.mp3",
  "temperature": 1,
  "continuation": true,
  "audioOutputFormat": "wav",
  "guidanceIntensity": 3,
  "continuationEndTime": 8,
  "continuationStartTime": 0,
  "useMultiBandDiffusion": false,
  "audioNormalizationStrategy": "loudness"
}

Output

Upon successful execution, this action typically returns a URL to the generated audio file. For example:

https://assets.cognitiveactions.com/invocations/2e41aa06-b61e-4a46-acbd-380908ddc2d4/09eb28a5-0b85-41fb-9591-ea06c01525ec.wav

Conceptual Usage Example (Python)

Here’s how you might set up your request to execute the Fine-Tune MusicGen Models action using Python:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute" # Hypothetical endpoint

action_id = "edd87eb0-c1cb-446b-8c94-cbb66c3eea58" # Action ID for Fine-Tune MusicGen Models

# Construct the input payload based on the action's requirements
payload = {
    "topK": 250,
    "topP": 0,
    "prompt": "80s rock music with grunge bass, overdriven guitar and hard drum beats",
    "duration": 50,
    "audioInput": "https://replicate.delivery/pbxt/Ji88eCq8hjBvrVViys57a7PH8pZXHqKF3azoRa3Y6pgQx6OX/KeepItReal.mp3",
    "temperature": 1,
    "continuation": True,
    "audioOutputFormat": "wav",
    "guidanceIntensity": 3,
    "continuationEndTime": 8,
    "continuationStartTime": 0,
    "useMultiBandDiffusion": False,
    "audioNormalizationStrategy": "loudness"
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload} # Hypothetical structure
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this example, replace the placeholder YOUR_COGNITIVE_ACTIONS_API_KEY with your actual API key, and note how the action ID and payload are structured for the execution. Keep in mind that the endpoint URL is illustrative; you will use the actual endpoint provided by your service.

Conclusion

The sakemin/musicgen-fine-tuner Cognitive Actions provide an exciting opportunity for developers to fine-tune music generation models, enabling the creation of unique musical pieces tailored to specific styles and preferences. With the ability to customize parameters such as duration, input audio, and output format, you can generate high-quality music that suits your application's needs. Explore these actions further, and consider integrating them into your projects to elevate the musical experience for your users!

← Back to All Articles