audio-processing

Effortlessly Separate Music Stems with MVSEP-MDX23

25 Apr 2025
Effortlessly Separate Music Stems with MVSEP-MDX23

The MVSEP-MDX23 Music Separation service provides developers with a powerful tool for audio processing, enabling the separation of music tracks into individual components, such as bass, drums, vocals, and other elements. This capability is crucial for various applications, including remixing, music production, and audio analysis. By utilizing advanced models, like Demucs4 and MDX, which ranked among the top in the Sound Demixing Challenge 2023, the service ensures high-quality stem separation optimized for performance, even on limited GPU resources.

Imagine a scenario where you are a music producer looking to create a remix of a popular song. Instead of starting from scratch, you can use MVSEP-MDX23 to extract individual stems from the original track. This not only speeds up your workflow but also allows for greater creativity and flexibility in your music projects. Whether you're a content creator needing isolated vocals for a video or an audio engineer working on a film score, the potential applications are vast and varied.

Perform Music Stem Separation

The "Perform Music Stem Separation" action is designed to break down a mixed audio file into its constituent parts, providing you with four distinct stems: bass, drums, vocals, and 'other'. This separation allows for a detailed analysis and manipulation of individual components, which is essential for high-quality audio production and remixing.

Input Requirements:
To utilize this action, you must provide an audio file in a valid URI format. For instance, your input might look like this:

{
  "audioUri": "https://replicate.delivery/pbxt/KZKv1lisix73ys7wSl8Uj7d9dhGBHYAf8YKrLA6aiZMzgVwR/day-of-sun-clip.wav"
}

Expected Output:
Upon processing, you will receive multiple audio files corresponding to each stem. The output will include separate audio files for bass, drums, vocals, and other elements. Here’s what you can expect:

  • Bass Stem: Link to bass audio
  • Drums Stem: Link to drums audio
  • Vocals Stem: Link to vocals audio
  • Other Elements Stem: Link to other audio

This allows you to have complete control over each component of the track, making it easier to mix, remix, or analyze the music.

Use Cases for this specific action:

  • Music Production: Producers can extract stems from existing tracks to create new remixes or mashups.
  • Audio Analysis: Analysts can isolate specific elements of a track for detailed examination, such as studying the frequency response of vocals versus instruments.
  • Content Creation: Video editors can pull vocals or instrumental sections for background scores without needing to source additional music.
  • Live Performance: Musicians can use separated stems for live remixes, enhancing their performance with real-time audio manipulation.
import requests
import json

# Replace with your actual Cognitive Actions API key and endpoint
# Ensure your environment securely handles the API key
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
# This endpoint URL is hypothetical and should be documented for users
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"

action_id = "b6c2a003-0bb5-4016-b647-04e56c33c741" # Action ID for: Perform Music Stem Separation

# Construct the exact input payload based on the action's requirements
# This example uses the predefined example_input for this action:
payload = {
  "audioUri": "https://replicate.delivery/pbxt/KZKv1lisix73ys7wSl8Uj7d9dhGBHYAf8YKrLA6aiZMzgVwR/day-of-sun-clip.wav"
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json",
    # Add any other required headers for the Cognitive Actions API
}

# Prepare the request body for the hypothetical execution endpoint
request_body = {
    "action_id": action_id,
    "inputs": payload
}

print(f"--- Calling Cognitive Action: {action.name or action_id} ---")
print(f"Endpoint: {COGNITIVE_ACTIONS_EXECUTE_URL}")
print(f"Action ID: {action_id}")
print("Payload being sent:")
print(json.dumps(request_body, indent=2))
print("------------------------------------------------")

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json=request_body
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully. Result:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body (non-JSON): {e.response.text}")
    print("------------------------------------------------")

Conclusion

The MVSEP-MDX23 Music Separation service offers a seamless way to extract individual music stems, empowering developers and creators with the tools necessary for innovative audio production. By utilizing this service, you can enhance your projects with high-quality audio manipulation and analysis capabilities. As you explore these actions further, consider how they can streamline your workflow and elevate your audio projects to new heights. Start integrating music separation into your applications today to unlock new creative possibilities!

← Back to All Articles