music

Unlock Music Insights with All In One Music Structure Analysis

25 Apr 2025
Unlock Music Insights with All In One Music Structure Analysis

In the ever-evolving world of music technology, understanding the structure of audio files is essential for developers looking to create innovative applications. The "All In One Music Structure Analysis" service provides a suite of Cognitive Actions designed to analyze music tracks and extract valuable insights. By leveraging pretrained models, this service simplifies the process of identifying song structures, beats per minute (BPM), downbeats, and much more. It also offers the flexibility to save additional outputs such as demuxed audio files, visualizations, and embeddings, enhancing the analytical capabilities for music developers.

Imagine being able to dissect a song's structure effortlessly or generate audio visualizations for a music app. Whether you're building a music recommendation system, creating educational tools for music theory, or developing audio editing software, this service allows you to integrate advanced music analysis into your projects quickly and efficiently.

Prerequisites

To get started, you'll need a Cognitive Actions API key and a basic understanding of how to make API calls.

Analyze Music Structure

The "Analyze Music Structure" action is at the heart of this service. It analyzes audio files to determine their structure, BPM, and downbeats, while providing options to export various forms of data.

Purpose

This action solves the problem of understanding complex audio structures by providing developers with detailed insights into the musical elements of a track. By analyzing the audio, it enables applications to offer features like beat tracking, automatic tagging, and even music generation.

Input Requirements

The input for this action requires a JSON object that includes:

  • musicInput: A URI pointing to the audio file to be analyzed.
  • Optional boolean flags to save embeddings, activations, demuxed audio, sonifications, visualizations, and to include embeddings or activations in the results.
  • A selection of a pretrained model name to utilize for the analysis.

Example Input:

{
  "musicInput": "https://replicate.delivery/pbxt/Ls92GQNYoMhPtSQAaWQLHSjsJP9BGMvzEln6phzPPQR8R2HY/way%20low%20-%20can%27t%20do%20it%20on%20my%20own.mp3",
  "saveEmbeddings": false,
  "saveActivations": false,
  "saveDemuxedAudio": true,
  "includeEmbeddings": false,
  "saveSonifications": false,
  "includeActivations": false,
  "saveVisualizations": true,
  "pretrainedModelName": "harmonix-all"
}

Expected Output

The expected output will include a collection of links to various analysis results, such as:

  • A JSON file with detailed analysis data.
  • Visualization images that represent the audio structure.
  • Separate audio tracks if the demuxed audio option is enabled.

Example Output:

[
  "https://assets.cognitiveactions.com/invocations/d233c954-8678-4516-8d56-b04025dc7fc6/2b7babe9-b7b1-4127-8aa5-60f4759e59ce.json",
  "https://assets.cognitiveactions.com/invocations/d233c954-8678-4516-8d56-b04025dc7fc6/bc0eef32-ddbd-413c-a590-e789d8e5eb53.png",
  "https://assets.cognitiveactions.com/invocations/d233c954-8678-4516-8d56-b04025dc7fc6/e5eaddaf-a3b6-459d-917f-8c8eeb7d3fa0.wav",
  "https://assets.cognitiveactions.com/invocations/d233c954-8678-4516-8d56-b04025dc7fc6/a64b6933-91aa-4089-ae3e-4ddabbd82fcc.wav",
  "https://assets.cognitiveactions.com/invocations/d233c954-8678-4516-8d56-b04025dc7fc6/64196093-6d50-4e60-8b0e-03492e2040e1.wav",
  "https://assets.cognitiveactions.com/invocations/d233c954-8678-4516-8d56-b04025dc7fc6/970e1485-0fd5-4a53-8f89-6a1b52120d3e.wav"
]

Use Cases for this Action

  • Music Education: Develop applications that teach users about song structures and music theory fundamentals by visualizing audio analysis results.
  • Audio Editing: Create software that automatically analyzes tracks to assist editors in identifying sections of music, making it easier to cut or mix tracks.
  • Music Recommendation: Integrate insights from the analysis into recommendation engines that suggest tracks based on structural similarities.
  • Music Production: Help producers quickly analyze and visualize tracks to enhance their creative process.

```python
import requests
import json

# Replace with your actual Cognitive Actions API key and endpoint
# Ensure your environment securely handles the API key
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
# This endpoint URL is hypothetical and should be documented for users
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"

action_id = "66cf2a08-287a-46b6-9920-cdb690e788d6" # Action ID for: Analyze Music Structure

# Construct the exact input payload based on the action's requirements
# This example uses the predefined example_input for this action:
payload = {
  "musicInput": "https://replicate.delivery/pbxt/Ls92GQNYoMhPtSQAaWQLHSjsJP9BGMvzEln6phzPPQR8R2HY/way%20low%20-%20can%27t%20do%20it%20on%20my%20own.mp3",
  "saveEmbeddings": false,
  "saveActivations": false,
  "saveDemuxedAudio": true,
  "includeEmbeddings": false,
  "saveSonifications": false,
  "includeActivations": false,
  "saveVisualizations": true,
  "pretrainedModelName": "harmonix-all"
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json",
    # Add any other required headers for the Cognitive Actions API
}

# Prepare the request body for the hypothetical execution endpoint
request_body = {
    "action_id": action_id,
    "inputs": payload
}

print(f"--- Calling Cognitive Action: {action.name or action_id} ---")
print(f"Endpoint: {COGNITIVE_ACTIONS_EXECUTE_URL}")
print(f"Action ID: {action_id}")
print("Payload being sent:")
print(json.dumps(request_body, indent=2))
print("------------------------------------------------")

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json=request_body
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully. Result:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body (non-JSON): {e.response.text}")
    print("------------------------------------------------")



## Conclusion
The "All In One Music Structure Analysis" service offers powerful tools for understanding and manipulating music data. By integrating these Cognitive Actions, developers can create innovative applications that enhance user engagement and provide deep insights into music. Whether you're developing tools for education, production, or recommendation, this service can streamline your processes and unlock new possibilities in music technology. Start exploring these powerful actions today and elevate your music-related projects to the next level!
← Back to All Articles