video-generation

Create Stunning Videos with Stable Diffusion's Mo-Di Action

26 Apr 2025
Create Stunning Videos with Stable Diffusion's Mo-Di Action

In the realm of video generation, the "Stable Diffusion Videos Mo Di" service opens up exciting possibilities for developers looking to create dynamic and visually appealing content. Utilizing the innovative Mo-Di Diffusion model, this service allows for the interpolation of video frames, enabling smooth transitions between different prompts or variations of a single prompt. This capability not only enhances creativity but also offers significant time savings by automating the video creation process.

Imagine a scenario where you want to create a video that transitions from a serene landscape of a cat to an energetic scene featuring a dog. With the Mo-Di Diffusion action, you can effortlessly generate such a video, providing a visually rich experience that captivates viewers. Whether for marketing campaigns, educational content, or artistic projects, the potential applications are vast.

Prerequisites

To get started, you'll need a Cognitive Actions API key and a basic understanding of making API calls.

Generate Interpolated Videos with Mo-Di Diffusion

The "Generate Interpolated Videos with Mo-Di Diffusion" action offers a powerful way to create videos by interpolating between prompts. It addresses the challenge of producing smooth and coherent video transitions, allowing developers to control the output with precision.

Input Requirements

  • Random Seeds: Specify random seeds separated by '|'. Each seed corresponds to a prompt. Leave empty to randomize seeds.
  • Input Prompts: Specify input prompts separated by '|'. For example, "modern disney (kitty cat) | modern disney (puppy dog)".
  • Guidance Scale: A classifier-free guidance scale for image generation, ranging from 1 to 20, with a default of 7.5.
  • Number of Steps: The total steps for video generation. Recommended: 3-5 for testing or 60-200 for quality results. Default is 50.
  • Scheduler Type: Options include 'default', 'ddim', and 'klms', with 'klms' as the default.
  • Frames Per Second: The frame rate for video output, ranging from 5 to 60 fps, with a default of 15 fps.
  • Number of Inference Steps: Denoising steps used per image from prompts, ranging from 1 to 500, with a default of 50.

Expected Output

The output is a video file URL, providing a seamless viewing experience of the generated content. For instance, a typical output may look like this: https://assets.cognitiveactions.com/invocations/30e6d861-f269-4665-a628-9d3d3f5a28e1/42feb001-2248-4bf4-98e7-de9dc6b545c3.mp4.

Use Cases for this Specific Action

  • Creative Storytelling: Develop captivating narratives by smoothly transitioning between scenes or subjects.
  • Marketing and Advertising: Create engaging promotional videos that highlight different product features or scenarios.
  • Educational Content: Produce instructional videos that visually explain concepts through dynamic transitions.
  • Artistic Projects: Explore artistic expressions by merging various visual styles or themes into a cohesive video.

```python
import requests
import json

# Replace with your actual Cognitive Actions API key and endpoint
# Ensure your environment securely handles the API key
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
# This endpoint URL is hypothetical and should be documented for users
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"

action_id = "dae75a43-e151-436a-896a-30432647eeda" # Action ID for: Generate Interpolated Videos with Mo-Di Diffusion

# Construct the exact input payload based on the action's requirements
# This example uses the predefined example_input for this action:
payload = {
  "randomSeeds": "1 | 2",
  "inputPrompts": "  modern disney (kitty cat) | modern disney (puppy dog)",
  "guidanceScale": 7.5,
  "numberOfSteps": 100,
  "schedulerType": "klms",
  "framesPerSecond": 15,
  "numberOfInferenceSteps": 50
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json",
    # Add any other required headers for the Cognitive Actions API
}

# Prepare the request body for the hypothetical execution endpoint
request_body = {
    "action_id": action_id,
    "inputs": payload
}

print(f"--- Calling Cognitive Action: {action.name or action_id} ---")
print(f"Endpoint: {COGNITIVE_ACTIONS_EXECUTE_URL}")
print(f"Action ID: {action_id}")
print("Payload being sent:")
print(json.dumps(request_body, indent=2))
print("------------------------------------------------")

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json=request_body
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully. Result:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body (non-JSON): {e.response.text}")
    print("------------------------------------------------")



## Conclusion
The "Stable Diffusion Videos Mo Di" service transforms the landscape of video generation by enabling developers to create stunning interpolated videos with ease. By harnessing this powerful action, you can save time, enhance creativity, and produce high-quality content for a wide array of applications. As you explore this tool, consider the diverse use cases and how they can elevate your projects. Start integrating the Mo-Di Diffusion action today and unlock new possibilities in video creation!
← Back to All Articles