video-generation

Transform Static Images into Dynamic Videos with Wan2.1

26 Apr 2025
Transform Static Images into Dynamic Videos with Wan2.1

In the rapidly evolving landscape of visual content creation, the ability to turn static images into dynamic videos presents a significant advantage for developers and creators alike. The "Wan2.1 With Lora" service provides powerful Cognitive Actions that enable this transformation seamlessly. By leveraging the advanced capabilities of the Wan2.1 model, developers can generate high-quality videos from images, offering a new dimension to storytelling, marketing, and content creation.

With the flexibility to choose between faster generation and higher quality through different model versions, as well as the option to apply custom effects with LORA, this service simplifies the video creation process. Common use cases include creating animated promotional content, enhancing educational materials, or generating engaging social media posts that capture audience attention.

Prerequisites

To get started with the Wan2.1 Cognitive Actions, you'll need an API key for the Cognitive Actions service and a basic understanding of API calls to integrate these powerful capabilities into your applications.

Generate Video from Image with Wan2.1 and Lora

This action utilizes the Wan2.1 model to transform a static image into a dynamic video. The service supports two model versions, 14b for higher quality and 1.3b for faster generation, allowing developers to select the best fit for their needs. Additionally, LORA can be applied to introduce custom effects, further enhancing the generated video.

Input Requirements

The action requires a structured input with the following parameters:

  • prompt: A text description that guides the content and style of the video (e.g., "flat color 2d animation of a portrait of woman with white hair and green eyes, dynamic scene").
  • image: The URI of the starting image for video generation.
  • frameCount: The number of frames to generate, which corresponds to approximately 1 to 5 seconds of video.
  • modelVersion: Specifies which model version to use (1.3b or 14b).
  • loraLink: An optional URL for a LORA model file to influence the video generation.
  • videoResolution: Chooses between 480p and 720p resolution.
  • videoAspectRatio: Sets the aspect ratio for the video output.
  • guideScale, samplingShift, generationSteps, loraClipIntensity, and loraModelIntensity: Additional parameters that fine-tune the generation process.

Expected Output

The expected output is a URL linking to the generated video file, allowing for immediate use or further manipulation. For example, a successful output might look like:

  • https://assets.cognitiveactions.com/invocations/dbcc532a-c791-49b4-b767-6ef7592fe241/ee31b547-455d-4c37-9b8c-a9f43a2a946b.mp4

Use Cases for this Specific Action

  • Marketing and Advertising: Create animated ads that can captivate viewers and deliver messages more dynamically.
  • Education: Develop engaging educational videos that can bring concepts to life, facilitating better understanding and retention.
  • Social Media Content: Generate eye-catching videos for social media platforms that increase engagement rates and attract followers.

```python
import requests
import json

# Replace with your actual Cognitive Actions API key and endpoint
# Ensure your environment securely handles the API key
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
# This endpoint URL is hypothetical and should be documented for users
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"

action_id = "83d8729b-901b-4a17-a405-503c307139d5" # Action ID for: Generate Video from Image with Wan2.1 and Lora

# Construct the exact input payload based on the action's requirements
# This example uses the predefined example_input for this action:
payload = {
  "prompt": "flat color 2d animation of a portrait of woman with white hair and green eyes, dynamic scene",
  "loraLink": "https://huggingface.co/motimalu/wan-flat-color-v2/resolve/main/wan_flat_color_v2.safetensors",
  "frameCount": 81,
  "guideScale": 5,
  "modelVersion": "14b",
  "samplingShift": 8,
  "generationSteps": 30,
  "videoAspectRatio": "16:9",
  "loraClipIntensity": 1,
  "loraModelIntensity": 1
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json",
    # Add any other required headers for the Cognitive Actions API
}

# Prepare the request body for the hypothetical execution endpoint
request_body = {
    "action_id": action_id,
    "inputs": payload
}

print(f"--- Calling Cognitive Action: {action.name or action_id} ---")
print(f"Endpoint: {COGNITIVE_ACTIONS_EXECUTE_URL}")
print(f"Action ID: {action_id}")
print("Payload being sent:")
print(json.dumps(request_body, indent=2))
print("------------------------------------------------")

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json=request_body
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully. Result:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body (non-JSON): {e.response.text}")
    print("------------------------------------------------")



## Conclusion
The Wan2.1 With Lora service offers an innovative way for developers to create compelling video content from static images effortlessly. By understanding the various parameters and capabilities of the "Generate Video from Image" action, developers can unlock a range of creative possibilities, from marketing to education and beyond. The next step is to experiment with this powerful tool, integrating it into your projects and exploring its full potential to enhance your visual storytelling.
← Back to All Articles