video-generation

Transform Text to Dynamic Video Content with Cognitive Actions

25 Apr 2025
Transform Text to Dynamic Video Content with Cognitive Actions

In the age of visual storytelling, the ability to convert text into engaging video content is a game-changer for developers and content creators alike. The "Text2video Zero Openjourney" service provides a powerful Cognitive Action that allows developers to generate realistic and dynamic video sequences from textual descriptions. By harnessing advanced techniques from text-to-image synthesis and motion dynamics, this service simplifies the video creation process, enabling rapid content generation without the need for extensive video editing skills.

Imagine the possibilities: creating promotional videos, educational content, or even animated stories, all from a simple text prompt. This service is ideal for marketers, educators, game developers, and anyone looking to enhance their visual content strategy.

Prerequisites

To get started with the Text2video Zero Openjourney service, you'll need a Cognitive Actions API key and a basic understanding of how to make API calls.

Generate Video from Text

The "Generate Video from Text" action is the heart of the Text2video Zero Openjourney service. It allows you to transform rich textual descriptions into coherent video narratives, making it easier to visualize ideas and concepts.

Purpose

This action utilizes the Picsart Text2Video-Zero model to convert written prompts into visually appealing video sequences. The innovative use of motion dynamics and cross-frame attention helps create seamless transitions and realistic movements, addressing the challenge of generating videos directly from text without needing extensive video production resources.

Input Requirements

To use this action, you will need to provide a JSON object that includes the following parameters:

  • Prompt: A descriptive text that outlines the scene you want to create (e.g., "A panda is dancing in Times Square").
  • Chunk Size: The number of frames processed simultaneously (1-10).
  • Resolution: The square resolution of the video in pixels (default is 512).
  • Video Length: The total number of frames to generate in the video.
  • Final Timestep (t1) and Initial Timestep (t0): These define the starting and ending points for the video generation process.
  • Motion Field Strength X/Y: Controls the global translation of the video in horizontal and vertical directions, respectively.
  • Frames Per Second: Sets the frame rate of the generated video.

Expected Output

Upon successful execution, the action will return a link to the generated video file, allowing you to view or embed the content directly in your applications.

Example Input:

{
  "prompt": "A panda is dancing in times square",
  "chunkSize": 8,
  "resolution": 512,
  "videoLength": 30,
  "finalTimestep": 45,
  "framesPerSecond": 8,
  "initialTimestep": 44,
  "motionFieldStrengthX": 12,
  "motionFieldStrengthY": 12
}

Example Output:

https://assets.cognitiveactions.com/invocations/1cdfe344-6388-4639-a875-d3125ab77491/48552408-1aec-4b61-8e78-cddd25ac00f9.mp4

Use Cases for this Action

  • Marketing and Advertising: Create captivating promotional videos that can engage customers and enhance brand visibility.
  • Education: Generate instructional videos that illustrate complex concepts or provide visual aids for better understanding.
  • Entertainment: Develop animated stories or short films based on creative prompts, allowing for unique storytelling experiences.
  • Content Creation: Streamline the video production process for social media content, blogs, or vlogs by quickly transforming ideas into visual narratives.
import requests
import json

# Replace with your actual Cognitive Actions API key and endpoint
# Ensure your environment securely handles the API key
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
# This endpoint URL is hypothetical and should be documented for users
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"

action_id = "463a7352-046e-43d5-afad-6f067910f79f" # Action ID for: Generate Video from Text

# Construct the exact input payload based on the action's requirements
# This example uses the predefined example_input for this action:
payload = {
  "prompt": "A panda is dancing in times square",
  "chunkSize": 8,
  "resolution": 512,
  "videoLength": 30,
  "finalTimestep": 45,
  "framesPerSecond": 8,
  "initialTimestep": 44,
  "motionFieldStrengthX": 12,
  "motionFieldStrengthY": 12
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json",
    # Add any other required headers for the Cognitive Actions API
}

# Prepare the request body for the hypothetical execution endpoint
request_body = {
    "action_id": action_id,
    "inputs": payload
}

print(f"--- Calling Cognitive Action: {action.name or action_id} ---")
print(f"Endpoint: {COGNITIVE_ACTIONS_EXECUTE_URL}")
print(f"Action ID: {action_id}")
print("Payload being sent:")
print(json.dumps(request_body, indent=2))
print("------------------------------------------------")

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json=request_body
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully. Result:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body (non-JSON): {e.response.text}")
    print("------------------------------------------------")

Conclusion

The Text2video Zero Openjourney service opens up new avenues for content creation by allowing developers to effortlessly generate videos from text. This not only accelerates the content production process but also enhances creativity by enabling unique visual storytelling. Whether you are in marketing, education, or entertainment, this service provides the tools you need to bring your ideas to life.

As you explore this powerful technology, consider how it can be integrated into your projects to create dynamic and engaging content that resonates with your audience. Start experimenting with the Text2video Zero Openjourney today and redefine the way you visualize ideas!

← Back to All Articles