Create Stunning Portrait Animations with camenduru/aniportrait-vid2vid Cognitive Actions

24 Apr 2025
Create Stunning Portrait Animations with camenduru/aniportrait-vid2vid Cognitive Actions

In the world of digital content creation, the ability to generate lifelike animations from static images has become a game-changer. The camenduru/aniportrait-vid2vid API offers developers a powerful Cognitive Action that transforms static portraits into photorealistic animations driven by audio inputs. This capability not only enhances visual storytelling but also allows for a more engaging user experience in applications ranging from gaming to virtual reality.

Prerequisites

To get started with the Cognitive Actions from the camenduru/aniportrait-vid2vid API, you will need:

  • An API key for the Cognitive Actions platform.
  • Basic knowledge of working with RESTful APIs and JSON.

Authentication typically involves passing your API key in the request headers, ensuring secure access to the service.

Cognitive Actions Overview

Generate Photorealistic Portrait Animation

Description:
The Generate Photorealistic Portrait Animation action creates dynamic animations from a reference image and a source video. By leveraging audio cues, this action produces lifelike animations that can be used for a variety of creative applications.

Category: image-animation

Input:

The input schema for this action requires several fields:

  • referenceImagePath (string, required): The URI of the reference input image file.
  • sourceVideoPath (string, required): The URI of the input video file.
  • seed (integer, optional): Used for initializing the random number generator. Default is 42.
  • steps (integer, optional): Number of processing steps to perform (default is 25).
  • width (integer, optional): Width of the output in pixels (default is 512).
  • height (integer, optional): Height of the output in pixels (default is 512).
  • length (integer, optional): Number of frames to extract or process from the source video (default is 64).
  • configurationValue (number, optional): Tuning parameter for algorithm sensitivity (default is 3.5).

Example Input:

{
  "seed": 42,
  "steps": 25,
  "width": 512,
  "height": 512,
  "length": 256,
  "sourceVideoPath": "https://replicate.delivery/pbxt/Ke3UqttnvH0VfcCC1zFlnOUGCZBaAHkpJprTEfecngcEuiXd/Aragaki_song.mp4",
  "configurationValue": 3.5,
  "referenceImagePath": "https://replicate.delivery/pbxt/Ke4joO1FPJWe6tQ28QNEcTsxrOX3gNUCFNe6B72ZwGmLsPPH/917bd7512eae29e24e2b97a389.jpg"
}

Output:

The output of this action is a list of URIs pointing to the generated animation files. Each animation represents a different variation based on the input parameters.

Example Output:

[
  "https://assets.cognitiveactions.com/invocations/f09e7ceb-027e-465d-a6ad-8e3c9e604106/354154cb-348d-4651-8ee7-11d697b7ed12.mp4",
  "https://assets.cognitiveactions.com/invocations/f09e7ceb-027e-465d-a6ad-8e3c9e604106/28399cc7-d071-4476-808c-a17c854fcfd6.mp4",
  "https://assets.cognitiveactions.com/invocations/f09e7ceb-027e-465d-a6ad-8e3c9e604106/52c1f218-ea44-441e-8c7d-bd539284d0ac.mp4",
  "https://assets.cognitiveactions.com/invocations/f09e7ceb-027e-465d-a6ad-8e3c9e604106/18287a6f-a669-4498-81f3-332889b64652.mp4"
]

Conceptual Usage Example (Python):

Here's how you might call this action using Python:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute" # Hypothetical endpoint

action_id = "5fc590de-44f8-4de2-aa83-c9f9a91e1c78"  # Action ID for Generate Photorealistic Portrait Animation

# Construct the input payload based on the action's requirements
payload = {
    "seed": 42,
    "steps": 25,
    "width": 512,
    "height": 512,
    "length": 256,
    "sourceVideoPath": "https://replicate.delivery/pbxt/Ke3UqttnvH0VfcCC1zFlnOUGCZBaAHkpJprTEfecngcEuiXd/Aragaki_song.mp4",
    "configurationValue": 3.5,
    "referenceImagePath": "https://replicate.delivery/pbxt/Ke4joO1FPJWe6tQ28QNEcTsxrOX3gNUCFNe6B72ZwGmLsPPH/917bd7512eae29e24e2b97a389.jpg"
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload}  # Hypothetical structure
    )
    response.raise_for_status()  # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this code snippet, ensure you replace the placeholder API key with your actual key. The action ID and input payload are structured according to the specifications of the Generate Photorealistic Portrait Animation action. Please note that the endpoint URL is hypothetical and should be replaced with the actual endpoint when available.

Conclusion

The camenduru/aniportrait-vid2vid Cognitive Action provides an innovative way to animate portraits, enhancing both user interaction and content quality in applications. By utilizing the straightforward JSON input structure, developers can easily integrate this functionality into their projects. Explore the possibilities of dynamic content creation and start building engaging applications today!

← Back to All Articles