Create Engaging Experiences with Live Portraits Using zf-kbot Cognitive Actions

21 Apr 2025
Create Engaging Experiences with Live Portraits Using zf-kbot Cognitive Actions

In today's digital landscape, enhancing user engagement through dynamic multimedia experiences is essential. The zf-kbot/live-portrait API offers powerful Cognitive Actions that allow developers to create animated live portraits by combining images and audio. This article explores how to leverage these pre-built actions to captivate users with realistic visual and audio elements.

Prerequisites

Before diving into the Cognitive Actions, ensure you have the following:

  • An API key for the Cognitive Actions platform to authenticate your requests.
  • Basic familiarity with making HTTP requests in your preferred programming language.
  • A development environment set up to run Python code.

Authentication typically involves passing your API key in the headers of your requests, ensuring secure access to the Cognitive Actions API.

Cognitive Actions Overview

Generate Live Portrait with Audio

The Generate Live Portrait with Audio action allows you to create a dynamic, animated representation by combining an input image with audio. This enhances user interaction through synchronized sound and visuals, making applications more engaging.

  • Category: image-animation

Input

This action requires the following input fields:

  • image (string): A URI to the input image; required for processing.
  • video (string): A URI to the input video; required for processing.

Here’s an example of the input JSON payload needed to invoke this action:

{
  "image": "https://replicate.delivery/pbxt/LJdkFLcNdAemF6Re5Pmtmc8LxkFY93zF11wB7hNcajpfSjy1/mom_1.png",
  "video": "https://replicate.delivery/pbxt/LJdkF2MjQJWdcANNELbXWLP40Yzm9PpuSchnfmCnDRvRUtCs/d14_trim.mp4"
}

Output

Upon successful execution, this action returns a URI to the generated animated video. Here’s an example of the output:

[
  "https://assets.cognitiveactions.com/invocations/a8366e6a-3d45-4821-8a38-c1c4a74f1ff6/2f1327ec-7db8-4e82-92a9-2eb3b7319f42.mp4"
]

This output represents a link to the animated portrait video that has been created, ready for playback.

Conceptual Usage Example (Python)

Below is a conceptual Python code snippet demonstrating how to call this action using a generic Cognitive Actions endpoint:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"  # Hypothetical endpoint

action_id = "825e2c20-420f-4aa3-b9f4-2fab0d556f11"  # Action ID for Generate Live Portrait with Audio

# Construct the input payload based on the action's requirements
payload = {
    "image": "https://replicate.delivery/pbxt/LJdkFLcNdAemF6Re5Pmtmc8LxkFY93zF11wB7hNcajpfSjy1/mom_1.png",
    "video": "https://replicate.delivery/pbxt/LJdkF2MjQJWdcANNELbXWLP40Yzm9PpuSchnfmCnDRvRUtCs/d14_trim.mp4"
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload}  # Hypothetical structure
    )
    response.raise_for_status()  # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this code snippet, replace "YOUR_COGNITIVE_ACTIONS_API_KEY" with your actual API key. The action_id is set to the ID for the Generate Live Portrait with Audio action. The input payload is structured according to the action's requirements, and the response is handled gracefully.

Conclusion

The zf-kbot/live-portrait Cognitive Actions provide an innovative way to enhance user engagement through multimedia. By integrating actions like Generate Live Portrait with Audio, developers can create captivating experiences that combine visual and audio elements seamlessly.

Consider exploring other use cases for these actions, such as interactive applications, educational content, or digital storytelling to further enrich user interactions. Get started today and transform how your applications engage with users!

← Back to All Articles