Generate Stunning Images with ControlNet Actions for lucataco/controlnet-union-pro

24 Apr 2025
Generate Stunning Images with ControlNet Actions for lucataco/controlnet-union-pro

In the world of AI-driven creativity, the lucataco/controlnet-union-pro API offers powerful Cognitive Actions designed to help developers generate images with remarkable precision. Leveraging the capabilities of the ControlNet model, these actions allow for detailed manipulation of visual elements, making it easier to create stunning visuals tailored to specific needs. Whether you're enhancing graphics for an application or exploring creative design, these pre-built actions streamline the process and improve overall output quality.

Prerequisites

Before diving into the integration of Cognitive Actions, there are a few requirements to keep in mind:

  • API Key: To use the Cognitive Actions, you'll need an API key for authentication. This key must be included in the headers of your API requests.
  • Setup: Ensure that your development environment is configured to make HTTP requests (e.g., using libraries like requests in Python).

Cognitive Actions Overview

Generate Image with ControlNet

Description: This action utilizes the ControlNet for the FLUX.1-dev model to generate images with specific control modes, allowing for precise management of various visual elements such as canny, tile, depth, and more. The Pro version supports additional steps and datasets, enhancing performance and output quality.

Category: Image Generation

Input

The input for this action is defined by the following schema:

  • seed (integer): Specifies a seed value for random number generation to ensure reproducibility. Leave unspecified for a random default.
  • steps (integer): Defines the number of iteration steps in the process, ranging from 1 to 50. Defaults to 28.
  • prompt (string): Text prompt that describes the desired output. Example: "A bohemian-style female travel blogger with sun-kissed skin and messy beach waves".
  • adjustmentType (string): Specifies the type of control applied to the adjustment image. Default is 'canny'. Examples include 'pose' and 'depth'.
  • guidelineScale (number): Determines the guidance scale, influencing the prominence of the guidelines in the output. Default is 3.5.
  • adjustmentImage (string): URL of the image used to control the output. Must be in URI format.
  • adjustmentStrength (number): Level of influence the control image has on the final output. Recommended range is 0.3–0.8.

Example Input:

{
  "steps": 28,
  "prompt": "A bohemian-style female travel blogger with sun-kissed skin and messy beach waves",
  "adjustmentType": "pose",
  "guidelineScale": 3.5,
  "adjustmentImage": "https://replicate.delivery/pbxt/LWGXlTeS6tfDc0J0PqzYhDYePQs7f62kfhc195388gzTikWu/assets_openpose.jpg",
  "adjustmentStrength": 0.3
}

Output

The action typically returns a URL linking to the generated image. For example:

https://assets.cognitiveactions.com/invocations/82556444-e9af-4cf9-b8f4-c91c991e71ed/769d98d3-c4fc-454e-9ca3-ca38f72b5d2b.png

Conceptual Usage Example (Python)

Here’s how you might implement the action in Python:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"  # Hypothetical endpoint

action_id = "a864fd32-3532-43f4-86d7-38667cd01ab8"  # Action ID for Generate Image with ControlNet

# Construct the input payload based on the action's requirements
payload = {
    "steps": 28,
    "prompt": "A bohemian-style female travel blogger with sun-kissed skin and messy beach waves",
    "adjustmentType": "pose",
    "guidelineScale": 3.5,
    "adjustmentImage": "https://replicate.delivery/pbxt/LWGXlTeS6tfDc0J0PqzYhDYePQs7f62kfhc195388gzTikWu/assets_openpose.jpg",
    "adjustmentStrength": 0.3
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload}  # Hypothetical structure
    )
    response.raise_for_status()  # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this code snippet, replace YOUR_COGNITIVE_ACTIONS_API_KEY with your actual API key. The payload is structured according to the action's requirements, and the endpoint URL is illustrative of a hypothetical Cognitive Actions execution endpoint.

Conclusion

The Cognitive Actions provided by the lucataco/controlnet-union-pro API allow developers to harness the power of AI-driven image generation with remarkable flexibility and control. By utilizing these pre-built actions, you can easily create tailored visuals that meet a variety of application needs. Explore the capabilities of these actions and consider how they can enhance your projects or creative endeavors!

← Back to All Articles