Enhance Your Applications with Image Generation: Integrating the swk23/windu Cognitive Actions

22 Apr 2025
Enhance Your Applications with Image Generation: Integrating the swk23/windu Cognitive Actions

The swk23/windu specification provides a powerful toolset for developers looking to leverage advanced image generation capabilities. With a focus on inpainting and customization, the Cognitive Actions included in this spec allow users to generate tailored images based on their specific requirements. These pre-built actions simplify the process of creating high-quality images, enabling developers to enhance their applications with minimal effort.

Prerequisites

Before diving into the Cognitive Actions, ensure you have the following prerequisites in place:

  • An API key for the Cognitive Actions platform to authenticate your requests.
  • Basic familiarity with making HTTP requests and handling JSON payloads in your preferred programming language.

Authentication typically involves passing your API key in the headers of your requests, allowing you to securely access the Cognitive Actions.

Cognitive Actions Overview

Generate Image with Inpainting and Customization

Description: This action generates customized images using inpainting techniques and adjustable model parameters. It allows for image-to-image transformations and supports advanced features such as LoRA scaling and prompt influence, enabling developers to create precise and detailed images tailored to user specifications.

  • Category: Image Generation

Input

The input to this action requires a JSON object with various fields. Here’s a breakdown of the required and optional fields, along with an example:

  • Required Field:
    • prompt: A text prompt guiding the image generation.
  • Optional Fields:
    • mask: URI of the image mask for inpainting.
    • seed: Random seed for consistent results.
    • image: URI of the input image for transformations.
    • width: Width of the generated image in pixels.
    • height: Height of the generated image in pixels.
    • goFast: Optimize predictions for speed.
    • aspectRatio: Defines the aspect ratio of the generated image.
    • numOutputs: Number of images to generate (1-4).
    • outputFormat: The file format for output images (e.g., webp, jpg, png).
    • Additional fields for finer control over the image generation process, such as guidanceScale, numInferenceSteps, and extraLora.

Example Input:

{
  "mask": "https://replicate.delivery/pbxt/MW3Dyqdtn6JdKvOzr9qFJLdIzmivKKu25vFrWc1cXyJqL2Ru/test.png",
  "image": "https://replicate.delivery/pbxt/MW3DzDSPvSGGCirpj7SByIOUEHcXJBBLSGvDe1PuUrpaPgbO/full.png",
  "goFast": false,
  "prompt": "windu sitting in a chair",
  "loraScale": 1,
  "numOutputs": 1,
  "aspectRatio": "21:9",
  "outputFormat": "jpg",
  "guidanceScale": 3,
  "outputQuality": 80,
  "extraLoraScale": 1,
  "inferenceModel": "dev",
  "promptStrength": 0.8,
  "imageMegapixels": "1",
  "numInferenceSteps": 28
}

Output

The action typically returns a JSON array containing URLs of the generated images. Here’s an example of what the output might look like:

Example Output:

[
  "https://assets.cognitiveactions.com/invocations/391b9c40-be18-4dfd-b469-3c70e2bb8335/5b49b1f9-6279-4ab5-aebe-8d4129a55a81.jpg"
]

Conceptual Usage Example (Python)

Here’s a conceptual example of how to call this action using Python:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"  # Hypothetical endpoint

action_id = "fe208845-e766-4fef-a35c-34ae3ace24f9"  # Action ID for Generate Image with Inpainting and Customization

# Construct the input payload based on the action's requirements
payload = {
    "mask": "https://replicate.delivery/pbxt/MW3Dyqdtn6JdKvOzr9qFJLdIzmivKKu25vFrWc1cXyJqL2Ru/test.png",
    "image": "https://replicate.delivery/pbxt/MW3DzDSPvSGGCirpj7SByIOUEHcXJBBLSGvDe1PuUrpaPgbO/full.png",
    "goFast": False,
    "prompt": "windu sitting in a chair",
    "loraScale": 1,
    "numOutputs": 1,
    "aspectRatio": "21:9",
    "outputFormat": "jpg",
    "guidanceScale": 3,
    "outputQuality": 80,
    "extraLoraScale": 1,
    "inferenceModel": "dev",
    "promptStrength": 0.8,
    "imageMegapixels": "1",
    "numInferenceSteps": 28
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload}  # Hypothetical structure
    )
    response.raise_for_status()  # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this example, replace YOUR_COGNITIVE_ACTIONS_API_KEY with your actual API key. The action ID and input payload should be constructed according to the specifics of the action you're invoking.

Conclusion

The swk23/windu Cognitive Actions provide developers with a robust framework for generating and customizing images effectively. By integrating these actions into your applications, you can enhance user experiences, automate image creation, and leverage advanced features like inpainting and LoRA scaling. As you explore these capabilities, consider building prototypes or experimenting with various parameters to fully harness the power of image generation in your projects.

← Back to All Articles