Elevate Your Apps with Image Generation: A Guide to hilongjw/sdxl-cybertruck Cognitive Actions

23 Apr 2025
Elevate Your Apps with Image Generation: A Guide to hilongjw/sdxl-cybertruck Cognitive Actions

In the rapidly evolving world of image processing, the hilongjw/sdxl-cybertruck Cognitive Actions provide powerful capabilities for developers looking to integrate advanced image generation techniques into their applications. One standout action, Generate Image with Inpainting, allows you to create stunning images based on specific prompts while retaining designated elements through inpainting. This guide will walk you through the essential aspects of this action, including its input requirements and output formats, along with a conceptual example in Python to help you get started.

Prerequisites

Before diving into the integration of the Cognitive Actions, ensure you have the following in place:

  • An API key for the Cognitive Actions platform, which will be used for authentication when making requests.
  • Basic familiarity with RESTful APIs and JSON formatting.

Authentication typically involves passing your API key in the headers of your requests.

Cognitive Actions Overview

Generate Image with Inpainting

Description:
The Generate Image with Inpainting action creates an image based on an input prompt while using inpainting techniques to preserve specific areas of the image as specified by a mask. This action supports various styles, resolution settings, and optional features such as watermarking.

Category: Image Processing

Input

The input for this action is structured as follows:

{
  "image": "https://example.com/input_image.jpg",
  "width": 1024,
  "height": 1024,
  "prompt": "In the style of TOK, a cyber punk style truck running on road",
  "refine": "no_refiner",
  "loraScale": 0.6,
  "scheduler": "K_EULER",
  "outputCount": 1,
  "guidanceScale": 7.5,
  "applyWatermark": true,
  "negativePrompt": "NSFW",
  "promptStrength": 0.8,
  "highNoiseFraction": 0.8,
  "inferenceStepCount": 50
}

Required Fields:

  • image: (string) URI of the input image for inpaint mode.
  • prompt: (string) Textual prompt guiding the image generation.
  • width: (integer) Width of the output image (default: 1024).
  • height: (integer) Height of the output image (default: 1024).
  • outputCount: (integer) Number of output images (1-4, default: 1).

Optional Fields:

  • seed: (integer) Random seed for generating outputs.
  • refine: (string) Select refinement style (default: "no_refiner").
  • loraScale: (number) Scale factor for adding LoRA adjustments (0-1).
  • scheduler: (string) Scheduler type for image generation (default: "K_EULER").
  • guidanceScale: (number) Scale for classifier-free guidance (1-50, default: 7.5).
  • applyWatermark: (boolean) Whether to apply a watermark (default: true).
  • negativePrompt: (string) Input to steer generation away from unwanted features.
  • promptStrength: (number) Impact of the prompt on image generation (0-1).
  • highNoiseFraction: (number) Noise fraction for "expert_ensemble_refiner" (0-1).
  • inferenceStepCount: (integer) Number of denoising steps (1-500, default: 50).

Output

The action returns a JSON array containing the URIs of the generated images. For example:

[
  "https://assets.cognitiveactions.com/invocations/.../generated_image.png"
]

Conceptual Usage Example (Python)

Here’s how you might call the Generate Image with Inpainting action using Python:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"  # Hypothetical endpoint

action_id = "bb8cf93c-f44b-47fa-8508-42c6b985d009"  # Action ID for Generate Image with Inpainting

# Construct the input payload based on the action's requirements
payload = {
    "image": "https://replicate.delivery/pbxt/JzPGEr3EMkQ2lsvRgEsGeOKiyKMd44o0dIKneQGwTwRIb2j6/best_sportscar_511.jpg",
    "width": 1024,
    "height": 1024,
    "prompt": "In the style of TOK, a cyber punk style truck running on road",
    "refine": "no_refiner",
    "loraScale": 0.6,
    "scheduler": "K_EULER",
    "outputCount": 1,
    "guidanceScale": 7.5,
    "applyWatermark": True,
    "negativePrompt": "NSFW",
    "promptStrength": 0.8,
    "highNoiseFraction": 0.8,
    "inferenceStepCount": 50
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload}  # Hypothetical structure
    )
    response.raise_for_status()  # Raise an exception for bad status codes

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this code snippet, replace "YOUR_COGNITIVE_ACTIONS_API_KEY" with your actual API key. The payload is constructed based on the action's schema, and the results will show the generated image's URI.

Conclusion

The Generate Image with Inpainting action offers a robust tool for developers looking to enhance their applications with advanced image generation capabilities. By leveraging this action, you can create unique and tailored images based on user input, opening the door to innovative applications in various domains. Consider exploring further use cases or integrating additional features to maximize the potential of the hilongjw/sdxl-cybertruck Cognitive Actions in your projects!

← Back to All Articles