Enhance Your Applications with Advanced Image Inpainting Using Cognitive Actions

24 Apr 2025
Enhance Your Applications with Advanced Image Inpainting Using Cognitive Actions

In the rapidly evolving field of artificial intelligence, the ability to manipulate and edit images has become a crucial aspect for developers. The zsxkib/flux-dev-inpainting-controlnet offers a powerful suite of Cognitive Actions designed to facilitate advanced image inpainting. With these pre-built actions, developers can easily integrate sophisticated image editing capabilities into their applications, allowing for precise control over content generation and transformation.

Prerequisites

To get started with the Cognitive Actions, you'll need an API key for the Cognitive Actions platform. This key will authenticate your requests and ensure secure access to the services. Conceptually, you will pass this API key in the headers of your HTTP requests when invoking the actions.

Cognitive Actions Overview

Perform Advanced Image Inpainting

Description:
Utilize the FLUX.1-dev ControlNet Inpainting model to precisely edit and generate image content by manipulating masked regions, offering advanced control over image transformation.

Category: Image Processing

Input

The input schema for this action requires the following fields:

  • image (required): A URI to the base image you want to edit.
  • mask (required): A URI to the mask image that indicates the areas to be modified (white areas for inpainting, black areas to be preserved).
  • prompt (optional): A descriptive text prompt to influence the content and style of the inpainting.
  • numberOfOutputs (optional): The number of images to generate (1 to 10).
  • outputFileFormat (optional): The desired output format for the generated images (webp, jpg, png).
  • exactGuidanceScale (optional): A number that defines the guidance scale for the transformer model.
  • negativeTextPrompt (optional): Text prompts to specify features to be minimized or avoided.
  • outputImageQuality (optional): Quality level for output images in jpg and webp formats.
  • guidanceIntensityScale (optional): Guidance scale for classifier-free guidance.
  • numberOfInferenceSteps (optional): Number of denoising steps (1 to 100).
  • controlnetAdjustmentScale (optional): Adjusts the ControlNet conditioning scale (0 to 2).
  • seed (optional): An integer seed for reproducible results.

Example Input:

{
  "mask": "https://replicate.delivery/pbxt/Le6GAg8i6DrhZxvjibNmzKy4jPYEKIhH8DBZnUp2WAioguXI/bucket_mask.jpeg",
  "image": "https://replicate.delivery/pbxt/Le6GAdIHbCc7u5RAFQ09dqJoROHEayxjWQbg9Hx16aY2fa9L/bucket.png",
  "prompt": "a person wearing a white shoe, carrying a white bucket with text 'REPLICATE FLUX INPAINTING CONTROLNET' on it",
  "numberOfOutputs": 10,
  "outputFileFormat": "png",
  "exactGuidanceScale": 3.5,
  "negativeTextPrompt": "",
  "outputImageQuality": 80,
  "guidanceIntensityScale": 3.5,
  "numberOfInferenceSteps": 28,
  "controlnetAdjustmentScale": 0.9
}

Output

The action typically returns an array of URLs pointing to the generated images based on your input parameters.

Example Output:

[
  "https://assets.cognitiveactions.com/invocations/40fe3ae7-5c53-475f-85a1-2de2713a8e76/8c3acb64-d26c-4963-92f1-30bd1e5f4e7b.png",
  "https://assets.cognitiveactions.com/invocations/40fe3ae7-5c53-475f-85a1-2de2713a8e76/9bd32851-c5e8-4918-b3b0-fde1eed04fed.png",
  ...
]

Conceptual Usage Example (Python)

Here's how you might invoke the Perform Advanced Image Inpainting action using Python:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute" # Hypothetical endpoint

action_id = "18715167-6d72-4a20-a390-f0c264231f7e" # Action ID for Perform Advanced Image Inpainting

# Construct the input payload based on the action's requirements
payload = {
    "mask": "https://replicate.delivery/pbxt/Le6GAg8i6DrhZxvjibNmzKy4jPYEKIhH8DBZnUp2WAioguXI/bucket_mask.jpeg",
    "image": "https://replicate.delivery/pbxt/Le6GAdIHbCc7u5RAFQ09dqJoROHEayxjWQbg9Hx16aY2fa9L/bucket.png",
    "prompt": "a person wearing a white shoe, carrying a white bucket with text 'REPLICATE FLUX INPAINTING CONTROLNET' on it",
    "numberOfOutputs": 10,
    "outputFileFormat": "png",
    "exactGuidanceScale": 3.5,
    "negativeTextPrompt": "",
    "outputImageQuality": 80,
    "guidanceIntensityScale": 3.5,
    "numberOfInferenceSteps": 28,
    "controlnetAdjustmentScale": 0.9
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload} # Hypothetical structure
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this code snippet, replace YOUR_COGNITIVE_ACTIONS_API_KEY with your actual API key. The action ID corresponds to the inpainting action, and the payload is structured according to the input schema. The endpoint URL and request structure are illustrative and may vary based on the actual implementation.

Conclusion

The zsxkib/flux-dev-inpainting-controlnet Cognitive Actions provide developers with the tools necessary to perform advanced image inpainting seamlessly. By integrating these actions, you can enhance your applications with sophisticated image manipulation capabilities that are both powerful and easy to use. Consider exploring additional use cases such as content generation, artistic image editing, and more to fully leverage the potential of these Cognitive Actions.

← Back to All Articles