Enhance Image Editing with Inpainting Using emaph/inpaint-controlnet-union Actions

24 Apr 2025
Enhance Image Editing with Inpainting Using emaph/inpaint-controlnet-union Actions

In the world of image processing, the ability to manipulate and edit images with precision is invaluable. The emaph/inpaint-controlnet-union API provides powerful Cognitive Actions that allow developers to inpaint selected areas of images using ControlNet++, offering high-resolution generation and fine control over the editing process. This guide will explore how to effectively use these actions to enhance your applications.

Prerequisites

Before diving into the Cognitive Actions, ensure you have the following:

  • An API key for accessing the Cognitive Actions platform.
  • Familiarity with sending HTTP requests and handling JSON data.

Authentication is typically handled by including your API key in the request headers, ensuring secure access to the actions provided by the platform.

Cognitive Actions Overview

Inpaint Image Area with ControlNet++

Description: This action allows you to inpaint a selected area of an image using ControlNet++ union for SDXL. It provides high-resolution image generation with precise control and editing capabilities.

Category: Image Processing

Input

The input for this action is structured as follows:

{
  "mask": "https://replicate.delivery/pbxt/LLr2HCNTBnKtFrEhBR2uLadsTnkHuGxDvHvZAWeTiznYobFc/header-mask.png",
  "image": "https://replicate.delivery/pbxt/LLr2HPn4G84jrgoHfLGJpRzHnVTgqXNtshyqsSUth9ng8SyF/2024-03-29_12-46-01_4057.png",
  "steps": 20,
  "prompt": "portrait of a man wearing a suit with a red tie, colorful background",
  "outputFormat": "webp",
  "guidanceScale": 4,
  "outputQuality": 80,
  "negativePrompt": "ugly, deformed"
}
  • mask: (string) URI of the image containing the masked area to be inpainted.
  • image: (string) URI of the image file to be inpainted.
  • steps: (integer, default: 20) Number of inference steps during processing (1 to 50).
  • prompt: (string, default: "") Textual description directing the inpainting process.
  • outputFormat: (string, default: "webp") Format of the output image (options: "webp", "jpg", "png").
  • guidanceScale: (number, default: 4) Scale of guidance during image generation (0 to 20).
  • outputQuality: (integer, default: 80) Quality of the output image (0 to 100).
  • negativePrompt: (string, default: "") Elements to avoid in the image during generation.

Output

The output typically returns a URI of the generated image following the inpainting process:

[
  "https://assets.cognitiveactions.com/invocations/0560a7ab-99ab-4ae1-b6da-40ac664a1ff7/57257f4d-f55b-47be-b07a-c442ba89428f.webp"
]

This output provides a direct link to the newly generated image, allowing you to easily display or further process it in your application.

Conceptual Usage Example (Python)

Here’s how you might call this action using Python and the requests library:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute" # Hypothetical endpoint

action_id = "5b2d2a46-e63d-40fd-bff3-051f230c5840" # Action ID for Inpaint Image Area with ControlNet++

# Construct the input payload based on the action's requirements
payload = {
    "mask": "https://replicate.delivery/pbxt/LLr2HCNTBnKtFrEhBR2uLadsTnkHuGxDvHvZAWeTiznYobFc/header-mask.png",
    "image": "https://replicate.delivery/pbxt/LLr2HPn4G84jrgoHfLGJpRzHnVTgqXNtshyqsSUth9ng8SyF/2024-03-29_12-46-01_4057.png",
    "steps": 20,
    "prompt": "portrait of a man wearing a suit with a red tie, colorful background",
    "outputFormat": "webp",
    "guidanceScale": 4,
    "outputQuality": 80,
    "negativePrompt": "ugly, deformed"
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload} # Hypothetical structure
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this code snippet:

  • The API key and endpoint are placeholders that should be replaced with actual values.
  • The action ID for the Inpaint Image Area with ControlNet++ action is specified.
  • The input JSON payload is constructed based on the required fields.

Conclusion

The emaph/inpaint-controlnet-union Cognitive Actions empower developers to integrate advanced image inpainting capabilities into their applications with ease. By leveraging these actions, you can achieve high-quality image editing that meets the needs of your users. Explore further use cases and consider how these tools can enhance your projects. Happy coding!

← Back to All Articles