image-processing

Transform Your Images with ControlNet's Modification Actions

26 Apr 2025
Transform Your Images with ControlNet's Modification Actions

In the ever-evolving landscape of image processing, ControlNet stands out as an innovative solution that allows developers to modify images while maintaining their structural integrity. By leveraging prompts and various detail detection methods, such as Canny edge detection and depth detection, ControlNet empowers users to guide the image generation process effectively. This capability not only speeds up the workflow but also enhances the quality of the outputs, making it an invaluable tool for developers working with visual content.

Common use cases for ControlNet include creating artistic renditions of photographs, generating illustrations based on textual descriptions, and improving image quality by removing unwanted artifacts. Whether you're designing graphics for marketing materials, developing content for social media, or enhancing images for e-commerce, ControlNet's modification capabilities can streamline and elevate your projects.

Prerequisites

To get started with ControlNet, you will need a valid Cognitive Actions API key and a basic understanding of making API calls. This will enable you to integrate the image modification actions seamlessly into your applications.

Modify Image with ControlNet

The "Modify Image with ControlNet" action is designed to transform images based on user-defined prompts while preserving essential structural details. This action addresses the need for high-quality image alterations that are guided by specific visual cues.

Input Requirements

To use this action, the following inputs are required:

  • image: A URI pointing to the input image (e.g., "https://example.com/image.png").
  • prompt: The text prompt that guides the image generation (e.g., "a cute dog").

Additional optional parameters include:

  • scale: Adjusts guidance scale, default is 9.
  • diffusionSteps: Number of diffusion steps, default is 20.
  • negativePrompt: Attributes to avoid in the output.
  • controlNetModelType: The type of detection model to use (e.g., "canny").
  • generatedImageResolution: Specifies the resolution of the generated image (e.g., "512").

Expected Output

The action will return one or more modified images based on the input specifications. For example, the output could include:

  • "https://assets.cognitiveactions.com/invocations/.../output1.png"
  • "https://assets.cognitiveactions.com/invocations/.../output2.png"

Use Cases for this Specific Action

This action is particularly useful in scenarios where:

  • Developers want to create unique visuals based on specific themes or concepts.
  • Content creators aim to enhance existing images by adding artistic elements or correcting flaws.
  • Businesses need to generate high-quality promotional materials quickly and efficiently.

By utilizing the "Modify Image with ControlNet" action, developers can add significant value to their projects, ensuring that images not only meet aesthetic standards but also convey the intended message effectively.


```python
import requests
import json

# Replace with your actual Cognitive Actions API key and endpoint
# Ensure your environment securely handles the API key
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
# This endpoint URL is hypothetical and should be documented for users
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"

action_id = "15d6ffc6-5107-4fbb-81c2-8bae054d7dc0" # Action ID for: Modify Image with ControlNet

# Construct the exact input payload based on the action's requirements
# This example uses the predefined example_input for this action:
payload = {
  "image": "https://replicate.delivery/pbxt/IMpV0c2SLNPxcnFxJzNrYymUxrzOd9UoQzdLxV1Ew3jAzXRW/doge.png",
  "scale": 9,
  "prompt": "a cute dog",
  "diffusionSteps": 20,
  "negativePrompt": "longbody, lowres, bad anatomy, bad hands, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality",
  "numberOfSamples": "1",
  "additionalPrompt": "best quality, extremely detailed",
  "cannyLowThreshold": 100,
  "cannyHighThreshold": 200,
  "mlsdValueThreshold": 0.1,
  "controlNetModelType": "canny",
  "detectionResolution": 512,
  "mlsdDistanceThreshold": 0.1,
  "generatedImageResolution": "512"
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json",
    # Add any other required headers for the Cognitive Actions API
}

# Prepare the request body for the hypothetical execution endpoint
request_body = {
    "action_id": action_id,
    "inputs": payload
}

print(f"--- Calling Cognitive Action: {action.name or action_id} ---")
print(f"Endpoint: {COGNITIVE_ACTIONS_EXECUTE_URL}")
print(f"Action ID: {action_id}")
print("Payload being sent:")
print(json.dumps(request_body, indent=2))
print("------------------------------------------------")

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json=request_body
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully. Result:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body (non-JSON): {e.response.text}")
    print("------------------------------------------------")



## Conclusion
ControlNet's image modification capabilities provide developers with powerful tools to create and enhance visual content efficiently. With the ability to guide image transformations using prompts and various detection methods, this service opens up a world of creative possibilities. As you explore the potential of ControlNet, consider how these actions can be applied to your projects, whether for artistic endeavors, marketing campaigns, or product enhancements. Embrace the future of image processing and start transforming your images with ControlNet today!
← Back to All Articles