Generate Stunning Line Art with ControlNet 1.1 and Realistic Vision v2.0

21 Apr 2025
Generate Stunning Line Art with ControlNet 1.1 and Realistic Vision v2.0

In the world of image generation, the ability to create realistic outputs from various input images is paramount. The ControlNet 1.1 with Realistic Vision v2.0 offers a powerful set of capabilities for developers looking to integrate sophisticated image generation functionalities into their applications. By utilizing pre-built Cognitive Actions, developers can effortlessly generate stunning line art from images while fine-tuning parameters to meet specific needs.

In this article, we will explore the Generate Realistic Line Art with ControlNet action, detailing its input requirements, output expectations, and providing a conceptual example of how to call this action using Python.

Prerequisites

To get started with the Cognitive Actions, you will need:

  • An API key for the Cognitive Actions platform. This key is essential for authenticating your requests.
  • Basic knowledge of making HTTP requests and handling JSON data in your programming language of choice.

For authentication, you will typically pass the API key in the headers of your requests.

Cognitive Actions Overview

Generate Realistic Line Art with ControlNet

This operation leverages the ControlNet 1.1 model with Realistic Vision v2.0 to generate realistic line art from input images. By adjusting various parameters, users can control aspects like the model's inference steps, output dimensions, and guidance strength to achieve the desired artistic effect.

Input

The input schema for this action requires an object with the following properties:

  • image (required): A valid URI string pointing to the input image.
  • seed (optional): An integer for random seed control.
  • steps (optional): The number of inference steps for the model, ranging from 0 to 100 (default is 20).
  • prompt (optional): A guiding text prompt for generation (default: "(a tabby cat)+++, high resolution, sitting on a park bench").
  • maxWidth (optional): Maximum width of the generated image in pixels (default: 612, minimum: 128).
  • maxHeight (optional): Maximum height of the generated image in pixels (default: 612, minimum: 128).
  • strength (optional): A control weight for the generation strength (default: 0.8, ranges from 0 to 2).
  • guidanceScale (optional): A scale for guidance strength during generation (default: 10, ranges from 0 to 30).
  • negativePrompt (optional): Text used to avoid certain undesirable features during generation.

Example input JSON payload:

{
  "image": "https://replicate.delivery/pbxt/IrAdCMSMtw7yHM5RJNl2SQWPfpQIZx5Yog2fV29wB7xpEbyO/ceb71f061de43744a245456771d6f95d.jpg",
  "steps": 20,
  "prompt": "underwater kingdom",
  "maxWidth": 612,
  "strength": 0.5,
  "maxHeight": 612,
  "guidanceScale": 10,
  "negativePrompt": "(deformed iris, deformed pupils, semi-realistic, cgi, 3d, render, sketch, cartoon, drawing, anime:1.4), text, close up, cropped, out of frame, worst quality, low quality, jpeg artifacts, ugly, duplicate, morbid, mutilated, extra fingers, mutated hands, poorly drawn hands, poorly drawn face, mutation, deformed, blurry, dehydrated, bad anatomy, bad proportions, extra limbs, cloned face, disfigured, gross proportions, malformed limbs, missing arms, missing legs, extra arms, extra legs, fused fingers, too many fingers, long neck"
}

Output

Upon successful execution, the action returns a URL pointing to the generated line art, such as:

https://assets.cognitiveactions.com/invocations/baa69341-7e94-4b0c-9941-bbeb940dfeb5/4727733b-9441-4957-bd6c-ca9be99055e1.png

This URL leads to the image output that has been processed by the model based on the provided input parameters.

Conceptual Usage Example (Python)

Here’s a conceptual example demonstrating how to invoke the Generate Realistic Line Art action using Python:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute" # Hypothetical endpoint

action_id = "2af103f2-d157-48ec-b54b-c28eda2cc78a" # Action ID for Generate Realistic Line Art with ControlNet

# Construct the input payload based on the action's requirements
payload = {
    "image": "https://replicate.delivery/pbxt/IrAdCMSMtw7yHM5RJNl2SQWPfpQIZx5Yog2fV29wB7xpEbyO/ceb71f061de43744a245456771d6f95d.jpg",
    "steps": 20,
    "prompt": "underwater kingdom",
    "maxWidth": 612,
    "strength": 0.5,
    "maxHeight": 612,
    "guidanceScale": 10,
    "negativePrompt": "(deformed iris, deformed pupils, semi-realistic, cgi, 3d, render, sketch, cartoon, drawing, anime:1.4), text, close up, cropped, out of frame, worst quality, low quality, jpeg artifacts, ugly, duplicate, morbid, mutilated, extra fingers, mutated hands, poorly drawn hands, poorly drawn face, mutation, deformed, blurry, dehydrated, bad anatomy, bad proportions, extra limbs, cloned face, disfigured, gross proportions, malformed limbs, missing arms, missing legs, extra arms, extra legs, fused fingers, too many fingers, long neck"
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload} # Hypothetical structure
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this example, replace YOUR_COGNITIVE_ACTIONS_API_KEY with your actual API key. The input payload is structured according to the requirements of the Generate Realistic Line Art action. The endpoint URL and exact request structure provided here are illustrative, aimed at guiding developers in making similar API calls.

Conclusion

The Generate Realistic Line Art with ControlNet action is a powerful tool for developers seeking to enhance their applications with advanced image generation capabilities. With adjustable parameters allowing for fine-tuning, this action can be integrated into various creative projects, enabling unique visual outputs.

Consider exploring additional use cases where this action could add value, such as in art applications, gaming, or social media content creation. Happy coding!

← Back to All Articles