image-generation

Create Stunning Images with Sd3 ControlNet

25 Apr 2025
Create Stunning Images with Sd3 ControlNet

In the realm of digital creativity, the ability to generate high-quality images is a game changer. With the Sd3 ControlNet, developers can harness the power of Stable Diffusion 3 to create visually stunning images with enhanced control over various elements such as canny edges, pose, and tile structures. This advanced image generation capability simplifies the creative process, allowing for a range of applications from artistic expression to commercial use. Whether you’re looking to generate unique artwork, enhance graphics for marketing, or create compelling visuals for social media, the Sd3 ControlNet offers a robust solution that can meet diverse needs.

Common Use Cases:

  • Artistic Creation: Generate unique artwork that combines surreal elements and imaginative concepts.
  • Marketing Materials: Create eye-catching images for advertisements, social media posts, or promotional content.
  • Game Development: Design character poses or backgrounds that require specific structures and aesthetics.
  • Prototyping: Quickly visualize concepts for products or services with tailored imagery.

Before diving into the capabilities of Sd3 ControlNet, ensure you have a Cognitive Actions API key and a basic understanding of making API calls to utilize these powerful actions effectively.

Generate Images with Stable Diffusion 3 ControlNet

This action utilizes Stable Diffusion 3 in combination with InstantX's Canny, Pose, and Tile ControlNets to enhance image generation. By allowing developers to specify the type of structure and adhere to complex prompts, this action ensures high-quality, photorealistic images that meet specific creative briefs.

Input Requirements

To use this action, you need to provide the following inputs:

  • inputImage: URL of the image to be processed.
  • prompt: A descriptive text that guides the image generation process.
  • structure: Type of structure to apply during image processing (options: canny, pose, tile).
  • scaleGuidance: A numerical value (0-50) indicating how closely the image should adhere to the prompt.
  • weightControl: A number (0-1) influencing the control weight in image generation.
  • promptNegative: Concepts to avoid during image generation.
  • stepsInference: Number of inference steps (1-50) to refine the image.
  • numberOfOutputs: Number of images to generate (1-4).
  • imageAspectRatio: Defines the aspect ratio of the image.
  • imageOutputFormat: Specifies the output format (webp, jpg, png).
  • imageOutputQuality: Determines the quality of the output images.
  • Additional parameters may include thresholds for line detection and safety checker settings.

Example Input:

{
  "prompt": "A surreal interpretation of an ice cream cone transforming into a fantastical cloud city, with miniature buildings and flying vehicles emerging from the swirls of ice cream",
  "structure": "canny",
  "inputImage": "https://replicate.delivery/pbxt/L8XLfd3JY13a51BlD1xA1APD4lPCqFgVJD5pG00Xpr4klsbQ/canny.png",
  "scaleGuidance": 7,
  "weightControl": 0.7,
  "promptNegative": "NSFW, nude, naked, porn, ugly, melting, dripping, realistic ice cream",
  "stepsInference": 20,
  "numberOfOutputs": 1,
  "imageAspectRatio": "1:1",
  "imageOutputFormat": "webp",
  "imageOutputQuality": 90,
  "lineDetectionLowThreshold": 1,
  "lineDetectionHighThreshold": 255
}

Expected Output

The output will consist of generated images based on the provided input parameters, delivered in the specified format. For example, you might receive an image link like this:

["https://assets.cognitiveactions.com/invocations/dcfb3963-44de-40e8-b514-63a1c530ec0b/5413279e-5456-48bc-aa53-425c34d4676f.webp"]

Use Cases for this Specific Action

  • Artistic Exploration: Use this action to create surreal and imaginative artworks that push the boundaries of creativity.
  • Visual Storytelling: Generate images that tell a story or convey a message visually, making them perfect for blogs and presentations.
  • Brand Development: Create unique visuals that align with brand identity, enhancing marketing strategies and outreach efforts.
  • Dynamic Content Creation: Utilize the flexibility of this action to produce diverse imagery on demand, perfect for social media campaigns.
import requests
import json

# Replace with your actual Cognitive Actions API key and endpoint
# Ensure your environment securely handles the API key
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
# This endpoint URL is hypothetical and should be documented for users
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"

action_id = "dbb698f8-37c7-4c08-a70f-0c6af8c0df3b" # Action ID for: Generate Images with Stable Diffusion 3 ControlNet

# Construct the exact input payload based on the action's requirements
# This example uses the predefined example_input for this action:
payload = {
  "prompt": "A surreal interpretation of an ice cream cone transforming into a fantastical cloud city, with miniature buildings and flying vehicles emerging from the swirls of ice cream",
  "structure": "canny",
  "inputImage": "https://replicate.delivery/pbxt/L8XLfd3JY13a51BlD1xA1APD4lPCqFgVJD5pG00Xpr4klsbQ/canny.png",
  "scaleGuidance": 7,
  "weightControl": 0.7,
  "promptNegative": "NSFW, nude, naked, porn, ugly, melting, dripping, realistic ice cream",
  "stepsInference": 20,
  "numberOfOutputs": 1,
  "imageAspectRatio": "1:1",
  "imageOutputFormat": "webp",
  "imageOutputQuality": 90,
  "lineDetectionLowThreshold": 1,
  "lineDetectionHighThreshold": 255
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json",
    # Add any other required headers for the Cognitive Actions API
}

# Prepare the request body for the hypothetical execution endpoint
request_body = {
    "action_id": action_id,
    "inputs": payload
}

print(f"--- Calling Cognitive Action: {action.name or action_id} ---")
print(f"Endpoint: {COGNITIVE_ACTIONS_EXECUTE_URL}")
print(f"Action ID: {action_id}")
print("Payload being sent:")
print(json.dumps(request_body, indent=2))
print("------------------------------------------------")

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json=request_body
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully. Result:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body (non-JSON): {e.response.text}")
    print("------------------------------------------------")

Conclusion

The Sd3 ControlNet offers developers a powerful tool for generating high-quality, tailored images that cater to a wide range of applications. By leveraging the capabilities of Stable Diffusion 3, you can create stunning visuals that meet specific requirements and enhance creative projects. Whether for art, marketing, or prototyping, the potential applications are vast. Start integrating the Sd3 ControlNet into your workflows today and unlock new possibilities in visual content creation.

← Back to All Articles