Effortlessly Generate and Edit Images with BLIP-Diffusion Cognitive Actions

23 Apr 2025
Effortlessly Generate and Edit Images with BLIP-Diffusion Cognitive Actions

In the realm of image generation and editing, the BLIP-Diffusion Cognitive Actions offer developers a powerful toolkit to create and manipulate images with remarkable efficiency and precision. These actions leverage a pre-trained model that supports controllable text-to-image generation and editing, enabling zero-shot subject-driven generation and fine-tuning that can be up to 20 times faster. Whether you are looking to create unique artworks or enhance existing images, integrating these Cognitive Actions into your applications can yield impressive results.

Prerequisites

Before diving into the actions, ensure you have the following:

  • An API key for accessing the Cognitive Actions platform.
  • Basic knowledge of making HTTP requests and handling JSON data.

To authenticate your requests, you will typically need to include your API key in the request headers, allowing you to securely access the Cognitive Actions services.

Cognitive Actions Overview

Generate and Edit Image with BLIP-Diffusion

The Generate and Edit Image with BLIP-Diffusion action allows you to create and refine images using a text prompt and a reference image. This action is particularly useful for applications requiring creative image generation and editing while maintaining control over the output through various parameters.

Category: image-generation

Input

The input for this action is structured as follows:

{
  "prompt": "painting by Van Gogh",
  "guidanceScale": 7.5,
  "negativePrompt": "over-exposure, under-exposure, saturated, duplicate, out of frame, lowres, cropped, worst quality, low quality, jpeg artifacts, morbid, mutilated, ugly, bad anatomy, bad proportions, deformed, blurry",
  "referenceImage": "https://replicate.delivery/pbxt/KNZcJhVZuWiMWYReUDO2J0Up9CrBN7NmubFg2ZHADbJ5tP9c/dog.png",
  "numInferenceSteps": 25,
  "sourceSubjectCategory": "dog",
  "targetSubjectCategory": "dog"
}
  • referenceImage (required): URI pointing to the reference image that guides the generation.
  • prompt (optional): The text prompt that guides the image generation.
  • guidanceScale (optional): How closely the generation aligns with the prompt (1-20).
  • negativePrompt (optional): Prompts to avoid or minimize in the generation process.
  • numInferenceSteps (optional): Number of denoising steps for better image quality (1-500).
  • sourceSubjectCategory (optional): The category of the source subject.
  • targetSubjectCategory (optional): The category of the target subject after transformation.

Output

The output of this action is a URI pointing to the generated image:

"https://assets.cognitiveactions.com/invocations/11f755cd-d4d1-4946-a2a5-816651a237a8/9b52e548-7170-455c-b707-9eb200da20c9.png"

This URI can be used to access the newly created or edited image.

Conceptual Usage Example (Python)

Here’s how you might integrate the Generate and Edit Image with BLIP-Diffusion action into your Python application:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute" # Hypothetical endpoint

action_id = "ef45bb75-32c8-4077-bc05-5f41ace2fde8"  # Action ID for Generate and Edit Image with BLIP-Diffusion

# Construct the input payload based on the action's requirements
payload = {
    "prompt": "painting by Van Gogh",
    "guidanceScale": 7.5,
    "negativePrompt": "over-exposure, under-exposure, saturated, duplicate, out of frame, lowres, cropped, worst quality, low quality, jpeg artifacts, morbid, mutilated, ugly, bad anatomy, bad proportions, deformed, blurry",
    "referenceImage": "https://replicate.delivery/pbxt/KNZcJhVZuWiMWYReUDO2J0Up9CrBN7NmubFg2ZHADbJ5tP9c/dog.png",
    "numInferenceSteps": 25,
    "sourceSubjectCategory": "dog",
    "targetSubjectCategory": "dog"
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload}  # Hypothetical structure
    )
    response.raise_for_status()  # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this snippet, replace YOUR_COGNITIVE_ACTIONS_API_KEY with your actual API key. The payload is built according to the schema defined for the action, and the request is sent to a hypothetical endpoint. The response is then processed to access the generated image.

Conclusion

The BLIP-Diffusion Cognitive Actions provide an innovative way to generate and edit images effectively. With capabilities for controllable text-to-image generation and fine-tuning, developers can create unique visual content tailored to their needs. By leveraging these actions, you can enhance your applications with advanced image processing features, leading to new possibilities in creative fields. Explore these actions today and unlock the potential of image generation in your projects!

← Back to All Articles