Create Stunning Image Segmentation Masks with hilongjw/fast-sam Cognitive Actions

24 Apr 2025
Create Stunning Image Segmentation Masks with hilongjw/fast-sam Cognitive Actions

In the realm of computer vision, segmentation masks play a crucial role in understanding and analyzing images. The hilongjw/fast-sam API provides a powerful Cognitive Action that enables developers to generate segmentation masks for grayscale images based on text prompts. This pre-built action simplifies the image analysis process and enhances the quality of outputs, making it easier to integrate advanced image processing capabilities into applications.

Prerequisites

Before you start integrating the Cognitive Actions from hilongjw/fast-sam, ensure you have the following:

  • An API key for the Cognitive Actions platform to authenticate your requests.
  • Familiarity with making HTTP calls in your programming environment.
  • Basic knowledge of JSON structures to format your input and output data.

Authentication typically involves passing your API key in the request headers, allowing you to securely access the action functionalities.

Cognitive Actions Overview

Generate Image Segmentation Mask

The Generate Image Segmentation Mask action creates a segmentation mask for a grayscale image, predicting and annotating areas of interest based on a text prompt. This action is part of the image-segmentation category and is particularly useful for applications in fields such as medical imaging, autonomous vehicles, and more.

Input

The input schema for this action requires several fields, with some being optional. Here’s a breakdown based on the provided schema:

  • image (required): The URI of the grayscale input image.
  • imageSize (optional): The size of the image, ranging between 0 and 2048. Default is 1024.
  • cropOutput (optional): A boolean indicating whether the output should be cropped. Default is false.
  • outputMask (optional): A boolean indicating if the output should include a segmentation mask. Default is false.
  • textPrompt (optional): The text prompt that guides the segmentation model.
  • iouThreshold (optional): The Intersection over Union (IoU) threshold for filtering annotations, with a default of 0.9.
  • betterQuality (optional): A boolean to enhance output quality if set to true. Default is false.

Example Input:

{
  "image": "https://replicate.delivery/pbxt/J3vUEWFnXB7QFcxagPNQX38my2AFOpcZFJJ8WiT5FNyjsITO/5.jpg"
}

Output

The output of this action will typically return a URL pointing to the generated segmentation mask image.

Example Output:

https://assets.cognitiveactions.com/invocations/0362b271-fe44-440c-98f4-e86704547d2b/c84ad8e4-df9d-4c66-9ece-d7f3a134afe2.jpg

Conceptual Usage Example (Python)

Below is a conceptual Python code snippet demonstrating how to call the Generate Image Segmentation Mask action using a hypothetical endpoint:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute" # Hypothetical endpoint

action_id = "8423ef1c-a9ff-4656-9e09-2776fe4d5d6c" # Action ID for Generate Image Segmentation Mask

# Construct the input payload based on the action's requirements
payload = {
    "image": "https://replicate.delivery/pbxt/J3vUEWFnXB7QFcxagPNQX38my2AFOpcZFJJ8WiT5FNyjsITO/5.jpg"
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload} # Hypothetical structure
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this code snippet, replace YOUR_COGNITIVE_ACTIONS_API_KEY and the endpoint with your actual credentials. The action ID and input payload are structured to match the requirements of the Generate Image Segmentation Mask action.

Conclusion

The hilongjw/fast-sam Cognitive Action for generating image segmentation masks offers a robust solution for developers looking to enhance their applications with advanced image processing capabilities. By leveraging this action, you can automate the creation of segmentation masks, improving the efficiency and accuracy of your image analysis tasks. Consider exploring additional use cases such as interactive applications or automated image editing solutions to fully utilize the power of this Cognitive Action. Happy coding!

← Back to All Articles