Detect Objects in Images with hilongjw/dora_page Cognitive Actions

21 Apr 2025
Detect Objects in Images with hilongjw/dora_page Cognitive Actions

In today's rapidly advancing tech landscape, integrating visual intelligence into applications is more critical than ever. The hilongjw/dora_page spec offers a powerful Cognitive Action designed specifically for image processing: Detect Objects in Image. This action enables developers to effortlessly detect objects within images, providing options for customization and enhanced functionality. By leveraging pre-built actions, developers can save time and resources, focusing on building innovative solutions without reinventing the wheel.

Prerequisites

Before you can start integrating the Cognitive Actions from the hilongjw/dora_page spec, ensure you have the following:

  • An API key for the Cognitive Actions platform.
  • Familiarity with basic JSON structure and HTTP requests.

Authentication typically involves passing your API key in the request headers to ensure secure access to the service.

Cognitive Actions Overview

Detect Objects in Image

The Detect Objects in Image action allows you to identify and highlight objects within a specified image. This action is particularly valuable for applications in surveillance, content moderation, and automated tagging.

Input

The input for this action requires a JSON payload that adheres to the following schema:

{
  "image": "string",          // Required. A valid URI to the input image.
  "showText": "boolean",      // Optional. Default is true. Displays text on the image.
  "imageSize": "integer",     // Optional. Default is 1280. Size of the image in pixels (0-2048).
  "threshold": "number",      // Optional. Default is 0.6. Sensitivity of detection (0-1).
  "iouThreshold": "number",   // Optional. Default is 0.45. IOU threshold for filtering annotations (0-1).
  "showConfidence": "boolean"  // Optional. Default is true. Displays confidence score.
}

Example Input:

{
  "image": "https://replicate.delivery/pbxt/JQJhWwVY22awMiFsPvTQyz51XXSSv1nhWX5pysujmHnqpHtn/screenshot-20230827-213409.png",
  "imageSize": 640,
  "threshold": 0.6,
  "iouThreshold": 0.45
}

Output

Upon successful execution, the action returns a URL pointing to the processed image with detected objects highlighted. The output typically resembles this format:

https://assets.cognitiveactions.com/invocations/d857c045-cc74-49ae-9b2b-f9733b17090d/a07cdce7-996d-4467-b6b0-3e0b2bed7de9.png

This URL provides access to the enhanced image where detected objects appear, complete with optional text and confidence scores if specified.

Conceptual Usage Example (Python)

Here’s how you might call the Detect Objects in Image action using Python, structuring the input payload correctly:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute" # Hypothetical endpoint

action_id = "e7b86d11-5038-4d0c-8940-0f9a35206af9"  # Action ID for Detect Objects in Image

# Construct the input payload based on the action's requirements
payload = {
    "image": "https://replicate.delivery/pbxt/JQJhWwVY22awMiFsPvTQyz51XXSSv1nhWX5pysujmHnqpHtn/screenshot-20230827-213409.png",
    "imageSize": 640,
    "threshold": 0.6,
    "iouThreshold": 0.45
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload}  # Hypothetical structure
    )
    response.raise_for_status()  # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this code snippet, replace YOUR_COGNITIVE_ACTIONS_API_KEY with your actual API key. The payload variable is structured according to the action’s input schema, ensuring the necessary parameters are included.

Conclusion

The Detect Objects in Image action from the hilongjw/dora_page spec opens up a world of possibilities for developers looking to integrate object detection capabilities into their applications. By utilizing this action, you can enhance user experiences, automate processes, and unlock new features without extensive coding efforts.

Consider experimenting with different configurations of the action, such as adjusting the detection sensitivity or toggling text display options, to best fit your application’s needs. Happy coding!

← Back to All Articles