Create 3D Mesh Models from Images with Instant Mesh Cognitive Actions

21 Apr 2025
Create 3D Mesh Models from Images with Instant Mesh Cognitive Actions

In the world of 3D modeling, transforming a single image into a detailed 3D mesh can be a game-changer for developers and artists alike. The Instant Mesh Cognitive Actions provide an innovative solution to create efficient 3D mesh models using advanced technology. By leveraging Sparse-view LRMs, these actions enhance performance and quality, making it easier than ever to integrate 3D reconstruction capabilities into your applications.

Prerequisites

Before diving into the integration of Cognitive Actions, ensure you have the following:

  • An API key for the Cognitive Actions platform, which you will need to authenticate your requests.
  • Familiarity with making HTTP requests and handling JSON data structures.

Authentication typically involves passing your API key in the request headers, which grants access to the Cognitive Actions functionalities.

Cognitive Actions Overview

Generate 3D Mesh from Single Image

The Generate 3D Mesh from Single Image action allows you to create a 3D mesh model from a single input image. This action is categorized under 3D Reconstruction and is particularly useful for developers working in fields like gaming, virtual reality, and digital content creation.

Input

The input for this action requires a specific JSON structure defined in the input schema. Here’s a breakdown of the required and optional fields:

  • imagePath (required): A URI pointing to the input image.
  • seed (optional): An integer used for randomization processes (default is 42).
  • exportVideo (optional): A boolean indicating whether to include a video in the output (default is true).
  • sampleSteps (optional): An integer indicating the number of sampling steps (default is 75).
  • exportTexmap (optional): A boolean indicating whether to export the texture map (default is false).
  • removeBackground (optional): A boolean indicating whether the background should be removed from the image (default is true).

Here’s an example input payload:

{
  "seed": 42,
  "imagePath": "https://replicate.delivery/pbxt/Kuf9PGp3vopyQmscqIszxJWBr1OYuzr1VWb67ijDJVBs6N7D/image.png",
  "exportVideo": true,
  "sampleSteps": 75,
  "exportTexmap": false,
  "removeBackground": true
}

Output

Upon successful execution, this action typically returns an array containing URLs for the generated outputs, which may include:

  • A PNG image of the 3D mesh,
  • A video showcasing the mesh creation,
  • A GLB file of the 3D model.

Here’s an example output:

[
  "https://assets.cognitiveactions.com/invocations/c20d0115-2969-4335-af1e-a5b1e42ef1d7/053155f3-cfb3-46b7-ba6c-58a437253bf4.png",
  "https://assets.cognitiveactions.com/invocations/c20d0115-2969-4335-af1e-a5b1e42ef1d7/b532afe9-26ab-4e48-8fb2-854efef4ae48.mp4",
  "https://assets.cognitiveactions.com/invocations/c20d0115-2969-4335-af1e-a5b1e42ef1d7/69edb0b2-937d-4df7-b036-50689afded00.glb"
]

Conceptual Usage Example (Python)

Here is how you might call the Generate 3D Mesh from Single Image action using Python:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"  # Hypothetical endpoint

action_id = "c4ac5777-8c7f-44db-9bfb-0701cdcc3f81"  # Action ID for Generate 3D Mesh from Single Image

# Construct the input payload based on the action's requirements
payload = {
    "seed": 42,
    "imagePath": "https://replicate.delivery/pbxt/Kuf9PGp3vopyQmscqIszxJWBr1OYuzr1VWb67ijDJVBs6N7D/image.png",
    "exportVideo": True,
    "sampleSteps": 75,
    "exportTexmap": False,
    "removeBackground": True
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload}  # Hypothetical structure
    )
    response.raise_for_status()  # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this example, replace YOUR_COGNITIVE_ACTIONS_API_KEY with your actual API key. The action_id corresponds to the specific action you want to execute, and the payload should be structured according to the input requirements outlined above. The endpoint URL and request structure provided are illustrative and should be adapted to your actual API specifications.

Conclusion

The Instant Mesh Cognitive Actions provide a powerful tool for developers looking to incorporate 3D reconstruction capabilities into their applications. By utilizing the Generate 3D Mesh from Single Image action, you can easily transform images into detailed 3D models, which can enhance user experiences in gaming, virtual reality, and beyond.

Explore further by integrating these actions into your projects, and unlock new possibilities in digital content creation!

← Back to All Articles