Enhance User Engagement with Interactive Media Conversations

In today's digital landscape, engaging users effectively is crucial for any application. The "Minicpm V 26" service offers powerful Cognitive Actions that elevate user interaction through multimedia. One standout feature is the ability to facilitate interactive conversations with images and videos. This capability not only adds depth to user engagement but also enhances the overall experience by providing context and instructions through text prompts.

Imagine a scenario where a user can ask questions about a cooking video or receive detailed descriptions of a product image. This action is ideal for applications in e-learning, marketing, customer support, and social media, where visual content plays a pivotal role in communication. By integrating these actions, developers can create more intuitive and responsive applications that cater to user needs in real-time.

Chat with Media

The "Chat with Media" action enables developers to create interactive conversations using images or videos. By employing predictive models, this action provides contextual information or instructions based on the visual content presented. This functionality is especially beneficial in environments where users seek information or assistance related to multimedia content.

Input Requirements

To utilize this action, the input must conform to the following schema:

• Image: A URI pointing to the input image or video. This is a required field.
• Prompt: An optional text prompt that provides context or instructions for processing the input. If no prompt is provided, it defaults to an empty string.

Example Input:

{
  "image": "https://replicate.delivery/pbxt/LYg9UV9q67McivPuwvpQPjClOZ7KqaOHH5F2DgbfCZspIhOQ/input.mp4",
  "prompt": ""
}

Expected Output

The expected output is a descriptive analysis of the media content. For instance, if the input is a cooking video, the output may include a detailed description of the cooking process, the equipment used, and the final dish presentation. This level of detail aids users in understanding the context and enhances the learning experience.

Example Output:

The video showcases a commercial kitchen setup where a person is cooking using a specialized cooking appliance. Here's a detailed description:

1. **Cooking Appliance**: The central focus is a unique cooking appliance, which appears to be a modern, automated cooking device...
2. **Cooking Process**: The appliance is being used to cook food...
3. **Stir-Frying**: The person is actively stirring the food with a spatula...
4. **Efficiency and Automation**: The video highlights the efficiency and automation of the cooking process...
5. **Conclusion**: The final frames show the completed dish...

Use Cases for this Action

This action is particularly useful in various scenarios:

• E-learning Platforms: Enhance learning materials with interactive videos, allowing students to ask questions about the content.
• E-commerce: Provide potential customers with detailed descriptions of products showcased in videos or images, improving their decision-making process.
• Customer Support: Enable support teams to analyze user-submitted media and provide tailored assistance based on the content.

By integrating the "Chat with Media" action, developers can significantly enhance user engagement and satisfaction, making applications more interactive and informative.

import requests
import json

# Replace with your actual Cognitive Actions API key and endpoint
# Ensure your environment securely handles the API key
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
# This endpoint URL is hypothetical and should be documented for users
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"

action_id = "213d154e-ae3b-400f-a9d4-16ddb984468d" # Action ID for: Chat with Media

# Construct the exact input payload based on the action's requirements
# This example uses the predefined example_input for this action:
payload = {
  "image": "https://replicate.delivery/pbxt/LYg9UV9q67McivPuwvpQPjClOZ7KqaOHH5F2DgbfCZspIhOQ/input.mp4",
  "prompt": ""
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json",
    # Add any other required headers for the Cognitive Actions API
}

# Prepare the request body for the hypothetical execution endpoint
request_body = {
    "action_id": action_id,
    "inputs": payload
}

print(f"--- Calling Cognitive Action: {action.name or action_id} ---")
print(f"Endpoint: {COGNITIVE_ACTIONS_EXECUTE_URL}")
print(f"Action ID: {action_id}")
print("Payload being sent:")
print(json.dumps(request_body, indent=2))
print("------------------------------------------------")

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json=request_body
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully. Result:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body (non-JSON): {e.response.text}")
    print("------------------------------------------------")

Conclusion

The "Minicpm V 26" service offers revolutionary Cognitive Actions that facilitate interactive conversations with multimedia content. By leveraging the "Chat with Media" action, developers can create applications that not only engage users but also provide valuable insights and information. As the demand for rich, interactive experiences continues to grow, incorporating these capabilities can set your application apart. Begin exploring the potentials of interactive media today to enhance user engagement and satisfaction.