Enhance Your Applications with Gemma's Text and Image Analysis Actions

22 Apr 2025
Enhance Your Applications with Gemma's Text and Image Analysis Actions

Integrating advanced artificial intelligence capabilities into your applications has never been easier, thanks to the google-deepmind/gemma-3-27b-it API. This powerful set of Cognitive Actions allows developers to leverage state-of-the-art text generation and image analysis, utilizing the advanced Gemma 3 models from Google. Whether you're looking to create engaging content, summarize information, or provide insightful answers to user queries, these multimodal models are designed to perform exceptionally well, even in environments with limited resources.

Prerequisites

Before you can start using the Cognitive Actions, ensure you have the following:

  • An API key for the Cognitive Actions platform, which will be used for authentication.
  • Basic knowledge of JSON and API interaction.

To authenticate your requests, you will need to pass your API key in the headers of your requests, typically structured like this:

Authorization: Bearer YOUR_COGNITIVE_ACTIONS_API_KEY

Cognitive Actions Overview

Generate Text and Image Analysis with Gemma

The Generate Text and Image Analysis with Gemma action enables you to utilize the capabilities of the Gemma 3 models for generating text and analyzing images. This action is particularly powerful for tasks such as question answering, summarization, and reasoning.

Input

The input for this action requires a JSON object that includes the following properties:

  • prompt (required): The primary text input for the model to base its generation.
  • topK (optional): The number of top tokens to consider during sampling (default is 50).
  • topP (optional): Cumulative probability threshold for token sampling (default is 0.9).
  • image (optional): URI of an optional image input for multimodal tasks.
  • temperature (optional): Controls randomness during sampling (default is 0.7).
  • maxNewTokens (optional): Specifies the maximum number of tokens the model is allowed to generate (default is 512).
  • systemPrompt (optional): A guiding prompt that affects the model's behavior and style (default is "You are a helpful assistant.").

Here’s an example of the input JSON payload:

{
  "topK": 50,
  "topP": 0.9,
  "prompt": "What is the speed of an unladen swallow?",
  "temperature": 0.7,
  "maxNewTokens": 512,
  "systemPrompt": "You are a helpful assistant."
}

Output

The output returned by this action is a string that encapsulates the generated response based on the input prompt. For example:

Ah, a classic question! As famously debated in *Monty Python and the Holy Grail*, determining the speed of an unladen swallow is... complicated.

Here's the breakdown:

* **European Swallow:** Approximately 11 meters per second, or 24 miles per hour.
* **African Swallow:** This is where it gets tricky! There's no definitive answer given in the film, and it's part of the joke. However, estimations based on real-world African swallow species range from 8-17 meters per second (18-38 mph). It's likely faster than the European swallow.

**The key point, as pointed out in the movie, is *what do you mean by "unladen"?*** Is it carrying a coconut? Because that significantly impacts the speed! 

So, to give you the most accurate answer: **It depends on whether it's an African or European swallow, and whether it's carrying anything!**

Conceptual Usage Example (Python)

Here's a conceptual Python code snippet demonstrating how to invoke the Generate Text and Image Analysis with Gemma action:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"  # Hypothetical endpoint

action_id = "b253ad1e-30e9-4bc9-93c0-c25c7583912c"  # Action ID for Generate Text and Image Analysis with Gemma

# Construct the input payload based on the action's requirements
payload = {
    "topK": 50,
    "topP": 0.9,
    "prompt": "What is the speed of an unladen swallow?",
    "temperature": 0.7,
    "maxNewTokens": 512,
    "systemPrompt": "You are a helpful assistant."
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload}  # Hypothetical structure
    )
    response.raise_for_status()  # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this code snippet, replace YOUR_COGNITIVE_ACTIONS_API_KEY with your actual API key and ensure the endpoint URL is correct. The input payload is structured according to the action's requirements, and the action ID corresponds to the "Generate Text and Image Analysis with Gemma" action.

Conclusion

The google-deepmind/gemma-3-27b-it Cognitive Actions provide powerful tools for developers looking to integrate advanced text generation and image analysis capabilities into their applications. By leveraging these pre-built actions, you can enhance user engagement, streamline content creation, and provide intelligent responses to queries. As you explore these capabilities, consider potential use cases such as chatbots, content summarization tools, or educational applications. The possibilities are endless!

← Back to All Articles