Generate Intelligent Responses with Nous Capybara 34B Cognitive Actions

24 Apr 2025
Generate Intelligent Responses with Nous Capybara 34B Cognitive Actions

Integrating advanced AI capabilities into applications can significantly enhance user interactions. The Nous Capybara 34B Cognitive Actions provide developers with powerful tools for generating human-like text responses. This blog post will guide you through the process of using the "Generate Response with Nous Capybara 34B" action, which leverages the Nous Capybara 34B model—a refined version of the Yi-34B model fine-tuned on the Capybara dataset. This model is designed to balance creativity and predictability, making it ideal for various applications.

Prerequisites

Before diving into the implementation, ensure you have:

  • An API key for accessing the Cognitive Actions platform.
  • Basic understanding of JSON structure for API requests and responses.

Authentication typically involves including your API key in the request headers, allowing secure access to the Cognitive Actions.

Cognitive Actions Overview

Generate Response with Nous Capybara 34B

The Generate Response with Nous Capybara 34B action is aimed at generating responses to user queries. By utilizing a state-of-the-art model, developers can create engaging and contextually relevant interactions within their applications.

Input

The input schema for this action requires a CompositeRequest object, which includes the following fields:

  • prompt (required): Instruction or question presented to the model to generate a response.
  • temperature (optional): Determines the creativity of the AI's responses. Default is 0.5.
  • maxNewTokens (optional): Specifies the maximum number of tokens to generate. Set to -1 for no limit.
  • systemPrompt (optional): Establishes the AI's persona. Default is: "You are 'Nous-Capybara', an AI assistant and your purpose and drive is to assist the user with any request they have."
  • repeatPenalty (optional): Discourages repetitive output. Default is 1.1.
  • promptTemplate (optional): Defines the structure for combining system prompts and user prompts.

Here’s an example of the input JSON payload:

{
  "prompt": "Why does a GPU process matrix multiplication faster than a CPU?",
  "temperature": 0.5,
  "maxNewTokens": -1,
  "systemPrompt": "You are 'Nous-Capybara', an AI assistant and your purpose and drive is to assist the user with any request they have.",
  "repeatPenalty": 1.1,
  "promptTemplate": "SYSTEM: {system_prompt}\nUSER: {prompt}\nASSISTANT: "
}

Output

The action typically returns an array of strings representing the generated output. An example of the output might look like this:

[
  ".",
  "</",
  "s",
  ">",
  ""
]

The output may vary based on the input parameters, especially the prompt and temperature settings.

Conceptual Usage Example (Python)

Here’s how you can call the Generate Response with Nous Capybara 34B action using Python:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute" # Hypothetical endpoint

action_id = "4cc23205-ed10-4e92-91b9-7319d3117490" # Action ID for Generate Response with Nous Capybara 34B

# Construct the input payload based on the action's requirements
payload = {
    "prompt": "Why does a GPU process matrix multiplication faster than a CPU?",
    "temperature": 0.5,
    "maxNewTokens": -1,
    "systemPrompt": "You are 'Nous-Capybara', an AI assistant and your purpose and drive is to assist the user with any request they have.",
    "repeatPenalty": 1.1,
    "promptTemplate": "SYSTEM: {system_prompt}\nUSER: {prompt}\nASSISTANT: "
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload} # Hypothetical structure
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In the code snippet above, replace YOUR_COGNITIVE_ACTIONS_API_KEY with your actual API key. The action ID corresponds to the Generate Response with Nous Capybara 34B action. The input payload is structured according to the requirements, allowing for dynamic queries to be sent to the model.

Conclusion

The Nous Capybara 34B Cognitive Action provides a robust solution for generating intelligent and contextually aware responses in your applications. By leveraging its capabilities, developers can create more engaging user experiences, enhancing the overall functionality of their applications. Whether you're building chatbots, virtual assistants, or any other interactive platform, this action opens the door to a new level of AI-driven interaction. Consider exploring more use cases or integrating additional actions for even greater functionality!

← Back to All Articles