Enhance Your Applications with TinyLlama Chatbot Responses

22 Apr 2025
Enhance Your Applications with TinyLlama Chatbot Responses

In the rapidly evolving world of conversational AI, integrating chatbot capabilities into your applications can significantly enhance user engagement and interactivity. The TinyLlama-1.1B Chat model, part of the tomasmcm/tinyllama-1.1b-chat-v1.0 spec, provides powerful tools to generate human-like responses efficiently. By utilizing pre-trained models optimized for both memory and computation, developers can easily implement sophisticated chat functionalities without extensive machine learning expertise.

Prerequisites

Before diving into the integration of Cognitive Actions, ensure you have the following:

  • An API key for the Cognitive Actions platform to authenticate your requests.
  • Basic familiarity with JSON and HTTP requests.
  • A programming environment set up for making API calls (Python is used in the examples below).

Authentication typically involves passing your API key in the headers of your requests, allowing you to securely access the Cognitive Actions.

Cognitive Actions Overview

Generate Chatbot Response

The Generate Chatbot Response action leverages the TinyLlama-1.1B Chat model to produce responses to user inputs. This function is categorized under text-generation and is designed to handle a variety of conversational prompts effectively.

Purpose

This action enables developers to generate contextual chatbot responses based on user inputs, making it ideal for applications in customer service, entertainment, and educational tools.

Input

The input for this action requires a JSON object that includes several fields. The prompt field is mandatory, while other fields are optional but can significantly influence the output.

Schema:

{
  "type": "object",
  "required": ["prompt"],
  "properties": {
    "topK": {
      "type": "integer",
      "default": -1,
      "description": "Number of top tokens to consider during generation. Set to -1 to include all tokens."
    },
    "topP": {
      "type": "number",
      "default": 0.95,
      "description": "Cumulative probability threshold for considering top tokens. Must be between 0.01 and 1, inclusive."
    },
    "prompt": {
      "type": "string",
      "description": "Text prompt to the model as the initial input sequence."
    },
    "maxTokens": {
      "type": "integer",
      "default": 128,
      "description": "Maximum number of tokens to generate per output sequence."
    },
    "temperature": {
      "type": "number",
      "default": 0.8,
      "description": "Controls sampling randomness; lower values yield more deterministic outputs."
    },
    "stopCriteria": {
      "type": "string",
      "description": "Sequences of characters that halt further generation."
    },
    "presencePenalty": {
      "type": "number",
      "default": 0,
      "description": "Penalizes new tokens based on prior occurrence in text."
    },
    "frequencyPenalty": {
      "type": "number",
      "default": 0,
      "description": "Penalizes new tokens based on frequency in the generated text."
    }
  }
}

Example Input:

{
  "topK": -1,
  "topP": 0.95,
  "prompt": "<|system|>\nYou are a friendly chatbot who always responds in the style of a pirate.</s>\n<|user|>\nHow many helicopters can a human eat in one sitting?</s>\n<|assistent|>",
  "maxTokens": 128,
  "temperature": 0.8,
  "presencePenalty": 0,
  "frequencyPenalty": 0
}

Output

The output is a generated text response from the chatbot based on the input prompt. This response is typically a string that addresses the user's query in a coherent and contextually relevant manner.

Example Output:

As a human being, you cannot eat many helicopters in one sitting. A helicopter is a large and bulky aircraft, and eating one of these requires a significant amount of time and effort. In general, humans are not known for their appetites, and eating multiple helicopters would be an extreme act of foodism. However, you can look up the specific capabilities of helicopters and their capacities for transporting food and materials.

Conceptual Usage Example (Python)

Here's how you might structure a call to the Generate Chatbot Response action using Python:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute" # Hypothetical endpoint

action_id = "811bd393-3605-4b9a-a250-c9b790d71d44" # Action ID for Generate Chatbot Response

# Construct the input payload based on the action's requirements
payload = {
    "topK": -1,
    "topP": 0.95,
    "prompt": "<|system|>\nYou are a friendly chatbot who always responds in the style of a pirate.</s>\n<|user|>\nHow many helicopters can a human eat in one sitting?</s>\n<|assistent|>",
    "maxTokens": 128,
    "temperature": 0.8,
    "presencePenalty": 0,
    "frequencyPenalty": 0
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload} # Hypothetical structure
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this code snippet:

  • Replace YOUR_COGNITIVE_ACTIONS_API_KEY with your actual API key.
  • The action_id corresponds to the Generate Chatbot Response action.
  • The payload is structured to match the required input schema, allowing for flexible chatbot responses.

Conclusion

Integrating the TinyLlama-1.1B Chat model into your applications opens up numerous possibilities for building engaging and interactive user experiences. By leveraging the Generate Chatbot Response action, developers can easily produce dynamic and contextually aware responses, enhancing the overall functionality of their applications. Explore the potential of conversational AI and consider the next steps for your project, whether it's fine-tuning prompts or expanding into other conversational capabilities!

← Back to All Articles