Generating Human-Like Dialogue with TinyLlama-1.1B Chat Actions

22 Apr 2025
Generating Human-Like Dialogue with TinyLlama-1.1B Chat Actions

In the ever-evolving landscape of artificial intelligence, the ability to generate human-like dialogue is a key feature for many applications. The TinyLlama-1.1B-Chat-v1.0 model offers developers a powerful tool for text generation, enabling the creation of interactive chatbots and conversational agents. This compact yet efficient model is fine-tuned on a diverse set of synthetic dialogues, making it an excellent choice for applications that require natural language processing with limited computational resources.

Prerequisites

Before you can start integrating the TinyLlama-1.1B Chat actions, you'll need a few things in place:

  • API Key: Access to the Cognitive Actions platform will require an API key. This key is essential for authenticating your requests.
  • HTTP Client: You'll need a tool or library for making HTTP requests (e.g., requests in Python).

For authentication, the API key is typically passed in the request headers.

Cognitive Actions Overview

Generate Chat Response with TinyLlama-1.1B

This action uses the TinyLlama-1.1B-Chat-v1.0 model to generate human-like dialogue based on a provided prompt. It is categorized under text-generation and is designed to offer robust conversational capabilities.

Input

The input for this action requires a JSON object with the following fields:

  • topK (integer): The number of highest-probability tokens to consider for generation. Default is 50.
  • topP (number): Controls the cumulative probability threshold for token selection. Default is 0.95.
  • prompt (string): The initial input provided to the model to guide its response generation. Default is "How many helicopters can a human eat in one sitting?".
  • temperature (number): Modulates the randomness of the output. Default is 0.7.
  • maxNewTokens (integer): Specifies the maximum number of tokens to generate in the response. Default is 256.
  • systemPrompt (string): Sets overarching behavior instructions for the model. Default is "You are a friendly chatbot who always responds in the style of a pirate".
  • promptTemplate (string): Defines a format string for multi-turn dialogue instructions. Default is "<|system|>\n{system_prompt}\n<|user|>\n{prompt}\n<|assistant|>".

Example Input:

{
  "topK": 50,
  "topP": 0.95,
  "prompt": "How many helicopters can a human eat in one sitting?",
  "temperature": 0.7,
  "maxNewTokens": 256,
  "systemPrompt": "You are a friendly chatbot who always responds in the style of a pirate",
  "promptTemplate": "<|system|>\n{system_prompt}</s>\n<|user|>\n{prompt}</s>\n<|assistant|>"
}

Output

The output is an array of strings representing the generated dialogue. The model returns a sequence of tokens that form the response to the prompt provided.

Example Output:

[
  "\n",
  "There",
  " is",
  " no",
  " specific",
  " limit",
  " or",
  " rule",
  " on",
  " how",
  " many",
  " hel",
  "ico",
  "pt",
  "ers",
  " a",
  " human",
  " can",
  " eat",
  ".",
  " It",
  " is",
  " recommended",
  " to",
  " not",
  " over",
  "e",
  "at",
  " as",
  " it",
  " can",
  " lead",
  " to",
  " an",
  " increase",
  " in",
  " hung",
  "er",
  " and",
  " fat",
  "igue",
  ",",
  " both",
  " of",
  " which",
  " can",
  " affect",
  " performance",
  " and",
  " safety",
  ".",
  " However",
  ",",
  " some",
  " studies",
  " suggest",
  " that",
  " cons",
  "uming",
  " around",
  " ",
  1,
  0,
  "-",
  2,
  0,
  " hel",
  "ico",
  "pt",
  "ers",
  " per",
  " day",
  " can",
  " provide",
  " energy",
  " and",
  " nut",
  "ri",
  "ents",
  " needed",
  " for",
  " optimal",
  " health",
  " and",
  " well",
  "be",
  "ing",
  ".",
  ""
]

Conceptual Usage Example (Python)

Here is how you might structure a Python code snippet to call the Cognitive Actions execution endpoint for this action:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"  # Hypothetical endpoint

action_id = "fe27f438-7b7d-49f8-bcbd-1f707aa26956"  # Action ID for Generate Chat Response with TinyLlama-1.1B

# Construct the input payload based on the action's requirements
payload = {
    "topK": 50,
    "topP": 0.95,
    "prompt": "How many helicopters can a human eat in one sitting?",
    "temperature": 0.7,
    "maxNewTokens": 256,
    "systemPrompt": "You are a friendly chatbot who always responds in the style of a pirate",
    "promptTemplate": "<|system|>\n{system_prompt}</s>\n<|user|>\n{prompt}</s>\n<|assistant|>"
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload}  # Hypothetical structure
    )
    response.raise_for_status()  # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this example, replace the YOUR_COGNITIVE_ACTIONS_API_KEY placeholder with your actual API key, and adjust the endpoint URL as necessary. The action_id corresponds to the action you are invoking. The input payload is structured based on the action's requirements.

Conclusion

Integrating the TinyLlama-1.1B-Chat actions into your applications offers an excellent opportunity to enhance user interactions with human-like dialogue capabilities. By leveraging the input parameters effectively, you can customize the behavior of your chatbot to meet various needs, whether for customer support, entertainment, or information retrieval. Start experimenting with the TinyLlama model today and unlock the potential of conversational AI!

← Back to All Articles