Elevate Your Code Generation with Cognitive Actions from andreasjansson/codellama-34b-instruct-gguf

22 Apr 2025
Elevate Your Code Generation with Cognitive Actions from andreasjansson/codellama-34b-instruct-gguf

In the rapidly evolving landscape of software development, the ability to generate code efficiently can significantly enhance productivity. The Cognitive Actions associated with the spec andreasjansson/codellama-34b-instruct-gguf provide a robust framework for developers looking to harness the power of AI to generate code with precision and flexibility. This article explores how to leverage these actions, particularly focusing on the action for generating code using grammars.

Prerequisites

Before diving into the integration of Cognitive Actions, ensure you have the following:

  • API Key: Register on the Cognitive Actions platform to obtain your API key, which will be used for authentication.
  • Setup: Familiarize yourself with the endpoint structure and ensure your development environment is ready for making HTTP requests.
  • Authentication: Generally, authentication is handled by including your API key in the request headers when calling the Cognitive Actions API.

Cognitive Actions Overview

Generate Code with Grammars

The Generate Code with Grammars action utilizes the CodeLlama-34B-instruct model to create code snippets based on user-defined prompts. The action supports grammars and JSON schema, allowing developers to specify the output format more effectively.

Input

To invoke this action, you will need to provide a JSON payload that adheres to the following schema:

{
  "topK": 10,
  "topP": 0.95,
  "prompt": "Write a Python program that counts the number of occurrences of a character in a string.",
  "grammar": "root        ::= \"```python\\ndef num_occurrences(c: str, s: str) -> int:\\n    \" code \"```\"\ncode        ::= [^`()]+",
  "jsonSchema": "",
  "temperature": 0.8,
  "mirostatRate": 0.1,
  "maximumTokens": 500,
  "presencePenalty": 0,
  "frequencyPenalty": 0,
  "repetitionPenalty": 1.1,
  "mirostatSamplingMode": "Disabled",
  "mirostatTargetEntropy": 5
}
  • Required Fields:
    • prompt: The text prompt that guides the code generation.
  • Optional Fields:
    • topK: Defines the number of highest probability tokens to keep during sampling (default: 10).
    • topP: Cumulative probability threshold for token selection (default: 0.95).
    • grammar: Specifies the output structure in GBNF format.
    • jsonSchema: Defines the format for the generated output.
    • temperature: Controls randomness in token selection (default: 0.8).
    • maximumTokens: The max number of tokens to generate (default: 500).
    • presencePenalty, frequencyPenalty, repetitionPenalty: Parameters to manage token generation dynamics.
    • mirostatSamplingMode: Determines the adaptive sampling strategy.
    • mirostatTargetEntropy: Influences randomness and diversity in code generation (default: 5).

Output

Upon successful execution, the action typically returns a response in the form of a generated code snippet. However, as seen in the example output below, there can also be error messages if the action fails:

<html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
</body>
</html>

This indicates that the server may be temporarily unavailable, which is an important aspect to handle in your application.

Conceptual Usage Example (Python)

Here’s a conceptual Python code snippet demonstrating how to call the Generate Code with Grammars action:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute" # Hypothetical endpoint

action_id = "7c5704ac-7776-40b8-bec1-4d46ad63011e" # Action ID for Generate Code with Grammars

# Construct the input payload based on the action's requirements
payload = {
    "topK": 10,
    "topP": 0.95,
    "prompt": "Write a Python program that counts the number of occurrences of a character in a string.",
    "grammar": "root        ::= \"```python\\ndef num_occurrences(c: str, s: str) -> int:\\n    \" code \"```\"\ncode        ::= [^`()]+",
    "jsonSchema": "",
    "temperature": 0.8,
    "mirostatRate": 0.1,
    "maximumTokens": 500,
    "presencePenalty": 0,
    "frequencyPenalty": 0,
    "repetitionPenalty": 1.1,
    "mirostatSamplingMode": "Disabled",
    "mirostatTargetEntropy": 5
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload} # Hypothetical structure
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this example, replace YOUR_COGNITIVE_ACTIONS_API_KEY with your actual API key. The payload variable is structured according to the action's requirements, and the request is sent to the specified endpoint. The response is then handled appropriately to either display the generated code or any error messages.

Conclusion

The Cognitive Actions from the andreasjansson/codellama-34b-instruct-gguf spec provide developers with powerful tools for automating code generation. By utilizing these actions, you can streamline your development process and focus more on building robust applications. Explore these capabilities further, and consider integrating them into your next project to harness the full potential of AI-driven code generation.

← Back to All Articles