speech-to-text

Transform Audio to Text Effortlessly with Whisper

26 Apr 2025
Transform Audio to Text Effortlessly with Whisper

In today's fast-paced digital landscape, the need for efficient and accurate transcription services is more critical than ever. Whisper offers a robust API that leverages advanced speech recognition technology to convert spoken language into written text seamlessly. This service not only enhances productivity but also simplifies the process of managing audio content. Whether you're developing applications for accessibility, content creation, or data analysis, Whisper's Cognitive Actions provide a powerful solution tailored for developers.

Imagine scenarios where you need to transcribe interviews, meetings, or lectures. Whisper can handle these tasks swiftly, providing high accuracy and multilingual support, making it a versatile tool for various applications. With features like automatic language detection and the option to translate text to English, Whisper ensures that you can cater to diverse user needs without any hassle.

Prerequisites

To get started with Whisper, you'll need a Cognitive Actions API key and a basic understanding of making API calls. This will allow you to integrate the speech-to-text functionalities into your applications effectively.

Convert Speech to Text

The Convert Speech to Text action utilizes the Whisper Large-v3 model, renowned for its state-of-the-art performance in speech recognition. This action efficiently transforms audio speech into text, addressing the need for accurate transcription in various contexts.

Purpose

This action solves the problem of converting audio content into readable text, which is essential for applications ranging from content creation to accessibility features for the hearing impaired.

Input Requirements

The input for this action requires an audio file, specified by a URI, along with optional parameters such as the spoken language, transcription format, and additional settings to fine-tune the output. The following are key parameters:

  • audio: URI of the audio file (e.g., https://example.com/audiofile.wav).
  • language: The spoken language, with options for automatic detection.
  • transcriptionFormat: Determines the format of the output (e.g., plain text, SRT, VTT).

Expected Output

The output consists of a transcription of the audio, including segments of text with timing information. It also provides details on the detected language and optional translation if requested. For example, the output may look like this:

{
  "transcription": "The little tales they tell are false...",
  "detected_language": "english",
  "segments": [
    {
      "id": 0,
      "start": 0,
      "end": 18.6,
      "text": "The little tales they tell are false..."
    }
  ]
}

Use Cases for this Specific Action

  • Content Creation: Journalists and content creators can use Whisper to transcribe interviews and speeches, saving time and ensuring accuracy.
  • Accessibility: Developers can integrate this action into applications aimed at providing accessibility features for individuals with hearing impairments.
  • Data Analysis: Businesses can analyze customer feedback or call center recordings by converting them into text for further processing.

```python
import requests
import json

# Replace with your actual Cognitive Actions API key and endpoint
# Ensure your environment securely handles the API key
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
# This endpoint URL is hypothetical and should be documented for users
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"

action_id = "6a2b4049-6e4d-4dba-b29c-06a630f5f273" # Action ID for: Convert Speech to Text

# Construct the exact input payload based on the action's requirements
# This example uses the predefined example_input for this action:
payload = {
  "audio": "https://replicate.delivery/mgxm/e5159b1b-508a-4be4-b892-e1eb47850bdc/OSR_uk_000_0050_8k.wav",
  "translate": false,
  "temperature": 0,
  "suppressTokens": "-1",
  "noSpeechThreshold": 0.6,
  "transcriptionFormat": "plain text",
  "conditionOnPreviousText": true,
  "logProbabilityThreshold": -1,
  "compressionRatioThreshold": 2.4,
  "temperatureIncrementOnFallback": 0.2
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json",
    # Add any other required headers for the Cognitive Actions API
}

# Prepare the request body for the hypothetical execution endpoint
request_body = {
    "action_id": action_id,
    "inputs": payload
}

print(f"--- Calling Cognitive Action: {action.name or action_id} ---")
print(f"Endpoint: {COGNITIVE_ACTIONS_EXECUTE_URL}")
print(f"Action ID: {action_id}")
print("Payload being sent:")
print(json.dumps(request_body, indent=2))
print("------------------------------------------------")

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json=request_body
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully. Result:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body (non-JSON): {e.response.text}")
    print("------------------------------------------------")



## Conclusion
Whisper's Convert Speech to Text action offers a powerful tool for developers looking to integrate speech recognition capabilities into their applications. By streamlining the transcription process and providing multilingual support, Whisper enhances productivity and accessibility. With its advanced features, you can cater to a wide range of use cases, from content creation to data analysis. 

To harness the full potential of Whisper, consider exploring additional functionalities or integrating it with other services that can further enhance your application's capabilities.
← Back to All Articles