text-to-speech

Enhance User Experience with Fish Speech Text-to-Speech Actions

26 Apr 2025
Enhance User Experience with Fish Speech Text-to-Speech Actions

In today’s digital world, delivering content in an engaging and accessible manner is crucial. The Fishspeech 1 2 service provides developers with powerful Cognitive Actions that transform textual content into synthetic speech, enhancing user interaction and experience. Utilizing advanced speech synthesis technology, this service allows for personalized text-to-speech capabilities, making it ideal for applications ranging from educational tools to interactive storytelling.

Imagine integrating realistic voiceovers into your applications, improving accessibility for users with reading difficulties, or simply adding a unique touch to your digital content. The Fishspeech 1 2 service is designed to simplify this process, offering improved speech quality and realism that can elevate your projects significantly.

Prerequisites

To get started, you'll need a Cognitive Actions API key and a fundamental understanding of making API calls.

Convert Text to Fish Speech

The Convert Text to Fish Speech action is designed to transform textual content into synthetic speech, leveraging the Fish Speech V1.2 model. This action addresses the need for high-quality, realistic speech synthesis in various applications.

Input Requirements

To utilize this action, you need to provide the following inputs:

  • text: The main body of content to be processed, represented as a string (e.g., "With tenure, Suzie'd have all the more leisure for yachting, but her publications are no good.").
  • textReference: A reference string related to the main text, used for context or correlation (e.g., "and keeping eternity before the eyes, though much").
  • speakerReference: A URI pointing to the audio file of the speaker, which is necessary for processing (e.g., "https://replicate.delivery/pbxt/MNFXdPaUPOwYCZjZM4azsymbzE2TCV2WJXfGpeV2DrFWaSq8/example_en.wav").

Expected Output

Upon successful processing, the action returns a URI to the generated audio file of the synthesized speech, allowing you to easily integrate it into your application (e.g., "https://assets.cognitiveactions.com/invocations/3124c18e-4769-4f5d-a2ab-b14a3ba0d5c3/17f45b79-27ba-4fe2-b12d-cd8c50ccce2e.wav").

Use Cases for this Specific Action

  • Education: Create engaging audio materials for learning platforms, helping students absorb information more effectively through auditory means.
  • Accessibility: Support users with visual impairments or reading difficulties by providing audio versions of written content.
  • Entertainment: Develop interactive storytelling applications where users can listen to narratives in a natural-sounding voice, enhancing the overall experience.
  • Marketing: Generate personalized voice messages or advertisements that resonate with users, making your campaigns more impactful.
import requests
import json

# Replace with your actual Cognitive Actions API key and endpoint
# Ensure your environment securely handles the API key
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
# This endpoint URL is hypothetical and should be documented for users
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"

action_id = "f6520c7f-0533-4f4e-be7e-e753a91a3926" # Action ID for: Convert Text to Fish Speech

# Construct the exact input payload based on the action's requirements
# This example uses the predefined example_input for this action:
payload = {
  "text": "With tenure, Suzie'd have all the more leisure for yachting, but her publications are no good.",
  "textReference": "and keeping eternity before the eyes, though much",
  "speakerReference": "https://replicate.delivery/pbxt/MNFXdPaUPOwYCZjZM4azsymbzE2TCV2WJXfGpeV2DrFWaSq8/example_en.wav"
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json",
    # Add any other required headers for the Cognitive Actions API
}

# Prepare the request body for the hypothetical execution endpoint
request_body = {
    "action_id": action_id,
    "inputs": payload
}

print(f"--- Calling Cognitive Action: {action.name or action_id} ---")
print(f"Endpoint: {COGNITIVE_ACTIONS_EXECUTE_URL}")
print(f"Action ID: {action_id}")
print("Payload being sent:")
print(json.dumps(request_body, indent=2))
print("------------------------------------------------")

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json=request_body
    )
    response.raise_for_status() # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully. Result:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body (non-JSON): {e.response.text}")
    print("------------------------------------------------")

Conclusion

The Fishspeech 1 2 service empowers developers to create more engaging and accessible applications through its robust text-to-speech capabilities. With its ability to deliver high-quality, personalized audio content, this service opens up a world of possibilities for enhancing user interactions. As you explore its capabilities, consider how you might integrate this technology into your projects to improve user experience and accessibility. Start experimenting with the Convert Text to Fish Speech action today to elevate your applications to new heights!

← Back to All Articles