Enhance Your Applications with Text-to-Speech Using Fish Speech Cognitive Actions

23 Apr 2025
Enhance Your Applications with Text-to-Speech Using Fish Speech Cognitive Actions

In the world of application development, incorporating advanced text-to-speech capabilities can significantly enhance user experience. The Fish Speech Cognitive Actions allow developers to leverage a sophisticated text-to-speech synthesis engine, offering features like zero-shot and few-shot capabilities, along with excellent bilingual support for Chinese and English. This blog post will guide you through integrating the "Generate Speech with Fish Speech V1.5" action into your applications, showcasing its powerful capabilities.

Prerequisites

Before you get started, ensure you have the following:

  • An API key for accessing the Cognitive Actions platform.
  • Familiarity with making HTTP requests and handling JSON payloads.

Authentication typically involves including your API key in the request headers. This ensures you have the necessary permissions to make API calls.

Cognitive Actions Overview

Generate Speech with Fish Speech V1.5

The Generate Speech with Fish Speech V1.5 action provides advanced text-to-speech synthesis. It is designed to create natural-sounding speech from text, utilizing a reference audio model for superior accuracy without phoneme dependency. This action is particularly beneficial for applications requiring high-quality audio outputs in both Chinese and English.

Input

The input for this action requires the following fields:

  • text (required): The text you want to convert into speech.
  • textReference (required): The text content that corresponds to the reference audio, providing additional context.
  • speakerReference (required): A URI pointing to the reference audio file that serves as a model for generating the speech.

Here’s an example input JSON payload:

{
  "text": "我的猫，就是全世界最好的猫！",
  "textReference": "希望你以后能够做得比我还好哟！",
  "speakerReference": "https://replicate.delivery/pbxt/MhG1jpArOiucMqSja15lT6c1oEddigVDkJdx7VYa7fTB6Du8/zero_shot_prompt.wav"
}

Output

The action typically returns a URL pointing to the generated audio file. Here’s an example of what the output might look like:

"https://assets.cognitiveactions.com/invocations/a465caac-4cbd-40f3-b9c4-06b72ed543a6/e42144b2-7191-4eb0-a95f-45b29b58843d.wav"

This URL can be used to access the synthesized speech audio file directly.

Conceptual Usage Example (Python)

Below is a conceptual Python code snippet demonstrating how you might call the Fish Speech Cognitive Action:

import requests
import json

# Replace with your Cognitive Actions API key and endpoint
COGNITIVE_ACTIONS_API_KEY = "YOUR_COGNITIVE_ACTIONS_API_KEY"
COGNITIVE_ACTIONS_EXECUTE_URL = "https://api.cognitiveactions.com/actions/execute"  # Hypothetical endpoint

action_id = "94837fb2-2ffc-46e0-b724-6e7f29af7d34"  # Action ID for Generate Speech with Fish Speech V1.5

# Construct the input payload based on the action's requirements
payload = {
    "text": "我的猫，就是全世界最好的猫！",
    "textReference": "希望你以后能够做得比我还好哟！",
    "speakerReference": "https://replicate.delivery/pbxt/MhG1jpArOiucMqSja15lT6c1oEddigVDkJdx7VYa7fTB6Du8/zero_shot_prompt.wav"
}

headers = {
    "Authorization": f"Bearer {COGNITIVE_ACTIONS_API_KEY}",
    "Content-Type": "application/json"
}

try:
    response = requests.post(
        COGNITIVE_ACTIONS_EXECUTE_URL,
        headers=headers,
        json={"action_id": action_id, "inputs": payload}  # Hypothetical structure
    )
    response.raise_for_status()  # Raise an exception for bad status codes (4xx or 5xx)

    result = response.json()
    print("Action executed successfully:")
    print(json.dumps(result, indent=2))

except requests.exceptions.RequestException as e:
    print(f"Error executing action {action_id}: {e}")
    if e.response is not None:
        print(f"Response status: {e.response.status_code}")
        try:
            print(f"Response body: {e.response.json()}")
        except json.JSONDecodeError:
            print(f"Response body: {e.response.text}")

In this code snippet:

  • Replace YOUR_COGNITIVE_ACTIONS_API_KEY with your actual API key.
  • The payload variable is structured according to the input schema.
  • The action ID is set to correspond to the "Generate Speech with Fish Speech V1.5" action.
  • This example demonstrates how to handle HTTP requests and process the response effectively.

Conclusion

Integrating the Fish Speech Cognitive Action into your applications can dramatically improve user interaction by providing high-quality speech synthesis. The benefits of advanced features like bilingual support and reference-based audio modeling make it a compelling choice for developers looking to enhance their applications. Consider exploring additional use cases, such as incorporating this action into virtual assistants, educational tools, or accessibility features to further enrich user experiences. Happy coding!

← Back to All Articles