Audio-to-Text

​

Overview

The audio-to-text pipeline converts audio from media files into text, utilizing cutting-edge diffusion models from HuggingFace’s automatic-speech-recognition (ASR) pipeline.

​

Models

​

Warm Models

The current warm model requested for the audio-to-text pipeline is:

• openai/whisper-large-v3: Whisper is a pre-trained model for automatic speech recognition (ASR) and speech translation.

​

On-Demand Models

The following models have been tested and verified for the audio-to-text pipeline:

​

Basic Usage Instructions

To create an audio transcript using the audio-to-text pipeline, submit a POST request to the Gateway’s audio-to-text API endpoint:

curl -X POST "https://<gateway-ip>/audio-to-text" \
    -F model_id=openai/whisper-large-v3 \
    -F audio=@<PATH_TO_FILE>

In this command:

• <gateway-ip> should be replaced with your AI Gateway’s IP address.
• model_id is the diffusion model for image generation.
• audio is the path to the audio file to be transcribed.

For additional optional parameters, refer to the AI Subnet API Reference.

After execution, the Orchestrator processes the request and returns the response to the Gateway:

{
    "chunks": [
        {
            "text": " Explore the power of automatic speech recognition",
            "timestamp": [
                0,
                1.35
            ]
        },
        {
            "text": " By extracting the text from audio",
            "timestamp": [
                1.35
                2.07
            ]
        }
    ],
    "text": " Explore the power of automatic speech recognition By extracting the text from audio"
}

​

API Reference