Configuración de IA

Esta página lo guiará a través del proceso de implementación y configuración de un Livepeer Gateway para servicios de inferencia de IA.

Modos de Gateway

Puede ejecutar un gateway

“Fuera de cadena” -> modo dev o local
“En cadena” -> modo de producción conectado a la red Livepeer basada en blockchain.

If you run your gateway off-chain - you will need to run your own Orchestrator node ie. have access to a GPU and set it up as an Orchestrator, in order to test Gateway functionality.

There is currently no Livepeer “Testnet” available which has Orchestrator offerings, though there are conversations underway to enable this in the future.Do you think Livepeer should have a “testnet” available for Gateways to connect to?Follow & contribute to the discussion in the Discord and on the Forum

Implementar un Gateway para servicios de inferencia de IA

Puedes ejecutar el software de IA Livepeer utilizando uno de los siguientes métodos:

Docker (Recomendado): El método más sencillo y preferido.
Binarios preconstruidos: Una alternativa si prefieres no usar Docker.

Implementar una puerta de enlace de IA

Siga los pasos a continuación para iniciar su nodo de puerta de enlace de IA Livepeer.

These instructions apply to both on-chain & off-chain Gateway deployments.

Use Docker (Recommended)
Use Binaries

Retrieve the Livepeer AI Docker Image

Fetch the latest Livepeer AI Docker image with the following command:

Pull Docker Image

docker pull livepeer/go-livepeer:master

Launch a Localhost (Off-chain) AI Gateway

Run the Docker container for your AI Gateway node:

docker run \
    --name livepeer_ai_gateway \
    -v ~/.lpData2/:/root/.lpData2 \
    -p 8937:8937 \
    --network host \
    livepeer/go-livepeer:master \
    -datadir ~/.lpData2 \
    -gateway \
    -orchAddr <orchestrator list> \
    -httpAddr 0.0.0.0:8937 \
    -v 6 \
    -httpIngest

This command launches a local (off-chain) AI Gateway node. The flags are similar to those used for a Mainnet Transcoding Network Gateway.

(fixme) See the go-livepeer CLI reference for details.

Confirm Successful Startup

Upon successful startup, you should see output similar to:

I0501 11:07:47.609839       1 mediaserver.go:201] Transcode Job Type: [{P240p30fps16x9 600k 30 0 426x240 16:9 0 0 0s 0 0 0 0} {P360p30fps16x9 1200k 30 0 640x360 16:9 0 0 0s 0 0 0 0}]
I0501 11:07:47.609917       1 mediaserver.go:226] HTTP Server listening on http://0.0.0.0:8937
I0501 11:07:47.609963       1 lpms.go:92] LPMS Server listening on rtmp://127.0.0.1:1935

Check Port Availability

Ensure that port 8937 is open and accessible, and configure your router for port forwarding if necessary to make the Gateway accessible from the internet.

Add Howto

Test the AI Gateway

Follow the instructions in the AI Gateway Testing Guide to verify that the AI Gateway is operational.

Download the Latest Livepeer AI Binary

Download the latest Livepeer AI binary for your system:

wget https://build.livepeer.live/go-livepeer/livepeer-<OS>-<ARCH>.tar.gz

Replace <OS> and <ARCH> with your operating system and architecture (e.g., linux-amd64 for Linux AMD64). For more details, see the go-livepeer installation guide.

The Windows and MacOS (amd64) binaries of Livepeer AI are not available yet.

Extract and Configure the Binary

Once downloaded, extract the binary to a directory of your choice.

Launch an Off-chain AI Gateway

Start the AI Gateway node with the following command:

./livepeer \
    -datadir ~/.lpData2 \
    -gateway \
    -orchAddr <orchestrator list> \
    -httpAddr 0.0.0.0:8937 \
    -v 6 \
    -httpIngest

This command launches an off-chain AI Gateway node. Refer to the go-livepeer CLI reference for more details on the flags.

Confirm Successful Startup

Check the terminal for the following output to confirm successful startup:

I0501 11:07:47.609839       1 mediaserver.go:201] Transcode Job Type: [{P240p30fps16x9 600k 30 0 426x240 16:9 0 0 0s 0 0 0 0} {P360p30fps16x9 1200k 30 0 640x360 16:9 0 0 0s 0 0 0 0}]
I0501 11:07:47.609917       1 mediaserver.go:226] HTTP Server listening on http://0.0.0.0:8937
I0501 11:07:47.609963       1 lpms.go:92] LPMS Server listening on rtmp://127.0.0.1:1935

Check Port Availability

Ensure that port 8937 is open and accessible, and configure port forwarding if needed.

Test the AI Gateway

Follow the instructions in the AI Gateway Testing Guide to verify that the AI Gateway is operational.

If binaries are unavailable for your system, you can build the master branch of go-livepeer from source. Refer to the Livepeer installation guide or reach out to the Livepeer community on Discord for assistance.

Enlaces de código de la puerta de enlace

Para el procesamiento de IA, la puerta de enlace extiende su funcionalidad para manejar flujos de trabajo específicos de IA.

go-livepeer/server/ai_mediaserver.go

Los componentes clave incluyen:

AISessionManager: Gestiona las sesiones de procesamiento de IA y selecciona los Orquestadores adecuados con capacidades de IAai_http.go
Integración de MediaMTX: Maneja la transmisión de medios para el procesamiento de IA
Protocolo Trickle: Permite una transmisión eficiente para el procesamiento en tiempo real de videos de IA

El flujo de trabajo de IA server/ai_process.goimplica

autenticar flujos de IA,
seleccionar Orquestadores capaces de IA,
procesar pagos basados en píxeles, y
gestionando pipelines de IA en vivo

Gateway Knowledge Hub

Quickstart ⚡

Gateway Services & Providers

Run A Gateway

Gateway Tools & Resources

Technical References

Modos de Gateway

Implementar un Gateway para servicios de inferencia de IA

Implementar una puerta de enlace de IA

Enlaces de código de la puerta de enlace

go-livepeer/server/ai_mediaserver.go

Gateway Knowledge Hub

Quickstart ⚡

Gateway Services & Providers

Run A Gateway

Gateway Tools & Resources

Technical References

​Modos de Gateway

​Implementar un Gateway para servicios de inferencia de IA

​ @keyframes blink { 0%, 100% { opacity: 1; } 50% { opacity: 0.3; } } Implementar una puerta de enlace de IA

​Enlaces de código de la puerta de enlace

go-livepeer/server/ai_mediaserver.go

Modos de Gateway

Implementar un Gateway para servicios de inferencia de IA

Implementar una puerta de enlace de IA

Enlaces de código de la puerta de enlace