AI 配置

本页将指导您完成部署和配置 Livepeer 网关以用于 AI 推理服务的过程。

网关模式

您可以运行一个网关

“Off-chain” -> 开发或本地模式
“On-chain” -> 生产模式，连接到基于区块链的 Livepeer 网络。

If you run your gateway off-chain - you will need to run your own Orchestrator node ie. have access to a GPU and set it up as an Orchestrator, in order to test Gateway functionality.

There is currently no Livepeer “Testnet” available which has Orchestrator offerings, though there are conversations underway to enable this in the future.Do you think Livepeer should have a “testnet” available for Gateways to connect to?Follow & contribute to the discussion in the Discord and on the Forum

部署用于 AI 推理服务的网关

您可以使用以下方法之一运行 Livepeer AI 软件：

Docker（推荐）：最简单、最优选的方法。
预构建二进制文件: 如果您不想使用 Docker，则可选择此方案。

部署 AI 网关

请按照以下步骤启动您的 Livepeer AI 网关节点。

These instructions apply to both on-chain & off-chain Gateway deployments.

Use Docker (Recommended)
Use Binaries

Retrieve the Livepeer AI Docker Image

Fetch the latest Livepeer AI Docker image with the following command:

Pull Docker Image

docker pull livepeer/go-livepeer:master

Launch a Localhost (Off-chain) AI Gateway

Run the Docker container for your AI Gateway node:

docker run \
    --name livepeer_ai_gateway \
    -v ~/.lpData2/:/root/.lpData2 \
    -p 8937:8937 \
    --network host \
    livepeer/go-livepeer:master \
    -datadir ~/.lpData2 \
    -gateway \
    -orchAddr <orchestrator list> \
    -httpAddr 0.0.0.0:8937 \
    -v 6 \
    -httpIngest

This command launches a local (off-chain) AI Gateway node. The flags are similar to those used for a Mainnet Transcoding Network Gateway.

(fixme) See the go-livepeer CLI reference for details.

Confirm Successful Startup

Upon successful startup, you should see output similar to:

I0501 11:07:47.609839       1 mediaserver.go:201] Transcode Job Type: [{P240p30fps16x9 600k 30 0 426x240 16:9 0 0 0s 0 0 0 0} {P360p30fps16x9 1200k 30 0 640x360 16:9 0 0 0s 0 0 0 0}]
I0501 11:07:47.609917       1 mediaserver.go:226] HTTP Server listening on http://0.0.0.0:8937
I0501 11:07:47.609963       1 lpms.go:92] LPMS Server listening on rtmp://127.0.0.1:1935

Check Port Availability

Ensure that port 8937 is open and accessible, and configure your router for port forwarding if necessary to make the Gateway accessible from the internet.

Add Howto

Test the AI Gateway

Follow the instructions in the AI Gateway Testing Guide to verify that the AI Gateway is operational.

Download the Latest Livepeer AI Binary

Download the latest Livepeer AI binary for your system:

wget https://build.livepeer.live/go-livepeer/livepeer-<OS>-<ARCH>.tar.gz

Replace <OS> and <ARCH> with your operating system and architecture (e.g., linux-amd64 for Linux AMD64). For more details, see the go-livepeer installation guide.

The Windows and MacOS (amd64) binaries of Livepeer AI are not available yet.

Extract and Configure the Binary

Once downloaded, extract the binary to a directory of your choice.

Launch an Off-chain AI Gateway

Start the AI Gateway node with the following command:

./livepeer \
    -datadir ~/.lpData2 \
    -gateway \
    -orchAddr <orchestrator list> \
    -httpAddr 0.0.0.0:8937 \
    -v 6 \
    -httpIngest

This command launches an off-chain AI Gateway node. Refer to the go-livepeer CLI reference for more details on the flags.

Confirm Successful Startup

Check the terminal for the following output to confirm successful startup:

I0501 11:07:47.609839       1 mediaserver.go:201] Transcode Job Type: [{P240p30fps16x9 600k 30 0 426x240 16:9 0 0 0s 0 0 0 0} {P360p30fps16x9 1200k 30 0 640x360 16:9 0 0 0s 0 0 0 0}]
I0501 11:07:47.609917       1 mediaserver.go:226] HTTP Server listening on http://0.0.0.0:8937
I0501 11:07:47.609963       1 lpms.go:92] LPMS Server listening on rtmp://127.0.0.1:1935

Check Port Availability

Ensure that port 8937 is open and accessible, and configure port forwarding if needed.

Test the AI Gateway

Follow the instructions in the AI Gateway Testing Guide to verify that the AI Gateway is operational.

If binaries are unavailable for your system, you can build the master branch of go-livepeer from source. Refer to the Livepeer installation guide or reach out to the Livepeer community on Discord for assistance.

网关代码链接

对于 AI 处理，Gateway 扩展其功能以处理 AI 专用工作流。

go-livepeer/server/ai_mediaserver.go

关键组件包括：

AISessionManager: 管理 AI 处理会话并选择具有 AI 能力的适当 Orchestratorai_http.go
MediaMTX 集成: 处理 AI 处理的媒体流
Trickle 协议: 启用高效流式传输以实现实时 AI 视频处理

AI 工作流 server/ai_process.go 涉及

验证 AI 流程,
选择支持 AI 的 Orchestrators,
处理支付 基于像素, 并
管理实时 AI 管道

Gateway Knowledge Hub

Quickstart ⚡

Gateway Services & Providers

Run A Gateway

Gateway Tools & Resources

Technical References

网关模式

部署用于 AI 推理服务的网关

部署 AI 网关

网关代码链接

go-livepeer/server/ai_mediaserver.go

Gateway Knowledge Hub

Quickstart ⚡

Gateway Services & Providers

Run A Gateway

Gateway Tools & Resources

Technical References

​网关模式

​部署用于 AI 推理服务的网关

​ @keyframes blink { 0%, 100% { opacity: 1; } 50% { opacity: 0.3; } } 部署 AI 网关

​网关代码链接

go-livepeer/server/ai_mediaserver.go

网关模式

部署用于 AI 推理服务的网关

部署 AI 网关

网关代码链接