Overview
In brief:
Together, they form the backbone of the Livepeer AI video pipeline.
Gateway Responsibilities
Gateways act as the front door to the network:- Receive jobs from applications
- Determine required model, pipeline, or GPU
- Select the best Orchestrator based on performance and pricing
- Route the workload with low latency
- Return results to the client
- Publish marketplace offerings (models, pipelines, cost per frame, etc.)
Orchestrator Responsibilities
Orchestrators are GPU operators who run:- Real-time AI inference
- Daydream / ComfyStream pipelines
- BYOC containers
- Traditional transcoding
- GPU horsepower
- Model execution
- Deterministic and verifiable output
- Performance guarantees