Overview

The Livepeer AI network’s upscale pipeline provides advanced image upscaling. Powered by the latest diffusion models in HuggingFace’s super-resolution pipeline, it enhances the resolution of input images by a factor of 4.

Models

Warm Models

The current warm model requested for the upscale pipeline is:

For faster responses with different upscale compatible diffusion models, ask Orchestrators to load it on their GPU via the ai-video channel in Discord Server.

On-Demand Models

The following models have been tested and verified for the upscale pipeline:

If a specific model you wish to use is not listed, please submit a feature request on GitHub to get the model verified and added to the list.

Basic Usage Instructions

For a detailed understanding of the upscale endpoint and to experiment with the API, see the Livepeer AI API Reference.

To generate an image with the upscale pipeline, send a POST request to the Gateway’s upscale API endpoint:

curl -X POST https://<GATEWAY_IP>/upscale \
    -F model_id="stabilityai/stable-diffusion-x4-upscaler" \
    -F image=@<PATH_TO_IMAGE>/low_res_cat.png \
    -F prompt="A white cat"

In this command:

  • <GATEWAY_IP> should be replaced with your AI Gateway’s IP address.
  • model_id is the diffusion model for image generation.
  • The image field holds the absolute path to the image file to be upscaled.
  • prompt is a descriptive text that provides context about the content of the image.

For additional optional parameters, refer to the Livepeer AI API Reference.

After execution, the Orchestrator processes the request and returns the response to the Gateway:

{
  "images": [
    {
      "nsfw": false,
      "seed": 3197613440,
      "url": "https://<GATEWAY_IP>/stream/dd5ad78d/7adde483.png"
    }
  ]
}

The url in the response is the URL of the generated image. Download the image with:

curl -O "https://<GATEWAY_IP>/stream/dd5ad78d/7adde483.png"

Orchestrator Configuration

To configure your Orchestrator to serve the upscale pipeline, refer to the Orchestrator Configuration guide.

System Requirements

The following system requirements are recommended for optimal performance:

We are planning to simplify the pricing in the future so orchestrators can set one AI price per compute unit and have the system automatically scale based on the model’s compute requirements.

The pricing for the upscale pipeline is based on competitor pricing. However, we strongly encourage orchestrators to set their own pricing based on their costs and requirements. Setting a competitive price will help attract more jobs, as Gateways can set their maximum price for a job. The current recommended pricing for this pipeline is 1.9073484e-08 USD per input pixel (height * width).

API Reference

API Reference

Explore the upscale endpoint and experiment with the API in the Livepeer AI API Reference.