OpenRelay logo

OpenRelay

Inference routing across available GPUs

HQ
United States of America flagUSA
Locations
3
OpenRelay homepage OpenRelay homepage

At a glance GPU prices checked 13 minutes ago

Cheapest GPU
$0.18 /GPU/hr
RTX 3090 · on-demand
B300
$8.49 /GPU/hr
on-demand
In stock
3 /15
GPU models
Egress
Free
Free and unlimited

What's good about OpenRelay

  • Nvidia and AMD GPUs, from RTX 3090 to B300
  • No egress fees, disk included in the hourly rate
  • Whole GPUs passed through with root SSH access
  • OpenAI-compatible inference API billed per token

Pricing & billing

Pricing page

Priced per GPU. VMs bill by the hour and containers by the second. Disk, storage and egress are included in the rate.

Price point Configuration Estimated cost
Egress Free and unlimited

Heads up: Figures take each provider's closest plan to a common setup, and vary by region and usage. Verify before provisioning. More on how we price.

OpenRelay GPUs

How this list works

Order

  • By GPU model: one card per GPU, the most looked-up models first, then the most widely offered ones.
  • By configuration: every configuration we track. What you can rent now comes first, and within that one row per GPU model before any repeats, so the opening rows cover the range rather than one model's sizes.

The price on a card

Each card leads with a per GPU per hour rate. We prefer configurations the provider reports as in stock, on-demand rates before reserved or spot, then take the lowest per-GPU rate among those.

Search

We match the GPU model, form factor, billing type, availability and instance name. Matching is partial and case-insensitive. Everyday words work too, so "interruptible" finds spot and "sold out" finds out of stock.

Transparency and funding

  • Ads and sponsors: Paid placements sit at the top of the list and are always labeled as sponsored content. Sponsorship never influences the organic ranking itself.
  • Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.
  • Prices: Shown in USD, converted at daily reference rates where a provider publishes in another currency. A month means 720 hours. Pricing methodology.

OpenRelay lists 15 GPU models across 16 configurations, including the B300, H100 and B200. Prices start at $0.18 /GPU/hr on demand.

Nvidia

1 config 1x

On-Demand
from $8.49
From $8.49 /GPU/hr On-Demand
Visit website
Nvidia

Nvidia H100

Out of stock

2 configs 1x

On-Demand
from $2.20
From $2.20 /GPU/hr On-Demand PCIe
Visit website
Nvidia

1 config 1x

On-Demand
from $6.30
From $6.30 /GPU/hr On-Demand
Visit website
Nvidia

1 config 1x

On-Demand
from $1.55
From $1.55 /GPU/hr On-Demand
Visit website
Nvidia

Nvidia RTX 5090

Out of stock

1 config 1x

On-Demand
from $0.52
From $0.52 /GPU/hr On-Demand
Visit website
Nvidia

Nvidia A100

In stock

1 config 1x

On-Demand
from $1.10
From $1.10 /GPU/hr On-Demand
Visit website
Nvidia

Nvidia RTX 4090

Out of stock

1 config 1x

On-Demand
from $0.35
From $0.35 /GPU/hr On-Demand
Visit website
Nvidia

Nvidia RTX 3090

In stock

1 config 1x

On-Demand
from $0.18
From $0.18 /GPU/hr On-Demand
Visit website
AMD

1 config 1x

On-Demand
from $6.30
From $6.30 /GPU/hr On-Demand
Visit website
AMD

AMD MI300X

Out of stock

1 config 1x

On-Demand
from $1.99
From $1.99 /GPU/hr On-Demand
Visit website
AMD

AMD MI325X

Out of stock

1 config 1x

On-Demand
from $2.25
From $2.25 /GPU/hr On-Demand
Visit website
Nvidia

Nvidia L4

Out of stock

1 config 1x

On-Demand
from $0.43
From $0.43 /GPU/hr On-Demand
Visit website
AMD

AMD MI350X

Out of stock

1 config 1x

On-Demand
from $3.99
From $3.99 /GPU/hr On-Demand
Visit website
Nvidia

Nvidia RTX 4000 Ada

Out of stock

1 config 1x

On-Demand
from $0.25
From $0.25 /GPU/hr On-Demand
Visit website
Nvidia

Nvidia RTX 5000 Ada

Out of stock

1 config 1x

On-Demand
from $0.50
From $0.50 /GPU/hr On-Demand
Visit website

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Verify before provisioning. More on how we price. See OpenRelay's pricing.

About OpenRelay

OpenRelay is a distributed GPU cloud headquartered in San Francisco and backed by Y Combinator. It rents whole Nvidia and AMD GPUs from its own servers, partner data centers and third-party hosts as Ubuntu VMs and containers.

It runs an OpenAI-compatible inference API billed per token, and managed Kubernetes.

Services

OpenRelay offers 3 of the 27 services we track.

Locations

Based on our records, OpenRelay operates in 3 countries.

Country Location Region code
Canada flagCanada Canada ca
United Kingdom flagUK United Kingdom gb
United States of America flagUSA United States us

Alternatives to OpenRelay

Compare OpenRelay against other cloud providers.

Our data for OpenRelay was last updated on Nov. 9, 2026.