GPU cloud / RTX 4090
RTX 4090 cloud pricing
24 GB VRAM per GPU. Compare 3 sourced offers. Use measured tokens/second from your own model and setup to calculate per-million-token costs.
| GPU | Provider | VRAM | GPU count | USD/hour | $/GB/hr | Billing | Type | Verified | Source |
|---|---|---|---|---|---|---|---|---|---|
| RTX 4090 | salad | 24 GB | 1 | $0.16lowest priority | $0.007 | per-second | interruptible | 2026-09-26 | Official price ↗ |
| RTX 4090 | tensordock | 24 GB | 1 | from $0.35 | $0.015 | hourly | on-demand | 2026-09-26 | Official price ↗ |
| RTX 4090 | runpod | 24 GB | 1 | $0.74 | $0.031 | per-second | on-demand | 2026-09-26 | Official price ↗ |
What fits in VRAM? (estimate)
4-bit weights with 20% headroom; real KV cache, context length and framework overhead vary. Multi-GPU memory is not automatically pooled.
- 7B: ~4.2 GB — fits by this estimate
- 13B: ~7.8 GB — fits by this estimate
- 30B: ~18.0 GB — fits by this estimate
- 70B: ~42.0 GB — exceeds single-card VRAM
Adjust precision and headroom →
Inference throughput and cost per 1M tokens
No comparable public throughput benchmark has been verified for this card. Enter your own measured tokens/second; the site does not assume a speed.
Calculate cost per million tokens →
GPU comparisons
Prices can change. Each offer links its official source and verification date. Affiliate links, if added later, will be marked sponsored.