GPU cloud / L40S
L40S cloud pricing
48 GB VRAM per GPU. Compare 2 sourced offers. Use measured tokens/second from your own model and setup to calculate per-million-token costs.
| GPU | Provider | VRAM | GPU count | USD/hour | $/GB/hr | Billing | Type | Verified | Source |
|---|---|---|---|---|---|---|---|---|---|
| L40S | runpod | 48 GB | 1 | $1.09 | $0.023 | per-second | on-demand | 2026-09-26 | Official price ↗ |
| L40S | modal | 48 GB | 1 | $1.95GPU only | $0.041 | per-second | on-demand | 2026-09-26 | Official price ↗ |
What fits in VRAM? (estimate)
4-bit weights with 20% headroom; real KV cache, context length and framework overhead vary. Multi-GPU memory is not automatically pooled.
- 7B: ~4.2 GB — fits by this estimate
- 13B: ~7.8 GB — fits by this estimate
- 30B: ~18.0 GB — fits by this estimate
- 70B: ~42.0 GB — fits by this estimate
Adjust precision and headroom →
Inference throughput and cost per 1M tokens
No comparable public throughput benchmark has been verified for this card. Enter your own measured tokens/second; the site does not assume a speed.
Calculate cost per million tokens →
GPU comparisons
Prices can change. Each offer links its official source and verification date. Affiliate links, if added later, will be marked sponsored.