GPU cloud / RTX 4090 vs L40S
RTX 4090 vs L40S for inference
VRAM: RTX 4090 24 GB; L40S 48 GB. 70B 4-bit estimated memory with 20% headroom: 42.0 GB. Throughput depends on model and workload; enter a measured rate in the cost calculator.
| GPU | Provider | VRAM | GPU count | USD/hour | $/GB/hr | Billing | Type | Verified | Source |
|---|---|---|---|---|---|---|---|---|---|
| RTX 4090 | salad | 24 GB | 1 | $0.16lowest priority | $0.007 | per-second | interruptible | 2026-09-26 | Official price ↗ |
| RTX 4090 | tensordock | 24 GB | 1 | from $0.35 | $0.015 | hourly | on-demand | 2026-09-26 | Official price ↗ |
| L40S | runpod | 48 GB | 1 | $1.09 | $0.023 | per-second | on-demand | 2026-09-26 | Official price ↗ |
| RTX 4090 | runpod | 24 GB | 1 | $0.74 | $0.031 | per-second | on-demand | 2026-09-26 | Official price ↗ |
| L40S | modal | 48 GB | 1 | $1.95GPU only | $0.041 | per-second | on-demand | 2026-09-26 | Official price ↗ |
Each price has an official source and verification date. Rates and availability change; affiliate links, if added later, will be marked sponsored.