Most deployedCloud GPU
NVIDIA

GeForce RTX 4090

GeForce RTX 4090 is available through OneInfer GPU marketplace with live provider pricing, regions, VRAM, and deployment options from the API.

VRAM
24GB
Best price
$0.33/gpu/hr
Providers
11 available
Regions
36 regions
VRAM
24GB
CUDA cores
16,384
TDP
450W
Bandwidth
N/A
Process node
5nm
Launch date
N/A

Available from 11 providers

Sorted by price · click price to re-sort
ProviderRegionsConfigPrice / hr Availability
novitanovita
EU-DE-02, JP-TYO-02, US-CA-06, US-CA-NAS-01, AF-ZA-01, AS-AE-01, AS-IN-01, AS-SG-02, CN-HK-01, SA-BR-01, OC-AU-011x 24GB$0.33Limited
vastaivastai
EU-GE-01, EU-HU-01, EU-IS-01, AS-IN-01, US-MT-01, EU-NO-01, US-OR-01, CA-QC-01, EU-ES-01, EU-SE-01, AS-TW-01, US-TX-01, EU-NL-01, EU-GB-011x 24GB$0.38Limited
vastaivastai
US-CA-01, AS-JP-01, AS-MO-01, US-WA-011x 24GB$0.42Limited
vastaivastai
CA-BC-011x 24GB$0.47Limited
runpodrunpod
EU-RO-01, EU-IS-01, EU-IS-02, EU-CZ-01, US-NC-011x 24GB$0.74Limited
vastaivastai
EU-HU-01, EU-IS-01, EU-NO-01, AF-ZA-01, EU-ES-01, AS-TW-01, EU-NL-01, EU-UA-01, EU-GB-01, US-WA-012x 24GB$0.80In stock
vastaivastai
EU-BG-01, EU-HU-01, AS-JP-01, EU-NO-01, AS-TW-01, EU-NL-01, EU-GB-014x 24GB$1.55In stock
vastaivastai
US-CA-01, AS-MO-012x 24GB$1.61In stock
vastaivastai
US-WA-014x 24GB$5.34In stock
vastaivastai
US-MD-0112x 24GB$6.08In stock
vastaivastai
EU-GE-0114x 24GB$7.10In stock

Full specifications

Data from GPU specs and provider APIs
AI TOPS1,321
FP8 TFLOPS1,321
FP16 TFLOPS82.58
BF16 TFLOPS82.58
FP32 TFLOPS82.58
INT8 TOPS1,321
Sparse multiplier2

Benchmarks

GeForce RTX 4090 vs comparable GPUs on the platform

Inference throughput

7B model · tokens/sec

B200 SXM15,000
H200 SXM8,500
H100620
A100500
GeForce RTX 5090180

Training performance

Overall training multiplier

B200 SXM30x
H200 SXM18x
H10015x
A1003.4x
L40S2.8x

GeekBench OpenCL

Compute benchmark score

GeForce RTX 5090367,740
H200 SXM343,598
L40S337,706
H100336,474
B200 SXM333,768

Best for

LLM fine-tuningHigh-throughput inferenceMulti-modal model trainingLarge-batch distributed trainingRAG pipelines at scale

Similar GPUs

Ready to deploy GeForce RTX 4090?

Spin up an instance in minutes from your choice of 11 providers.