GPU-Bench.click

GPU Rankings

Comprehensive database of GPUs for AI inference. Filter by category, compare specifications, and find the best hardware for your AI deployment needs.

Consumer GPUs

32
RTX 5090

NVIDIA

32GB VRAM

Architecture

Blackwell

Release Year

2025

Memory Bandwidth

1792 GB/s

TDP

575W

1,999
$62/GB
RTX 5080

NVIDIA

16GB VRAM

Architecture

Blackwell

Release Year

2025

Memory Bandwidth

960 GB/s

TDP

360W

999
$62/GB
RTX 5070 Ti

NVIDIA

16GB VRAM

Architecture

Blackwell

Release Year

2025

Memory Bandwidth

896 GB/s

TDP

300W

749
$47/GB
RTX 5070

NVIDIA

12GB VRAM

Architecture

Blackwell

Release Year

2025

Memory Bandwidth

672 GB/s

TDP

250W

549
$46/GB
RTX 5060 Ti

NVIDIA

16GB VRAM

Architecture

Blackwell

Release Year

2025

Memory Bandwidth

448 GB/s

TDP

180W

429
$27/GB
RTX 5060

NVIDIA

8GB VRAM

Architecture

Blackwell

Release Year

2025

Memory Bandwidth

384 GB/s

TDP

150W

299
$37/GB
RTX 4090

NVIDIA

24GB VRAM

Architecture

Ada Lovelace

Release Year

2022

Memory Bandwidth

1008 GB/s

TDP

450W

1,599
$67/GB
RTX 4080 Super

NVIDIA

16GB VRAM

Architecture

Ada Lovelace

Release Year

2024

Memory Bandwidth

736 GB/s

TDP

320W

999
$62/GB
RTX 4080

NVIDIA

16GB VRAM

Architecture

Ada Lovelace

Release Year

2022

Memory Bandwidth

717 GB/s

TDP

320W

1,199
$75/GB
RTX 4070 Ti Super

NVIDIA

16GB VRAM

Architecture

Ada Lovelace

Release Year

2024

Memory Bandwidth

672 GB/s

TDP

285W

799
$50/GB
RTX 4070 Ti

NVIDIA

12GB VRAM

Architecture

Ada Lovelace

Release Year

2023

Memory Bandwidth

504 GB/s

TDP

285W

799
$67/GB
RTX 4070 Super

NVIDIA

12GB VRAM

Architecture

Ada Lovelace

Release Year

2024

Memory Bandwidth

504 GB/s

TDP

220W

599
$50/GB
RTX 4070

NVIDIA

12GB VRAM

Architecture

Ada Lovelace

Release Year

2023

Memory Bandwidth

504 GB/s

TDP

200W

599
$50/GB
RTX 4060 Ti

NVIDIA

16GB VRAM

Architecture

Ada Lovelace

Release Year

2023

Memory Bandwidth

288 GB/s

TDP

165W

499
$31/GB
RTX 4060

NVIDIA

8GB VRAM

Architecture

Ada Lovelace

Release Year

2023

Memory Bandwidth

272 GB/s

TDP

115W

299
$37/GB
RTX 3090 Ti

NVIDIA

24GB VRAM

Architecture

Ampere

Release Year

2022

Memory Bandwidth

1008 GB/s

TDP

450W

1,999
$83/GB
RTX 3090

NVIDIA

24GB VRAM

Architecture

Ampere

Release Year

2020

Memory Bandwidth

936 GB/s

TDP

350W

1,499
$62/GB
RTX 3080 Ti

NVIDIA

12GB VRAM

Architecture

Ampere

Release Year

2021

Memory Bandwidth

912 GB/s

TDP

350W

1,199
$100/GB
RTX 3080

NVIDIA

10GB VRAM

Architecture

Ampere

Release Year

2020

Memory Bandwidth

760 GB/s

TDP

320W

699
$70/GB
RTX 3070 Ti

NVIDIA

8GB VRAM

Architecture

Ampere

Release Year

2021

Memory Bandwidth

608 GB/s

TDP

290W

599
$75/GB
RTX 3070

NVIDIA

8GB VRAM

Architecture

Ampere

Release Year

2020

Memory Bandwidth

448 GB/s

TDP

220W

499
$62/GB
RTX 3060 Ti

NVIDIA

8GB VRAM

Architecture

Ampere

Release Year

2020

Memory Bandwidth

448 GB/s

TDP

200W

399
$50/GB
RTX 3060

NVIDIA

12GB VRAM

Architecture

Ampere

Release Year

2021

Memory Bandwidth

360 GB/s

TDP

170W

329
$27/GB
RX 7900 XTX

AMD

24GB VRAM

Architecture

RDNA 3

Release Year

2022

Memory Bandwidth

960 GB/s

TDP

355W

999
$42/GB
RX 7900 XT

AMD

20GB VRAM

Architecture

RDNA 3

Release Year

2022

Memory Bandwidth

800 GB/s

TDP

315W

899
$45/GB
RX 7800 XT

AMD

16GB VRAM

Architecture

RDNA 3

Release Year

2023

Memory Bandwidth

624 GB/s

TDP

263W

499
$31/GB
RX 7700 XT

AMD

12GB VRAM

Architecture

RDNA 3

Release Year

2023

Memory Bandwidth

432 GB/s

TDP

245W

449
$37/GB
RX 7600

AMD

8GB VRAM

Architecture

RDNA 3

Release Year

2023

Memory Bandwidth

288 GB/s

TDP

165W

269
$34/GB
Arc A770

Intel

16GB VRAM

Architecture

Alchemist

Release Year

2022

Memory Bandwidth

560 GB/s

TDP

225W

349
$22/GB
Arc A750

Intel

8GB VRAM

Architecture

Alchemist

Release Year

2022

Memory Bandwidth

512 GB/s

TDP

225W

289
$36/GB
Arc A580

Intel

8GB VRAM

Architecture

Alchemist

Release Year

2023

Memory Bandwidth

512 GB/s

TDP

185W

179
$22/GB
Arc A380

Intel

6GB VRAM

Architecture

Alchemist

Release Year

2022

Memory Bandwidth

186 GB/s

TDP

75W

139
$23/GB

Workstation GPUs

9
RTX 6000 Ada

NVIDIA

48GB VRAM

Architecture

Ada Lovelace

Release Year

2022

Memory Bandwidth

960 GB/s

TDP

300W

6,800
$142/GB
RTX 5000 Ada

NVIDIA

32GB VRAM

Architecture

Ada Lovelace

Release Year

2023

Memory Bandwidth

800 GB/s

TDP

250W

4,000
$125/GB
RTX 4500 Ada

NVIDIA

24GB VRAM

Architecture

Ada Lovelace

Release Year

2023

Memory Bandwidth

640 GB/s

TDP

210W

2,800
$117/GB
RTX 4000 Ada

NVIDIA

20GB VRAM

Architecture

Ada Lovelace

Release Year

2023

Memory Bandwidth

448 GB/s

TDP

130W

1,250
$63/GB
RTX A6000

NVIDIA

48GB VRAM

Architecture

Ampere

Release Year

2020

Memory Bandwidth

768 GB/s

TDP

300W

4,650
$97/GB
RTX A5500

NVIDIA

24GB VRAM

Architecture

Ampere

Release Year

2022

Memory Bandwidth

768 GB/s

TDP

230W

3,600
$150/GB
RTX A5000

NVIDIA

24GB VRAM

Architecture

Ampere

Release Year

2021

Memory Bandwidth

768 GB/s

TDP

230W

2,500
$104/GB
RTX A4500

NVIDIA

20GB VRAM

Architecture

Ampere

Release Year

2021

Memory Bandwidth

640 GB/s

TDP

200W

1,800
$90/GB
RTX A4000

NVIDIA

16GB VRAM

Architecture

Ampere

Release Year

2021

Memory Bandwidth

448 GB/s

TDP

140W

1,000
$63/GB

Datacenter GPUs

11
H200

NVIDIA

141GB VRAM

Architecture

Hopper

Release Year

2024

Memory Bandwidth

4915 GB/s

TDP

700W

40,000
$284/GB
H100

NVIDIA

80GB VRAM

Architecture

Hopper

Release Year

2022

Memory Bandwidth

3350 GB/s

TDP

700W

30,000
$375/GB
A100 80GB

NVIDIA

80GB VRAM

Architecture

Ampere

Release Year

2020

Memory Bandwidth

2039 GB/s

TDP

400W

15,000
$188/GB
A100 40GB

NVIDIA

40GB VRAM

Architecture

Ampere

Release Year

2020

Memory Bandwidth

1555 GB/s

TDP

400W

10,000
$250/GB
L40S

NVIDIA

48GB VRAM

Architecture

Ada Lovelace

Release Year

2023

Memory Bandwidth

864 GB/s

TDP

350W

8,000
$167/GB
L4

NVIDIA

24GB VRAM

Architecture

Ada Lovelace

Release Year

2023

Memory Bandwidth

300 GB/s

TDP

72W

2,500
$104/GB
Instinct MI300X

AMD

192GB VRAM

Architecture

CDNA 3

Release Year

2023

Memory Bandwidth

5300 GB/s

TDP

750W

20,000
$104/GB
Instinct MI300A

AMD

128GB VRAM

Architecture

CDNA 3

Release Year

2023

Memory Bandwidth

5300 GB/s

TDP

550W

15,000
$117/GB
Instinct MI250X

AMD

128GB VRAM

Architecture

CDNA 2

Release Year

2021

Memory Bandwidth

3200 GB/s

TDP

560W

12,000
$94/GB
Data Center GPU Max 1100

Intel

48GB VRAM

Architecture

Ponte Vecchio

Release Year

2023

Memory Bandwidth

1228 GB/s

TDP

300W

2,500
$52/GB
Data Center GPU Max 1550

Intel

128GB VRAM

Architecture

Ponte Vecchio

Release Year

2023

Memory Bandwidth

3277 GB/s

TDP

600W

8,000
$63/GB