AI-GPU Tier List (LLM) (2006–2026)
GPUs ranked for LLM training and inference by VRAM, bandwidth and FP8 compute. Ranked by TweakGearPro's relative performance index (0–100).
| Rank | Part | Year | Brand | Architecture | VRAM / BW | Tier |
|---|---|---|---|---|---|---|
| 1 | B200 SXM 192GB | 2025 | NVIDIA | Blackwell | 192 GB / 8000 GB/s | 100 Enthusiast flagship |
| 2 | GB200 NVL72 | 2025 | NVIDIA | Blackwell | 192 GB / 8000 GB/s | 100 Enthusiast flagship |
| 3 | AMD Instinct MI350X | 2025 | AMD | CDNA 4 | 288 GB / 6600 GB/s | 98 Enthusiast flagship |
| 4 | H200 SXM 141GB | 2024 | NVIDIA | Hopper | 141 GB / 4800 GB/s | 97 Enthusiast flagship |
| 5 | H100 SXM 80GB | 2022 | NVIDIA | Hopper | 80 GB / 3350 GB/s | 96 Enthusiast flagship |
| 6 | AMD Instinct MI325X | 2024 | AMD | CDNA 3 | 256 GB / 6000 GB/s | 96 Enthusiast flagship |
| 7 | RTX PRO 6000 Blackwell | 2025 | NVIDIA | Blackwell | 96 GB / 1824 GB/s | 95 Enthusiast flagship |
| 8 | AMD Instinct MI300X | 2023 | AMD | CDNA 3 | 192 GB / 5300 GB/s | 95 Enthusiast flagship |
| 9 | GeForce RTX 5090 | 2025 | NVIDIA | Blackwell | 32 GB / 1792 GB/s | 92 Enthusiast flagship |
| 10 | H100 PCIe 80GB | 2022 | NVIDIA | Hopper | 80 GB / 2000 GB/s | 88 High-end |
| 11 | Intel Gaudi 3 | 2024 | Intel | Gaudi 3 | 128 GB / 3700 GB/s | 88 High-end |
| 12 | RTX 6000 Ada | 2022 | NVIDIA | Ada Lovelace | 48 GB / 960 GB/s | 84 High-end |
| 13 | H20 (China) | 2024 | NVIDIA | Hopper | 96 GB / 4000 GB/s | 82 High-end |
| 14 | NVIDIA L40S 48GB | 2023 | NVIDIA | Ada Lovelace | 48 GB / 864 GB/s | 80 High-end |
| 15 | GeForce RTX 4090 | 2022 | NVIDIA | Ada Lovelace | 24 GB / 1008 GB/s | 78 High-end |
| 16 | A100 80GB | 2020 | NVIDIA | Ampere | 80 GB / 2039 GB/s | 78 High-end |
| 17 | A800 80GB (China) | 2022 | NVIDIA | Ampere | 80 GB / 2039 GB/s | 78 High-end |
| 18 | A100 40GB | 2020 | NVIDIA | Ampere | 40 GB / 1555 GB/s | 72 Upper mainstream |
| 19 | Intel Gaudi 2 | 2022 | Intel | Gaudi 2 | 96 GB / 2400 GB/s | 70 Upper mainstream |
| 20 | GeForce RTX 3090 | 2020 | NVIDIA | Ampere | 24 GB / 936.2 GB/s | 52 Mainstream |
| 21 | NVIDIA L4 24GB | 2023 | NVIDIA | Ada Lovelace | 24 GB / 300 GB/s | 44 Mainstream |
Methodology
- Specs: vendor datasheets and the TechPowerUp database, retrieved 2026-08-21.
- Tier = TweakGearPro relative performance index (0–100), an estimate from public benchmarks; real performance varies by workload, drivers and cooling.