GPU Specifications
Filters:
| Interconnect | ||||||
|---|---|---|---|---|---|---|
NVIDIA | B300 SXM | Blackwell Ultra | 288GB HBM3e | FP64: 1.4 FP32: 80 FP24: 160 | FP16: 5000 INT8: 10000 | INT4: 20000 | 1400W | NVLink 5.0 1800 GB/s |
NVIDIA | B200 SXM | Blackwell | 192GB HBM3e | FP64: 40 FP32: 80 FP24: 160 | FP16: 4500 INT8: 9000 | INT4: 18000 | 1000W | NVLink 5.0 1800 GB/s |
NVIDIA | H200 SXM5 | Hopper | 141GB HBM3e | FP64: 34 FP32: 67 FP24: 134 | FP16: 1979 INT8: 3958 | INT4: 7916 | 700W | NVLink 4.0 900 GB/s |
NVIDIA | H100 SXM5 | Hopper | 80GB HBM3 | FP64: 34 FP32: 67 FP24: 134 | FP16: 1979 INT8: 3958 | INT4: 7916 | 700W | NVLink 4.0 900 GB/s |
NVIDIA | A100 80GB | Ampere | 80GB HBM2e | FP64: 9.7 FP32: 19.5 FP24: 39 | FP16: 624 INT8: 1248 | INT4: 2496 | 400W | NVLink 3.0 600 GB/s |
NVIDIA | V100 SXM2 32GB | Volta | 32GB HBM2 | FP64: 7.8 FP32: 15.7 FP24: 31.4 | FP16: 125 INT8: 62.8 | INT4: 62.8 | 300W | NVLink 2.0 300 GB/s |
NVIDIA | P100 SXM2 | Pascal | 16GB HBM2 | FP64: 5.3 FP32: 10.6 FP24: 21.2 | FP16: 21.2 INT8: 21.2 | INT4: 21.2 | 300W | NVLink 1.0 160 GB/s |
NVIDIA | RTX PRO 6000 Blackwell | Blackwell | 96GB GDDR7 | FP64: 2 FP32: 125 FP24: 250 | FP16: 1000 INT8: 2000 | INT4: 4000 | 600W | PCIe 5.0 128 GB/s |
NVIDIA | L40S | Ada Lovelace | 48GB GDDR6 | FP64: 1.4 FP32: 91.6 FP24: 183.2 | FP16: 733 INT8: 1466 | INT4: 2932 | 350W | PCIe 4.0 64 GB/s |
NVIDIA | L4 | Ada Lovelace | 24GB GDDR6 | FP64: 0.5 FP32: 30.3 FP24: 60.6 | FP16: 242 INT8: 485 | INT4: 970 | 72W | PCIe 4.0 64 GB/s |
NVIDIA | A40 | Ampere | 48GB GDDR6 | FP64: 0.6 FP32: 37.4 FP24: 74.8 | FP16: 299.4 INT8: 598.7 | INT4: 1197.4 | 300W | NVLink 3.0 112.5 GB/s |
NVIDIA | A30 | Ampere | 24GB HBM2 | FP64: 5.2 FP32: 10.3 FP24: 20.6 | FP16: 330 INT8: 661 | INT4: 1321 | 165W | NVLink 3.0 200 GB/s |
NVIDIA | A10 | Ampere | 24GB GDDR6 | FP64: 0.5 FP32: 31.2 FP24: 62.4 | FP16: 250 INT8: 500 | INT4: 1000 | 150W | PCIe 4.0 64 GB/s |
NVIDIA | T4 | Turing | 16GB GDDR6 | FP64: 0.25 FP32: 8.1 FP24: 16.2 | FP16: 65 INT8: 130 | INT4: 260 | 70W | PCIe 3.0 32 GB/s |
AMD | Instinct MI355X | CDNA 4 | 288GB HBM3e | FP64: 78.6 FP32: 157.3 FP24: 314.6 | FP16: 5000 INT8: 10100 | INT4: 20100 | 1400W | Infinity Fabric 4 1075 GB/s |
AMD | Instinct MI325X | CDNA 3 | 256GB HBM3e | FP64: 81.7 FP32: 163.4 FP24: 326.8 | FP16: 2615 INT8: 5230 | INT4: 5230 | 1000W | Infinity Fabric 3 896 GB/s |
AMD | Instinct MI300X | CDNA 3 | 192GB HBM3 | FP64: 81.7 FP32: 163.4 FP24: 326.8 | FP16: 2615 INT8: 5230 | INT4: 5230 | 750W | Infinity Fabric 3 896 GB/s |
AMD | Instinct MI250X | CDNA 2 | 128GB HBM2e | FP64: 47.9 FP32: 47.9 FP24: 95.8 | FP16: 383 INT8: 383 | INT4: 383 | 560W | Infinity Fabric 3 800 GB/s |