GPU comparison
T4 vs A100: specs and rental prices
NVIDIA T4 against NVIDIA A100: 16 GB against 80 GB of memory, lowest listed on-demand price $0.53 against $1.35 per GPU-hour. Specs from NVIDIA, prices as of Oct 25, 2026.
In short
- The A100 lists 80 GB of GPU memory against 16 GB for the T4: 5× higher.
- Memory type is GDDR6 on the T4 and HBM2e on the A100.
- The A100 lists 2,039 GB/s of memory bandwidth against 320 GB/s for the T4: 6.37× higher.
- Maximum power is listed at 70 W for the T4 and 400 W for the A100.
- Not every figure can be compared: at least one vendor page does not publish: FP8 tensor throughput; TF32 tensor throughput; FP64 throughput; GPU-to-GPU interconnect.
- The lowest listed on-demand price is $0.53 per GPU-hour for the T4 (AWS) and $1.35 for the A100 (Hyperstack).
- Per GB of GPU memory that is $0.033 per hour for the T4 and $0.017 for the A100.
This summary is generated from the tables below. Prices were last checked Oct 25, 2026. A listing not re-checked for 7 days is greyed and left out of every lowest-price figure; after 14 days it is removed from the page.
Specifications side by side
| Specification | T4 | A100 80GB SXM | Difference |
|---|---|---|---|
| GPU memory | 16 GB | 80 GB | A100 5× higher |
| Memory type | GDDR6 | HBM2e | Different |
| Memory bandwidth | 320 GB/s | 2,039 GB/s | A100 6.37× higher |
| FP16 / BF16 tensor throughput | 65 TFLOPS (basis not stated) | 624 TFLOPS (with sparsity) | Not compared: the vendors state the figures on different bases |
| TF32 tensor throughput | Not published | 312 TFLOPS (with sparsity) | — |
| FP64 throughput | Not published | 9.7 TFLOPS | — |
| Maximum power | 70 W | 400 W | A100 5.71× higher |
| GPU-to-GPU interconnect | Not published | 600 GB/s | — |
| CUDA cores | 2,560 | Not published | — |
Compared versions: T4 and A100 80GB SXM. The figure in the stronger cell is shaded; power is shown without a winner. Two throughput figures are compared only when both vendors state them on the same basis (both with sparsity, or both dense), and “derived” means a total the vendor publishes divided by the GPU count it publishes. Full tables with sources: T4 specifications · A100 specifications.
Rental prices
| Rental price | T4 | A100 | Difference |
|---|---|---|---|
| Lowest listed on-demand price | $0.53 per GPU-hour · AWS · checked Oct 25, 2026 | $1.35 per GPU-hour · Hyperstack · checked Oct 25, 2026 | A100 2.57× higher |
| Lowest listed spot price | $0.21 per GPU-hour · Microsoft Azure · checked Oct 25, 2026 | $1.06 per GPU-hour · Microsoft Azure · checked Oct 25, 2026 | A100 4.95× higher |
| Price per GB of memory | $0.033 per GB of GPU memory per hour | $0.017 per GB of GPU memory per hour | T4 1.95× higher |
| Fresh listings | 6 from 2 providers | 14 from 9 providers | — |
Prices cover every version and instance size the providers list, so they are not tied to the versions compared above; the price per GB of memory divides the lowest fresh on-demand price by the memory of the compared version. Listed prices are not like for like across providers. See every listing: T4 prices · A100 prices.
More on these GPUs
Cite this page
Last updated Oct 25, 2026. Figures may change as records are updated — include the date you retrieved them.
| APA | Data Center Census. (2026). T4 vs A100. Retrieved from https://datacentercensus.com/gpu-prices/compare/t4-vs-a100 |
|---|---|
| MLA | “T4 vs A100.” Data Center Census, Oct 25, 2026, https://datacentercensus.com/gpu-prices/compare/t4-vs-a100. |
| Link | https://datacentercensus.com/gpu-prices/compare/t4-vs-a100 |
Republishing a figure or table? Attribute it to Data Center Census with a link to this page. The underlying data is downloadable as JSON and CSV; the press kit has standing figures and contact details.