GPU comparison
Inferentia2 vs L4: specs and rental prices
AWS Inferentia2 (Inf2) against NVIDIA L4: 32 GB against 24 GB of memory, lowest listed on-demand price $0.76 against $0.80 per GPU-hour or chip-hour. Specs from AWS and NVIDIA, prices as of Oct 29, 2026.
In short
- The Inferentia2 lists 32 GB of GPU memory against 24 GB for the L4: 1.33× higher.
- The Inferentia2 lists 816.7 GB/s (derived) of memory bandwidth against 300 GB/s for the L4: 2.72× higher.
- Not every figure can be compared: at least one vendor page does not publish: FP8 tensor throughput; TF32 tensor throughput; FP64 throughput; Maximum power; GPU-to-GPU interconnect.
- The lowest listed on-demand price is $0.76 per chip-hour for the Inferentia2 (AWS) and $0.80 per GPU-hour for the L4 (AWS).
- Per GB of GPU memory that is $0.024 per hour for the Inferentia2 and $0.034 for the L4.
This summary is generated from the tables below. Prices were last checked Oct 29, 2026. A listing not re-checked for 7 days is greyed and left out of every lowest-price figure; after 14 days it is removed from the page.
Specifications side by side
| Specification | Inferentia2 (Inf2) | L4 | Difference |
|---|---|---|---|
| GPU memory | 32 GB | 24 GB | Inferentia2 1.33× higher |
| Memory type | HBM | Not published | — |
| Memory bandwidth | 816.7 GB/s (derived) | 300 GB/s | Inferentia2 2.72× higher |
| FP8 tensor throughput | Not published | 485 TFLOPS (with sparsity) | — |
| FP16 / BF16 tensor throughput | 190 TFLOPS (basis not stated) | 242 TFLOPS (with sparsity) | Not compared: the vendors state the figures on different bases |
| TF32 tensor throughput | Not published | 120 TFLOPS (with sparsity) | — |
| Maximum power | Not published | 72 W | — |
| GPU-to-GPU interconnect | 192 GB/s | Not published | — |
Compared versions: Inferentia2 (Inf2) and L4. The figure in the stronger cell is shaded; power is shown without a winner. Two throughput figures are compared only when both vendors state them on the same basis (both with sparsity, or both dense), and “derived” means a total the vendor publishes divided by the GPU count it publishes. Full tables with sources: Inferentia2 specifications · L4 specifications.
Rental prices
| Rental price | Inferentia2 | L4 | Difference |
|---|---|---|---|
| Lowest listed on-demand price | $0.76 per chip-hour · AWS · checked Oct 29, 2026 | $0.80 per GPU-hour · AWS · checked Oct 29, 2026 | L4 1.06× higher |
| Lowest listed spot price | No fresh listing | No fresh listing | — |
| Price per GB of memory | $0.024 per GB of GPU memory per hour | $0.034 per GB of GPU memory per hour | L4 1.42× higher |
| Fresh listings | 2 from 1 providers | 4 from 2 providers | — |
Prices cover every version and instance size the providers list, so they are not tied to the versions compared above; the price per GB of memory divides the lowest fresh on-demand price by the memory of the compared version. Listed prices are not like for like across providers. See every listing: Inferentia2 prices · L4 prices.
More on these GPUs
Cite this page
Last updated Oct 29, 2026. Figures may change as records are updated — include the date you retrieved them.
| APA | Data Center Census. (2026). Inferentia2 vs L4. Retrieved from https://datacentercensus.com/gpu-prices/compare/inferentia2-vs-l4 |
|---|---|
| MLA | “Inferentia2 vs L4.” Data Center Census, Oct 29, 2026, https://datacentercensus.com/gpu-prices/compare/inferentia2-vs-l4. |
| Link | https://datacentercensus.com/gpu-prices/compare/inferentia2-vs-l4 |
Republishing a figure or table? Attribute it to Data Center Census with a link to this page. The underlying data is downloadable as JSON and CSV; the press kit has standing figures and contact details.