Canvas 1
Layer 1
GPU Slice 6
GPU Slice Box
Memory Slice Box
DRAM
DRAM
L2 Slice 2
L2 Slices
…
L2 Slice 1
L2 Slices
Memory Slice
Memory Slice
Data Xbar
Data CrossBar
GPC Box
…
SM5
SM
SM4
SM
SM3
SM
SM2
SM
SM1
SM
GPC
GPC
Control Xbar
Control CrossBar
Sys Pipe
Sys Pipe
GPU Slice 6
GPU Slice 5
GPU Slice Box
Memory Slice Box
DRAM
DRAM
L2 Slice 2
L2 Slices
…
L2 Slice 1
L2 Slices
Memory Slice
Memory Slice
Data Xbar
Data CrossBar
GPC Box
…
SM5
SM
SM4
SM
SM3
SM
SM2
SM
SM1
SM
GPC
GPC
Control Xbar
Control CrossBar
Sys Pipe
Sys Pipe
GPU Slice 5
GPU Slice 4
GPU Slice Box
Memory Slice Box
DRAM
DRAM
L2 Slice 2
L2 Slices
…
L2 Slice 1
L2 Slices
Memory Slice
Memory Slice
Data Xbar
Data CrossBar
GPC Box
…
SM5
SM
SM4
SM
SM3
SM
SM2
SM
SM1
SM
GPC
GPC
Control Xbar
Control CrossBar
Sys Pipe
Sys Pipe
GPU Slice 4
GPU Slice 3
GPU Slice Box
Memory Slice Box
DRAM
DRAM
L2 Slice 2
L2 Slices
…
L2 Slice 1
L2 Slices
Memory Slice
Memory Slice
Data Xbar
Data CrossBar
GPC Box
…
SM5
SM
SM4
SM
SM3
SM
SM2
SM
SM1
SM
GPC
GPC
Control Xbar
Control CrossBar
Sys Pipe
Sys Pipe
GPU Slice 3
GPU Slice 2
GPU Slice Box
Memory Slice Box
DRAM
DRAM
L2 Slice 2
L2 Slices
…
L2 Slice 1
L2 Slices
Memory Slice
Memory Slice
Data Xbar
Data CrossBar
GPC Box
…
SM5
SM
SM4
SM
SM3
SM
SM2
SM
SM1
SM
GPC
GPC
Control Xbar
Control CrossBar
Sys Pipe
Sys Pipe
GPU Slice 2
GPU Instance (MIG 4g.40GB)
GPU Slice 1
GPU Slice Box
Memory Slice Box
DRAM
DRAM
L2 Slice 2
L2 Slices
…
L2 Slice 1
L2 Slices
Memory Slice
Memory Slice
Data Xbar
Data CrossBar
GPC Box
…
SM5
SM
SM4
SM
SM3
SM
SM2
SM
SM1
SM
GPC
GPC
Control Xbar
Control CrossBar
Sys Pipe
Sys Pipe
GPU Slice 1
GPU Slice 0
GPU Slice Box
Memory Slice Box
DRAM
DRAM
L2 Slice 2
L2 Slices
…
L2 Slice 1
L2 Slices
Memory Slice
Memory Slice
Data Xbar
Data CrossBar
GPC Box
…
SM5
SM
SM4
SM
SM3
SM
SM2
SM
SM1
SM
GPC
GPC
Control Xbar
Control CrossBar
Sys Pipe
Sys Pipe
GPU Slice 0
Instance Memory Partition
A100 80GB MIG Mode
NVDEC
NVDEC
CE
CE
CE
CE
NVDEC
CE
CE
NVDEC
CE
NVDEC