AMD Instinct

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by Klbrain (talk | contribs) at 20:04, 27 May 2020 (Closing stale 2019 merge proposal; uncontested objection and no support; see Talk:Radeon Pro#Proposed merge with Radeon Instinct). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

AMD Radeon Instinct
Design firmAdvanced Micro Devices
TypeServers

Radeon Instinct is AMD's brand of deep learning oriented GPUs.[1][2] It replaced AMD's FirePro S brand in 2016. Compared to the Radeon brand of mainstream consumer/gamer products, the Radeon Instinct branded products are intended to accelerate deep learning, artificial neural network, and high-performance computing/GPGPU applications.

The Radeon Instinct product line directly competes with Nvidia's Tesla and Intel Xeon Phi lines of deep learning and GPGPU cards.

Products

The three initial Radeon Instinct products were announced in December 2016, with each based on a different architecture.

MI6

The MI6 is a passively cooled, Polaris 10 based card with 16 GB of GDDR5 memory and with a <150 W TDP.[1][2] At 5.7 TFLOPS (FP16 and FP32), the MI6 is expected to be used primarily for inference, rather than neural network training. The MI6 has a peak double precision (FP64) compute performance of 358 GFLOPS.[3]

MI8

The MI8 is a Fiji based card, analogous to the R9 Nano, and expected to have a <175W TDP.[1] The MI8 has 4 GB of High Bandwidth Memory. At 8.2 TFLOPS (FP16 and FP32), the MI8 is marked toward inference. The MI8 has a peak (FP64) double precision compute performance 512 GFLOPS.[4]

MI25

The MI25 is a Vega based card, utilizing HBM2 memory. The MI25 performance is expected to be 12.3 TFLOPS using FP32 numbers. In contrast to the MI6 and MI8, the MI25 is able to increase performance when using lower precision numbers, and accordingly is expected to reach 24.6 TFLOPS when using FP16 numbers. The MI25 is rated at <300W TDP with passive cooling. The MI25 also provides 768 GFLOPS peak double precision (FP64) at 1/16th rate.[5]

Software

MxGPU

The MI6, MI8, and MI25 products all support AMD's MxGPU virtualization technology, enabling sharing of GPU resources across multiple users.[1][6]

MIOpen

MIOpen is AMD's deep learning library to enable GPU acceleration of deep learning.[1] Much of this extends the GPUOpen's Boltzmann Initiative software.[6] This is intended to compete with the deep learning portions of Nvidia's CUDA library. It supports the deep learning frameworks: Theano, Caffe, TensorFlow, MXNet, The Microsoft Cognitive Toolkit, Torch, and Chainer. Programming is supported in OpenCL and Python, in addition to supporting the compilation of CUDA through AMD's Heterogeneous-compute Interface for Portability and Heterogeneous Compute Compiler.

Chipset Table

Model
(Code name)
Launch Architecture
fab
Transistors
& die size
Core Fillrate[a][b][c] Processing power[a][d]
(TFLOPS)
Memory TBP Bus
interface
Config[e] Clock[a]
(MHz)
Texture
(GT/s)
Pixel
(GP/s)
Half Single Double Size
(GB)
Bus type
& width
Bandwidth
(GB/s)
Clock
(MT/s)
Radeon Instinct MI6
(Polaris 10)[7][8][9][10][11][12]
Jun 20, 2017 GCN 4
GloFo 14LP
5.7×109
232 mm2
2304:144:32
36 CU
1120
1233
161.3
177.6
35.84
39.46
5.161
5.682
5.161
5.682
0.323
0.355
16 GDDR5
256-bit
224 7000 150 W PCIe 3.0
×16
Radeon Instinct MI8
(Fiji)[7][8][9][13][14][15]
GCN 3
TSMC 28 nm
8.9×109
596 mm2
4096:256:64
64 CU
1000 256.0 64.00 8.192 8.192 0.512 4 HBM
4096-bit
512 1000 175 W
Radeon Instinct MI25
(Vega 10)[7][8][9][16][17][18][19]
GCN 5
GloFo 14LP
12.5×109
510 mm2
1400
1500
358.4
384.0
89.60
96.00
22.94
24.58
11.47
12.29
0.717
0.768
16 HBM2
2048-bit
484 1890 300 W
Radeon Instinct MI50
(Vega 20)[20][21][22][23][24][25]
Nov 18, 2018 GCN 5
TSMC N7
13.2×109
331 mm2
3840:240:64
60 CU
1450
1725
348.0
414.0
92.80
110.4
22.27
26.50
11.14
13.25
5.568
6.624
16
32
HBM2
4096-bit
1024 2000 PCIe 4.0
×16
Radeon Instinct MI60
(Vega 20)[21][26][27][28]
4096:256:64
64 CU
1500
1800
384.0
460.8
96.00
115.2
24.58
29.49
12.29
14.75
6.144
7.373
32
AMD Instinct MI100
(Arcturus)[29][30][31]
Nov 16, 2020 CDNA
TSMC N7
25.6×109
750 mm2
7680:480:-
120 CU
1000
1502
480.0
721.0
122.9
184.6
15.36
23.07
7.680
11.54
1228.8 2400
AMD Instinct MI210
(Aldebaran)[32][33][34]
Mar 22, 2022 CDNA 2
TSMC N6
28 x 109
~770 mm2
6656:416:-
104 CU
(1 × GCD)[f]
1000
1700
416.0
707.2
106.5
181.0
13.31
22.63
13.31
22.63
64 HBM2E
4096-bit
1638.4 3200
AMD Instinct MI250
(Aldebaran)[35][36][37]
Nov 8, 2021 58 x 109
1540 mm2
13312:832:-
208 CU
(2 × GCD)
832.0
1414
213.0
362.1
26.62
45.26
26.62
45.26
2 × 64 HBM2E
2 × 4096-bit[g]
2 × 1638.4 500 W
560 W (Peak)
AMD Instinct MI250X
(Aldebaran)[38][36][39]
14080:880:-
220 CU
(2 × GCD)
880.0
1496
225.3
383.0
28.16
47.87
28.16
47.87
AMD Instinct MI300A
(Antares)[40][41][42][43]
Dec 6, 2023 CDNA 3
TSMC N5 & N6
146 x 109
1017 mm2
14592:912:-
228 CU
(6 × XCD)
(24 AMD Zen 4 x86 CPU cores)
2100 912.0
1550.4
980.6
1961.2 (With Sparsity)
122.6
61.3
122.6 (FP64 Matrix)
128 HBM3
8192-bit
5300 5200 550 W
760 W (Liquid Cooling)
PCIe 5.0
×16
AMD Instinct MI300X
(Aqua Vanjaram)[44][45][46][47]
153 x 109
1017 mm2
19456:1216:-
304 CU
(8 × XCD)
1216.0
2062.1
1307.4
2614.9 (With Sparsity)
163.4
81.7
163.4 (FP64 Matrix)
192 750 W
  1. ^ a b c Boost values (if available) are stated below the base value in italic.
  2. ^ Texture fillrate is calculated as the number of texture mapping units multiplied by the base (or boost) core clock speed.
  3. ^ Pixel fillrate is calculated as the number of render output units multiplied by the base (or boost) core clock speed.
  4. ^ Precision performance is calculated from the base (or boost) core clock speed based on a FMA operation.
  5. ^ Unified shaders : Texture mapping units : Render output units and Compute units (CU)
  6. ^ GCD Refers to a Graphics Compute Die. Each GCD is a different piece of silicon.
  7. ^ CDNA 2.0 Based cards adopt a design using two dies on the same package.They are linked with 400GB/s Bidirectional Infinity Fabric link, The dies are addressed as individual GPUs by the host system.

See also

References

  1. ^ a b c d e Smith, Ryan (12 December 2016). "AMD Announces Radeon Instinct: GPU Accelerators for Deep Learning, Coming in 2017". Anandtech. Retrieved 12 December 2016.
  2. ^ a b Shrout, Ryan (12 December 2016). "Radeon Instinct Machine Learning GPUs include Vega, Preview Performance". PC Per. Retrieved 12 December 2016.
  3. ^ "Radeon Instinct MI6". Radeon Instinct. AMD. Retrieved 22 June 2017.
  4. ^ "Radeon Instinct MI8". Radeon Instinct. AMD. Retrieved 22 June 2017.
  5. ^ "Radeon Instinct MI25". Radeon Instinct. AMD. Retrieved 22 June 2017.
  6. ^ a b Kampman, Jeff (12 December 2016). "AMD opens up machine learning with Radeon Instinct". TechReport. Retrieved 12 December 2016.
  7. ^ a b c Smith, Ryan (December 12, 2016). "AMD Announces Radeon Instinct: GPU Accelerators for Deep Learning, Coming in 2017". AnandTech. Retrieved December 12, 2016.
  8. ^ a b c Shrout, Ryan (December 12, 2016). "Radeon Instinct Machine Learning GPUs include Vega, Preview Performance". PCPerspective. Retrieved December 12, 2016.
  9. ^ a b c Kampman, Jeff (December 12, 2016). "AMD opens up machine learning with Radeon Instinct". Tech Report. Retrieved December 12, 2016.
  10. ^ "Radeon Instinct MI6". AMD. Archived from the original on August 1, 2017. Retrieved May 27, 2022.
  11. ^ "AMD Radeon Instinct MI6 Datasheet" (PDF). usermanual.wiki. Retrieved May 27, 2022.
  12. ^ "AMD Radeon Instinct MI6 Specs". TechPowerUp. Retrieved May 27, 2022.
  13. ^ "Radeon Instinct MI8". AMD. Archived from the original on August 1, 2017. Retrieved May 27, 2022.
  14. ^ "AMD Radeon Instinct MI8 Datasheet" (PDF). usermanual.wiki. Retrieved May 27, 2022.
  15. ^ "AMD Radeon Instinct MI8 Specs". TechPowerUp. Retrieved May 27, 2022.
  16. ^ Smith, Ryan (January 5, 2017). "The AMD Vega Architecture Teaser: Higher IPC, Tiling, & More, coming in H1'2017". AnandTech. Retrieved January 10, 2017.
  17. ^ "Radeon Instinct MI25". AMD. Archived from the original on August 1, 2017. Retrieved May 27, 2022.
  18. ^ "AMD Radeon Instinct MI25 Datasheet" (PDF). AMD. Retrieved May 27, 2022.
  19. ^ "AMD Radeon Instinct MI25 Specs". TechPowerUp. Retrieved May 27, 2022.
  20. ^ Walton, Jarred (January 10, 2019). "Hands on with the AMD Radeon VII". PC Gamer.
  21. ^ a b "Next Horizon – David Wang Presentation" (PDF). AMD.
  22. ^ "AMD Radeon Instinct MI50 Accelerator (16GB)". AMD. Retrieved December 24, 2022.
  23. ^ "AMD Radeon Instinct MI50 Accelerator (32GB)". AMD. Retrieved December 24, 2022.
  24. ^ "AMD Radeon Instinct MI50 Datasheet" (PDF). AMD. Retrieved December 24, 2022.
  25. ^ "AMD Radeon Instinct MI50 Specs". TechPowerUp. Retrieved May 27, 2022.
  26. ^ "Radeon Instinct MI60". AMD. Archived from the original on November 22, 2018. Retrieved May 27, 2022.
  27. ^ "AMD Radeon Instinct MI60 Datasheet" (PDF). AMD. Retrieved December 24, 2022.
  28. ^ "AMD Radeon Instinct MI60 Specs". TechPowerUp. Retrieved May 27, 2022.
  29. ^ "AMD Instinct MI100 Accelerator". AMD. Retrieved May 27, 2022.
  30. ^ "AMD Instinct MI100 Accelerator Brochure" (PDF). AMD. Retrieved May 27, 2022.
  31. ^ "AMD Radeon Instinct MI100 Specs". TechPowerUp. Retrieved May 26, 2022.
  32. ^ "AMD Instinct MI210 Accelerator". AMD. Retrieved May 27, 2022.
  33. ^ "AMD Instinct MI210 Accelerator Brochure" (PDF). AMD. Retrieved May 27, 2022.
  34. ^ "AMD Radeon Instinct MI210 Specs". TechPowerUp. Retrieved May 27, 2022.
  35. ^ "AMD Instinct MI250 Accelerator". AMD. Retrieved May 27, 2022.
  36. ^ a b "AMD Instinct MI200 Series Accelerator Datasheet" (PDF). AMD. Retrieved December 24, 2022.
  37. ^ "AMD Radeon Instinct MI250 Specs". TechPowerUp. Retrieved May 26, 2022.
  38. ^ "AMD Instinct MI250X Accelerator". AMD. Retrieved May 27, 2022.
  39. ^ "AMD Radeon Instinct MI250X Specs". TechPowerUp. Retrieved May 26, 2022.
  40. ^ "AMD Instinct MI300A APU". AMD. Retrieved December 12, 2023.
  41. ^ "AMD Instinct MI300A Series Accelerator Datasheet" (PDF). AMD. Retrieved December 12, 2023.
  42. ^ "AMD Radeon Instinct MI300 Specs". TechPowerUp. Retrieved December 12, 2023.
  43. ^ "AMD-CDNA3-white-paper" (PDF). AMD. Retrieved December 12, 2023.
  44. ^ "AMD Instinct MI300X GPU". AMD. Retrieved December 12, 2023.
  45. ^ "AMD Instinct MI300X Series Accelerator Datasheet" (PDF). AMD. Retrieved December 12, 2023.
  46. ^ "AMD Radeon Instinct MI300 Specs". TechPowerUp. Retrieved December 12, 2023.
  47. ^ "AMD-CDNA3-white-paper" (PDF). AMD. Retrieved December 12, 2023.