TeraScale (microarchitecture)

From Wikipedia, the free encyclopedia
Jump to: navigation, search

TeraScale is the codename for a family of graphics processing unit microarchitectures developed by ATI Technologies/AMD and their second microarchitecture implementing the unified shader model following Xenos. TeraScale replaced the old fixed-pipeline microarchitectures and competed directly with Nvidia's first unified shader microarchitecture named Tesla.[1][2]

TeraScale was used in HD 2000 manufactured in 80 nm and 65 nm, HD 3000 manufactured in 65 nm and 55 nm, HD 4000 manufactured in 55 nm, HD 5000 and HD 6000 manufactured in 40 nm. TeraScale was also used in the AMD Accelerated Processing Units code-named "Brazos", "Llano", "Trinity" and "Richland". TeraScale is even found in some of the succeeding graphics cards brands.

TeraScale is a VLIW SIMD architecture, while Tesla is a RISC SIMD architecture, similar to TeraScale's successor Graphics Core Next. TeraScale implements HyperZ.[3]

TeraScale 1[edit]

At SIGGRAPH 08 in December 2008 AMD employee Mike Houston described some of TeraScale microarchitecture.[4]

At FOSDEM09 somebody presented a slide regarding the programming of open-source driver for the R600.[5]

Unified shaders[edit]

Previous GPU architectures implemented fixed-pipelines, i.e. there were distinct shader processors for each type of shader. TeraScale leverages many flexible shader processors which can be scheduled to process a variety of shader types, thereby significantly increasing GPU throughput (dependent on application instruction mix as noted below). The R600 core processes vertex, geometry, and pixel shaders as outlined by the Direct3D 10.0 specification for Shader Model 4.0 in addition to full OpenGL 3.0 support.[6]

The new unified shader functionality is based upon a very long instruction word (VLIW) architecture in which the core executes operations in parallel.[7]

A shader cluster is organized into 5 stream processing units. Each stream processing unit can retire a finished single precision floating point MAD (or ADD or MUL) instruction per clock, dot product (DP, and special cased by combining ALUs), and integer ADD.[8] The 5th unit is more complex and can additionally handle special transcendental functions such as sine and cosine.[8] Each shader cluster can execute 6 instructions per clock cycle (peak), consisting of 5 shading instructions plus 1 branch.[8]

Notably, the VLIW architecture brings with it some classic challenges inherent to VLIW designs, namely that of maintaining optimal instruction flow.[7] Additionally, the chip cannot co-issue instructions when one is dependent on the results of the other. Performance of the GPU is highly dependent on the mixture of instructions being used by the application and how well the real-time compiler in the driver can organize said instructions.[8]

R600 core includes 64 shader clusters, while RV610 and RV630 cores have 8 and 24 shader clusters respectively.

Hardware tessellation[edit]

TeraScale contained extra features, not part of the Direct3D 10.0 specification. It contains programmable tessellation units, similar to those within the Xenos GPU. These units allows a developer to take a simple polygon mesh and subdivide it based on a curved surface evaluation function, with different tessellation forms as Bézier surfaces with N-patches, B-splines and NURBS, and even some subdivision surface techniques, which usually comes with a displacement map texture.[9] Essentially, this allows a simple, low-polygon model to be increased dramatically in polygon density in real-time with minimized performance loss. Scott Wasson of Tech Report noted during an AMD demo of the technology that the resulting model was so dense with millions of polygons that it appeared to be solid.[7]

This unit is reminiscent of ATI's earlier TruForm technology, used initially in the Radeon 8500, which performed a similar function in hardware.[10] While this tessellation hardware was not part of the OpenGL or Direct3D requirements, and competitors such as the GeForce 8 series lacked similar hardware, Microsoft has included Tessellation as part of their D3D10.1 future plans.[11]

The TruForm technology from the past received little attention from software developers and was only utilized in a few game titles (such as Madden NFL 2004, Serious Sam, Unreal Tournament 2003 and 2004, and unofficially Morrowind), because it was not a feature shared with NVIDIA GPUs which had a competing tessellation solution using Quintic-RT patches which met with even less support from developers.[12] Since the Xenos contains similar hardware, and Microsoft sees hardware surface tessellation as a major GPU feature with proposed implementation of hardware tessellation support in future DirectX releases (presumably DirectX 11),[9][11] dedicated hardware tessellation units may receive increased developer awareness in future titles. It remains to be seen whether ATI's implementation will be compatible with the eventual DirectX standard.

Ultra threaded dispatch processor[edit]

Although the R600 is a significant departure from previous designs, it still shares many features with its predecessor, the Radeon R520.[7] The Ultra-Threaded Dispatch Processor is a major architectural component of the R600 core, just as it was with the Radeon X1000 GPUs. This processor manages a large number of in-flight threads of three distinct types (vertex, geometry, and pixel shaders) and switches amongst them as needed.[7] With a large number of threads being managed simultaneously it is possible to reorganize thread order to optimally utilize the shaders. In other words, the dispatch processor evaluates what goes in the other parts of the R600 and attempts to keep processing efficiency as high as possible. There are lower levels of management as well; each SIMD array of 80 stream processors has its own sequencer and arbiter. The arbiter decides which thread to process next, while the sequencer attempts to reorder instructions for best possible performance within each thread.[7]

Texturing and anti-aliasing[edit]

Texturing and final output aboard the R600 core is similar but also distinct from R580. R600 is equipped with 4 texture units that are decoupled (independent) from the shader core, like in the R520 and R580 GPUs.[7] The render output units (ROPs) of Radeon HD 2000 series now performs the task of Multisample anti-aliasing (MSAA) with programmable sample grids and maximum of 8 sample points, instead of using pixel shaders as in Radeon X1000 series. Also new is the capability to filter FP16 textures, popular with HDR lighting, at full-speed. ROP can also perform trilinear and anisotropic filtering on all texture formats. On R600, this totals 16 pixels per clock for FP16 textures, while higher precision FP32 textures filter at half-speed (8 pixels per clock).[7]

Anti-aliasing capabilities are more robust on R600 than on the R520 series. In addition to the ability to perform 8× MSAA, up from 6× MSAA on the R300 through R580, R600 has a new custom filter anti-aliasing (CFAA) mode. CFAA refers to an implementation of non-box filters that look at pixels around the particular pixel being processed in order to calculate the final color and anti-alias the image.[8] CFAA is performed by shader, instead of in the ROPs. This brings greatly enhanced programmability because the filters can be customized, but may also bring potential performance issues because of the use of shader resources. As of launch of R600, CFAA utilizes wide and narrow tent filters. With these, samples from outside the pixel being processed are weighted linearly based upon their distance from the centroid of that pixel, with the linear function adjusted based on the wide or narrow filter chosen.[8]

Memory controllers[edit]

Memory controllers are connected via internal bi-directional ring bus wrapped around the processor. In Radeon HD 2900, it is a 1,024-bit bi-directional ring bus (512-bit read and 512-bit write), with 8 64-bit memory channels for a total bus width of 512-bits on the 2900 XT.;[7] in Radeon HD 3800, it is a 512-bit ring bus; in Radeon HD 2600 and HD 3600, it is a 256-bit ring bus; In Radeon HD 2400 and HD 3400, there is no ring bus.

Half-generation update[edit]

The series saw a half-generation update with die shrink (55 nm) variants: RV670, RV635 and RV620. All variants support PCI Express 2.0, DirectX 10.1 with Shader Model 4.1 features, dedicated ATI Unified Video Decoder (UVD) for all models [13] and PowerPlay technology for desktop video cards.[14]

Except the Radeon HD 3800 series, all variants supported 2 integrated DisplayPort outputs, supporting 24- and 30-bit displays for resolutions up to 2,560×1,600. Each output included 1, 2, or 4 lanes per output, with data rate up to 2.7 Gbit/s per lane.

ATI claimed that the support of DirectX 10.1 can bring improved performance and processing efficiency with reduced rounding error (0.5 ULP compared with average error 1.0 ULP as tolerable error), better image details and quality, global illumination (a technique used in animated films, and more improvements to consumer gaming systems therefore giving more realistic gaming experience.[15] )

TeraScale 2[edit]

TeraScale 2 was introduced with the Radeon HD 5000 Series in the "Evergreen" series of GPUs.

At HPG10 Mark Fowler presented the "Evergreen" and stated that e.g. 5870 (Cypress), 5770 (Juniper) and 5670 (Redwood) support max resolution of the 6 times 2560×1600 pixels, while the 5470 (Cedar) supports 4 times 2560×1600 pixels, important for AMD Eyefinity multi-monitor support.[16]

With the release of Cypress, the Terascale graphics engine architecture has been upgraded with twice the number of stream cores, texture units and ROP units compared to the RV770. The architecture of stream cores is largely unchanged, but adds support for DirectX 11/DirectCompute 11 capabilities with new instructions.[17] Also similar to RV770, four texture units are tied to 16 stream cores (each have five processing elements, making a total of 80 processing elements). This combination of is referred to as a SIMD core.

Unlike the predecessor Radeon R700, as DirectX 11 mandates full developer control over interpolation, dedicated interpolators were removed, relying instead on the SIMD cores. The stream cores can handle the higher rounding precision fused multiply–add (FMA) instruction in both single and double precision which increases precision over multiply–add (MAD) and is compliant to IEEE 754-2008 standard.[18] The instruction sum of absolute differences (SAD) has been natively added to the processors. This instruction can be used to greatly improve the performance of some processes, such as video encoding and transcoding on the 3D engine. Each SIMD core is equipped with 32 KiB local data share and 8 kiB of L1 cache,[17] while all SIMD cores share 64 KiB global data share.

Memory controller[edit]

Each memory controller ties to two quad ROPs, one per 64-bit channel, and dedicated 512 KiB L2 cache.[17] Redwood has one quad ROP per 256-bit channel.

Power saving[edit]

Main article: AMD PowerPlay

AMD PowerPlay is supported, see there.

TeraScale 3[edit]

TeraScale 3 was introduced with the Radeon HD 6900 Series in the "Northern Islands" series of GPUs. It replaces the old 5-way VLIW designs with a 4-way VLIW design. The new design also incorporates an additional tessellation unit to improve DirectX 11 performance.

Power saving[edit]

Main article: AMD PowerTune

AMD PowerTune, dynamic frequency scaling for GPUs, was introduced with Radeon HD 6900 in Dec 15, 2010 and has been prone to further development ever since, like a couple of reviews by AnandTech document. [19] [20] [21] [22]

Successor[edit]

At HPG11 in August 2011 AMD employees Michael Mantor (Senior Fellow Architect) and Mike Houston (Fellow Architect) presented Graphics Core Next, the microarchitecture succeeding TeraScale.[23]

References[edit]

  1. ^ "The TeraScale 3 architecture of the HD 6990". Tom's Hardware. 
  2. ^ "Anatomy of AMD’s TeraScale Graphics Engine". 
  3. ^ "Feature matrix of the free and open-source "Radeon" graphics device driver". Retrieved 2014-07-09. 
  4. ^ "Anatomy of AMD’s TeraScale microarchitecture" (pdf). 2008-12-12. 
  5. ^ http://www.vis.uni-stuttgart.de/~hopf/pub/Fosdem_2009_r600demo_Slides.pdf
  6. ^ AMD OpenGL 3.0 driver release on Jan 28, 2009
  7. ^ a b c d e f g h i Wasson, Scott. AMD Radeon HD 2900 XT graphics processor: R600 revealed, Tech Report, May 14, 2007
  8. ^ a b c d e f Beyond3D review: AMD R600 Architecture and GPU Analysis, retrieved June 2, 2007.
  9. ^ a b ExtremeTech review
  10. ^ Witheiler, Matthew. ATi TRUFORM Technology - Powering the next generation Radeon, AnandTech, May 29, 2001.
  11. ^ a b The Future of DirectX presentation, slide 24-29
  12. ^ nVidia GeForce3 SDK WhitePaper
  13. ^ "RV670 Cards & Specs Revealed". VR-Zone. August 22, 2007. 
  14. ^ (Spanish) MadboxPC coverage, retrieved November 10, 2007
  15. ^ ATI DirectX 10.1 whitepaper, retrieved December 7, 2007
  16. ^ "Presenting Radeon HD 5000". 
  17. ^ a b c DirectX 11 in the Open: ATI Radeon HD 5870 Review
  18. ^ Report: AMD Radeon HD 5870 and 5850
  19. ^ "Redefining TDP With PowerTune". AnandTech. 2010-12-15. 
  20. ^ "Introducing PowerTune Technology With Boost". AnandTech. 2012-06-22. 
  21. ^ "The New PowerTune: Adding Further States". AnandTech. 2013-03-22. 
  22. ^ "PowerTune: Improved Flexibility & Fan Speed Throttling". AnandTech. 2014-10-23. 
  23. ^ "AMD "Graphic Core Next": Low Power High Performance Graphics & Parallel Computer". 2011-08-05. Retrieved 2014-07-06.