Jump to content

3 GB barrier: Difference between revisions

Edit links
From Wikipedia, the free encyclopedia
Browse history interactively
← Previous editNext edit →
Content deleted Content added
VisualWikitext
nor does it appear to have any OR, or at least it's not clearly tagged, nor do I see any "undue" anywhere. removing header tags, if there are problems, TAG THE PROBLEM
→Windows version dependencies: The limit was imposed through a licensing restriction, and can be removed by patching the kernel.
Line 156: Line 156:
|accessdate=2010-06-07
|accessdate=2010-06-07
|quote=The problematic client driver ecosystem led to the decision for client SKUs to ignore physical memory that resides above 4GB, even though they can theoretically address it.
|quote=The problematic client driver ecosystem led to the decision for client SKUs to ignore physical memory that resides above 4GB, even though they can theoretically address it.
| archiveurl= http://web.archive.org/web/20100609073029/http://blogs.technet.com/b/markrussinovich/archive/2008/07/21/3092070.aspx| archivedate= 9 June 2010 <!--DASHBot-->| deadurl= no}}</ref>
| archiveurl= http://web.archive.org/web/20100609073029/http://blogs.technet.com/b/markrussinovich/archive/2008/07/21/3092070.aspx| archivedate= 9 June 2010 <!--DASHBot-->| deadurl= no}}</ref> The limit was imposed through a licensing restriction,<ref>{{cite web|url=http://geoffchappell.com/notes/windows/license/memory.htm|title=Licensed Memory in 32-Bit Windows Vista|first=Geoff|last=Chappell|date=2012-06-02}}</ref> and can be removed by [[Patch (computing)|patching]] the [[Kernel (operating system)|kernel]].<ref>{{cite web|url=https://www.raymond.cc/blog/make-windows-7-and-vista-32-bit-x86-support-more-than-4gb-memory/|title=Make Windows 7, 8 and Vista 32-bit (x86) Support More Than 4GB Memory|author=HAL9000|work=Raymond.cc}}</ref>


Thus, the "3 GB barrier" under x86 Windows "client" operating systems can therefore arise in two slightly different scenarios. In both, RAM near the 4 GB point conflicts with memory-mapped I/O space. Either the BIOS simply disables the conflicting RAM; or, the BIOS remaps the conflicting RAM to physical addresses above the 4 GB point,{{cn|date=March 2014}} but x86 Windows client editions refuse to use physical addresses higher than that, even though they are running with PAE enabled. The conflicting RAM is therefore unavailable to the operating system whether it is remapped or not.
Thus, the "3 GB barrier" under x86 Windows "client" operating systems can therefore arise in two slightly different scenarios. In both, RAM near the 4 GB point conflicts with memory-mapped I/O space. Either the BIOS simply disables the conflicting RAM; or, the BIOS remaps the conflicting RAM to physical addresses above the 4 GB point,{{cn|date=March 2014}} but x86 Windows client editions refuse to use physical addresses higher than that, even though they are running with PAE enabled. The conflicting RAM is therefore unavailable to the operating system whether it is remapped or not.

Revision as of 19:21, 12 June 2014

In computing, the 3 GB barrier[1] is a limitation of some 32-bit operating systems running on x86 microprocessors. It prevents the operating systems from using more than about 3 GB (3 × 10243 bytes) of main memory (RAM). The exact barrier varies by motherboard and I/O device configuration, particularly the size of video RAM; it may be in the range of 2.75 GB to 3.5 GB. [2] The barrier can be resolved by moving to a 64-bit processor and 64-bit operating system. On certain x86 hardware, it is possible to resolve it by using an operating system such as Linux or certain versions of Windows Server and Mac OS that fully support physical address extension (PAE) mode on x86.

The barrier is caused by a set of interactions between several components, including the operating system.

Physical address limits

It is a common misconception that 32-bit processors and operating systems are limited to 4 GB (232 bytes) of RAM,[3][4] as were the original 80386DX and other early IA-32 CPUs. Since the 1995 Pentium Pro,[5] almost[dubious – discuss] all modern x86 processors can in fact already address up to 64 GB (236 bytes) RAM via physical address extension (PAE).[citation needed] PAE is a modification of the protected mode address translation scheme. It allows virtual or linear addresses to be translated to 36-bit physical addresses, instead of the 32-bit addresses available without PAE.[6] The CPU pinouts likewise provide 36 bits of physical address to the motherboard. [6]

Many x86 operating systems, including any version of Linux with a PAE kernel and some versions of Windows Server and Mac OS, support the use of PAE to address up to 64 GB of RAM on an x86 system.[7][8][9]

Use of PAE to address RAM above the 4 GB point allows use of more than 3 GB. There are, however, factors that limit this ability, and lead to the "3 GB barrier" under certain circumstances, even though the processor fully supports PAE.[citation needed]

Chipset and other motherboard issues

Although, as noted above, most x86 processors from the Pentium Pro onward do support physical addresses up to 64 GB,[citation needed] the rest of the motherboard must participate in allowing RAM above the 4GB point to be addressed by the CPU. Chipsets and motherboards allowing more than 4 GB of RAM with x86 processors do exist, but in the past, most of those intended for other than the high-end server market supported only 4 GB of RAM.[10]

This, however, is not sufficient to explain the "3 GB barrier" that appears even when running some x86 versions of Microsoft Windows on platforms that do support more than 4 GB of RAM.

Memory mapped I/O and disabled RAM

Modern personal computers are built around a set of standards that depend on, among other things, the characteristics of the original PCI bus. The original PCI bus supported 32-bit physical addresses and 32-bit wide data transfers. PCI (and PCI Express, and AGP) devices present at least some, if not all, of their host control interfaces via a set of memory-mapped I/O locations (MMIO). The address space in which these MMIO locations appear is the same address space as that used by RAM, and while RAM can exist and be addressable above the 4 GB point, these MMIO locations decoded by I/O devices cannot be. They are limited by PCI bus specifications to addresses of 0xFFFFFFFF (232−1) and below. With 4 GB or more of RAM installed, and with RAM occupying a contiguous range of addresses starting at 0, some of the MMIO locations will overlap with RAM addresses. On machines with large amounts of video memory, MMIO locations have been found to occupy as much as 1.8 GB of the 32-bit address space.[11]

The BIOS and chipset are responsible for detecting these address conflicts and disabling access to the RAM at those locations.[12] Due to the way bus address ranges are determined on the PCI bus, this disabling is often at a relatively large granularity, resulting in relatively large amounts of RAM being disabled.[13]

Address remapping

x86 chipsets that support more than 4 GB of RAM typically also support memory remapping (referred to in some BIOS setup screens as "memory hole remapping").[citation needed] In this scheme, the BIOS detects the memory address conflict and in effect relocates the interfering RAM so that it may be addressed by the processor at a new physical address that does not conflict with MMIO.[citation needed] On the Intel side, this support once was limited to server chipsets; however, newer desktop chipsets like the Intel 955X and 965 and later support it as well.[citation needed] On the AMD side, the AMD K8 and later processors' built-in memory controller supported it from the beginning.[citation needed]

As the new physical addresses are above the 4 GB point, addressing this RAM does require that the operating system be able to use physical addresses larger than 232.[14] This capability is provided by PAE. Note that there is not necessarily a requirement for the operating system to support more than 4 GB total of RAM, as the total RAM might be only 4 GB; it is just that a portion of it appears to the CPU at addresses in the range from 4 GB and up.[14]

This form of the 3 GB barrier affects one generation of MacBooks,[15] lasting 1 year (Core2Duo (Merom) – Nov 2006 to Oct 2007): the prior generation was limited to 2 GB, while later generations (Nov 2007–Oct 2009) allowed 4 GB by supporting PAE and memory hole remapping, and subsequent generations (late 2009 onwards) use 64-bit processors and support over 4 GB.

Windows version dependencies

Main article: Physical Address Extension § Operating system support

In Microsoft's "non-server", or "client", x86 editions of Microsoft Windows: Windows XP, Windows Vista, Windows 7, Windows 8, and Windows 8.1, the 32-bit (x86) versions of these are able to operate x86 processors in PAE mode, and do so by default as long as the CPU present supports the NX bit.[11] Nevertheless, these operating systems do not permit addressing of physical memory above the 4 GB address boundary. This is not an architectural limit; it is a limit imposed by Microsoft as a workaround for device driver compatibility issues that were discovered during testing.[16] The limit was imposed through a licensing restriction,[17] and can be removed by patching the kernel.[18]

Thus, the "3 GB barrier" under x86 Windows "client" operating systems can therefore arise in two slightly different scenarios. In both, RAM near the 4 GB point conflicts with memory-mapped I/O space. Either the BIOS simply disables the conflicting RAM; or, the BIOS remaps the conflicting RAM to physical addresses above the 4 GB point,[citation needed] but x86 Windows client editions refuse to use physical addresses higher than that, even though they are running with PAE enabled. The conflicting RAM is therefore unavailable to the operating system whether it is remapped or not.

See also

References

  1. ^ MSDN. "Memory Limits for Windows Releases". Microsoft. Retrieved 28 December 2013.
  2. ^ Russinovich, Mark. "Pushing the Limits of Windows: Physical Memory". Technet. Microsoft. Retrieved 28 December 2013.
  3. ^ Matthew Murray (2009-10-27). "Windows 7: The 64-Bit Question". PCMag. Retrieved 2010-06-07. A 32-bit system is limited to utilizing 4GB of RAM (232 addresses)
  4. ^ Andy Patrizio (2002-07-22). "AMD Answers the 64-Bit Question". Wired. Retrieved 2010-05-24. 32-bit processors like Intel's Pentium III/IV and AMD's Athlon have a memory limit of 4 GB per CPU. Any more memory can't be addressed.
  5. ^ Shanley, Tom (1998). Pentium Pro and Pentium II System Architecture. PC System Architecture Series (Second ed.). Addison-Wesley. p. 445. ISBN 0-201-30973-4.
  6. ^ a b "Volume 1: Specifications" (pdf). Pentium Pro Family Developer’s Manual. Intel Corporation. 1996. pp. 3–15. The Pentium Pro processor physical address space is 236 bytes or 64-Gigabytes (64 Gbyte). Cite error: The named reference "Intel-ppro-devman-64GB" was defined multiple times with different content (see the help page).
  7. ^ Microsoft Corporation (2008-08-22). "Memory Limits for Windows Releases". Retrieved 2010-06-07. Windows Server 2008 Enterprise; Limit in 32-bit Windows: 64 GB
  8. ^ "Enabling PAE". Ubuntu Documentation. 2010-05-19. Retrieved 2010-06-07. Physical Address Extension is a technology which allows 32 bit operating systems to use up to 64 Gb of memory (RAM)... PAE is supported on the majority of computers today and it is an easy procedure to enable it in Ubuntu, if it is not already.
  9. ^ "Linux Kernel". Fedora Documentation. 2010-05-18. Retrieved 2010-06-07. Fedora 8 includes the following kernel builds: ... The kernel-PAE, for use in 32-bit x86 systems with more than 4GB of RAM, or with CPUs that have an NX (No eXecute) feature.
  10. ^ Intel Corporation (February 2005). "Intel Chipset 4 GB System Memory Support" (pdf). Pentium Pro Family Developer’s Manual. p. 7. In uni-processor based systems for mobile, desktop, workstation, and entry level servers, chipsets may be limited to 4 GB of maximum memory. In today's dual processor Intel server chipsets and workstations, maximum system memory size can be upwards of 16 GB. {{cite web}}: line feed character in |quote= at position 99 (help)
  11. ^ a b Mark Russinovich (2008-07-21). "Pushing the Limits of Windows: Physical Memory". Archived from the original on 9 June 2010. Retrieved 2010-06-07. Windows XP SP2 also enabled Physical Address Extensions (PAE) support by default on hardware that implements no-execute memory because its required for Data Execution Prevention (DEP), but that also enables support for more than 4GB of memory. {{cite web}}: Unknown parameter |deadurl= ignored (|url-status= suggested) (help)
  12. ^ Intel Corporation (February 2005). "Intel Chipset 4 GB System Memory Support" (pdf). In platforms populated with physical memory sizes approaching 4 GB and greater, onboard system resource requirements will likely not allow the operating system to take advantage of all physical memory populated due to PCI specification requirements and other memory mapped IO resources. Portions of physical memory may overlap with the memory space dedicated to other subsystems and become unavailable to the operating system.
  13. ^ Intel Corporation (February 2005). "Intel Chipset 4 GB System Memory Support" (pdf). Pentium Pro Family Developer’s Manual. p. 8.
  14. ^ a b Intel Corporation (February 2005). "Intel Chipset 4 GB System Memory Support" (pdf). Pentium Pro Family Developer’s Manual. p. 13,14. In order to use remapping, the operating system must be able to address ranges higher than 4 GB of memory {{cite web}}: line feed character in |quote= at position 96 (help)
  15. ^ "Understanding Intel Mac RAM".
  16. ^ Mark Russinovich (2008-07-21). "Pushing the Limits of Windows: Physical Memory". Archived from the original on 9 June 2010. Retrieved 2010-06-07. The problematic client driver ecosystem led to the decision for client SKUs to ignore physical memory that resides above 4GB, even though they can theoretically address it. {{cite web}}: Unknown parameter |deadurl= ignored (|url-status= suggested) (help)
  17. ^ Chappell, Geoff (2012-06-02). "Licensed Memory in 32-Bit Windows Vista".
  18. ^ HAL9000. "Make Windows 7, 8 and Vista 32-bit (x86) Support More Than 4GB Memory". Raymond.cc.{{cite web}}: CS1 maint: numeric names: authors list (link)
Retrieved from "https://en.wikipedia.org/w/index.php?title=3_GB_barrier&oldid=612672331"