Jump to content

Apple File System

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by Artoria2e5 (talk | contribs) at 13:39, 11 August 2020. The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

Not to be confused with Apple File Service (AFS), the service implementing the Apple Filing Protocol (AFP).
Not to be confused with Andrew File System (AFS), the distributed file system.

APFS
Developer(s)Apple Inc.
Full nameApple File System
IntroducedMarch 27, 2017 (iOS), September 25, 2017 (macOS), with iOS 10.3, macOS 10.13
Partition IDs7C3457EF-0000-11AA-AA11-00306543ECAC (GPT)
Structures
Directory contentsB-tree[1]
Limits
Max file size8 EiB (9,223,372,036,854,775,808 bytes)[2]
Max no. of files9,223,372,036,854,775,808[2]
Allowed filename
characters		Unicode 9.0 encoded in UTF-8[3]
Features
Dates recordedaccess, attributes modified, contents modified, created
Date rangeJanuary 1, 1970 – July 21, 2554[1]
Date resolution1 ns[2]
File system
permissions		Unix permissions, NFSv4 ACLs
Transparent
compression		Partial (decmpfs)[4]
Transparent
encryption		Yes[5]
Copy-on-writeYes[3][5]
Other
Supported
operating systems		macOS, iPadOS, iOS, tvOS, watchOS

Apple File System (APFS) is a proprietary file system for macOS High Sierra (10.13) and later, iOS 10.3 and later, tvOS 10.2 and later,[6] watchOS 3.2 and later,[7] and all versions of iPadOS, developed and deployed by Apple Inc.[8][9] It aims to fix core problems of HFS+ (also called Mac OS Extended), APFS's predecessor on these operating systems. Apple File System is optimized for flash and solid-state drive storage, with a primary focus on encryption.[10][11]

History

Apple File System was announced at Apple's developers conference (WWDC) in June 2016 as a replacement for HFS+, which had been in use since 1998.[10][11] APFS was released for 64-bit iOS devices on March 27, 2017, with the release of iOS 10.3, and for macOS devices on September 25, 2017, with the release of macOS 10.13.[12][7]

Apple released a partial specification for APFS in September 2018 which supported read-only access to Apple File Systems on unencrypted, non-Fusion storage devices. The specification for software encryption was documented later.[13]

Design

The file system can be used on devices with relatively small or large amounts of storage. It uses 64-bit inode numbers,[2] and allows for more secure storage. The APFS code, like the HFS+ code, uses the TRIM command, for better space management and performance. It may increase read-write speeds on iOS and macOS,[7] as well as space on iOS devices, due to the way APFS calculates available data.[14]

Clones

Clones allow the operating system to make efficient file copies on the same volume without occupying additional storage space. Changes to a cloned file are saved as delta extents, reducing storage space required for document revisions and copies.[9] There is, however, no interface to mark two copies of the same file as clones of the other, or for other types of data deduplication.

Snapshots

Apple File System supports snapshots for creating a point-in-time, read-only instance of the file system.[9]

Encryption

Apple File System natively supports full disk encryption,[2] and file encryption with the following options:

  • no encryption
  • single-key encryption
  • multi-key encryption, where each file is encrypted with a separate key, and metadata is encrypted with a different key.[9]

Increased maximum number of files

APFS supports 64-bit inode numbers, supporting over 9 quintillion files (263) on a single volume.[2][5]

Data integrity

Apple File System uses checksums to ensure data integrity for metadata.[15]

Crash protection

Apple File System is designed to avoid metadata corruption caused by system crashes. Instead of overwriting existing metadata records in place, it writes entirely new records, points to the new ones and then releases the old ones, an approach known as redirect-on-write. This avoids corrupted records containing partial old and partial new data caused by a crash that occurs during an update. It also avoids having to write the change twice, as happens with an HFS+ journaled file system, where changes are written first to the journal and then to the catalog file.[15]

Compression

APFS supports transparent compression on individual files using Deflate (Zlib), LZVN (libFastCompression), and LZFSE. All three are Lempel-Ziv-type algorithms. This feature is inherited from HFS+, and is implemented with the same AppleFSCompression / decmpfs system using resource forks or extended attributes. As with HFS+, the transparency is broken for tools that do not use decmpfs-wrapped routines.[16]

Space sharing

APFS adds the ability to have multiple logical drives (referred to as volumes) in the same container where free space is available to all volumes in that container (block device).[17]

Limitations

Apple File System does not provide checksums for user data.[18] It also does not take advantage of byte-addressable non-volatile random-access memory.[19][20]

Unlike versions of HFS+ since Leopard, APFS has no support for hard links to directories.[3][21] This is in line with many other modern file systems, but Time Machine still relies on them, so APFS is not yet an option for its backup volumes (as of macOS 10.15 Catalina).[22][21]

Enumerating files, and any inode metadata in general, is much slower on APFS when it is located on a hard disk drive. This is because instead of storing metadata at a fixed location like HFS+ does, APFS stores them alongside the actual file data. This fragmentation of metadata means more seeks are performed when listing files, acceptable for SSDs but not HDDs.[23]

Security issues

  • In March 2018, the APFS driver in High Sierra was found to have a bug that causes the disk encryption password to be logged in plaintext.[24]

Support

macOS

Since macOS High Sierra, all devices with flash storage are automatically converted to APFS.[25] FileVault volumes are also converted. As of macOS Mojave, Fusion Drives and hard disk drives are also upgraded on installation.[26] The primary user interface to upgrade does not present an option to opt out of this conversion, and devices formatted with the High Sierra version of APFS will not be readable in previous versions of macOS.[25] Users can disable APFS conversion by using the installer's startosinstall utility on the command line and passing --converttoapfs NO.[27]

An experimental version of APFS, with some limitations, is available in macOS Sierra through the command line diskutil utility. Among these limitations, it does not perform Unicode normalization while HFS+ does,[28] leading to problems with languages other than English.[29] Drives formatted with Sierra’s version of APFS may also not be compatible with future versions of macOS or the final version of APFS, and the Sierra version of APFS cannot be used with Time Machine, FileVault volumes, or Fusion Drives.[30]

iOS, tvOS, and watchOS

iOS 10.3, tvOS 10.2, and watchOS 3.2 convert the existing HFSX file system to APFS on compatible devices.[12][7][31]

Third-party utilities

Despite the ubiquity of APFS volumes in today's Macs and the format's 2016 introduction, third-party repair utilities continue to have notable limitations in supporting APFS volumes, due to Apple's delayed release of complete documentation. According to Alsoft, the maker of DiskWarrior, Apple's 2018 release of partial APFS format documentation has delayed the creation of a version of DiskWarrior that can safely rebuild APFS disks.[32] Competing products, including MicroMat's TechTool and Prosoft's Drive Genius, are expected to increase APFS support as well.

Paragon Software Group has published a software development kit under the 4-Clause BSD License that supports read-only access of APFS drives.[33] An independent read-only open source implementation by Joachim Metz, libfsapfs, is released under GNU Lesser General Public License v3. It has been packaged into Debian and Ubuntu software repositories.[34] Both are command-line tools that do not expose a normal filesystem driver interface. There is a Filesystem in Userspace (FUSE) driver for Linux called apfs-fuse with read-only access.[35] An "APFS for Linux" project is working to integrate APFS support into the Linux kernel.[36]

See also

References

  1. ^ a b Hansen, K.H.; Toolan, F. (September 21, 2017). "Decoding the APFS file system". Digital Investigation. 22: 107–132. doi:10.1016/j.diin.2017.07.003. ISSN 1742-2876.
  2. ^ a b c d e f "Volume Format Comparison". Apple Developer. Retrieved May 25, 2018.
  3. ^ a b c "Apple File System Guide / Frequently Asked Questions". Retrieved May 25, 2018.
  4. ^ Bertin, René. "Compression and APFS". Github. Retrieved February 2, 2019.
  5. ^ a b c Apple Inc. "Apple File System Guide (Features)". Retrieved May 25, 2018.
  6. ^ "tvOS 10.2". What's New in tvOS. Apple Inc.
  7. ^ a b c d Warren, Tom (March 27, 2017). "Apple is upgrading millions of iOS devices to a new modern file system today". The Verge. Vox Media. Archived from the original on March 27, 2017. Retrieved March 27, 2017.
  8. ^ Roger Fingas (June 13, 2016). "'Apple File System' will scale from Apple Watch to Macs, replace HFS+". Apple Insider. Archived from the original on July 23, 2016.
  9. ^ a b c d Hutchinson, Lee (June 13, 2016). "Digging into APFS, Apple's new file system". Ars Technica UK. Retrieved June 15, 2016.
  10. ^ a b Weintraub, Seth (June 13, 2016). "Apple File System (APFS) announced for 2017, scales 'from Apple Watch to Mac Pro' and focuses on encryption". 9to5Mac. Archived from the original on March 28, 2017. Retrieved March 27, 2017.
  11. ^ a b Hutchinson, Lee (June 13, 2016). "New file system spotted in macOS Sierra [Updated]". Ars Technica. Condé Nast. Archived from the original on March 28, 2017. Retrieved March 27, 2017.
  12. ^ a b Clover, Juli (March 27, 2017). "Apple Releases iOS 10.3 With Find My AirPods, APFS, App Store Review Tweaks and More". MacRumors. Archived from the original on March 27, 2017. Retrieved March 27, 2017.
  13. ^ "Apple File System Reference" (PDF). Apple Developer.
  14. ^ Alan Loughnane. "Updating your iPhone will give you one major benefit". joe.co.uk. Archived from the original on May 20, 2017.
  15. ^ a b Adam Leventhal (June 19, 2016). "APFS in Detail: Data Integrity". Archived from the original on June 21, 2016.
  16. ^ Søgaard, Jens K. "How do I enable transparent compression on APFS?". Ask Different. Retrieved November 13, 2019.
  17. ^ "Archived copy" (PDF). Archived (PDF) from the original on October 23, 2016. Retrieved June 10, 2017.{{cite web}}: CS1 maint: archived copy as title (link)
  18. ^ A ZFS developer’s analysis of the good and bad in Apple’s new APFS file system Archived February 2, 2017, at the Wayback Machine
  19. ^ Robin Harris (June 24, 2016). "Why Apple's APFS won't last 30 years". ZDNet.
  20. ^ Adam Leventhal (June 19, 2016). "APFS in Detail: Overview". Retrieved October 1, 2017.
  21. ^ a b Leventhal, Adam H. (June 26, 2016). "A ZFS developer's analysis of the good and bad in Apple's new APFS file system". Ars Technica. APFS right now is incompatible with Time Machine due to the lack of directory hard links, a fairly disgusting implementation that likely contributes to Time Machine's questionable reliability.
  22. ^ "Disks you can use with Time Machine". Retrieved December 17, 2019.
  23. ^ "An analysis of APFS enumeration performance on rotational hard drives". Carbon Copy Cloner. Retrieved January 8, 2020.
  24. ^ "Uh Oh! Unified Logs in High Sierra (10.13) Show Plaintext Password for APFS Encrypted External Volumes via Disk Utility.app". mac4n6. Retrieved November 11, 2019.
  25. ^ a b "Prepare for APFS in macOS High Sierra". Apple.com. September 7, 2017. Retrieved September 19, 2017.
  26. ^ "macOS 10.14 Mojave: The Ars Technica review". arstechnica.com. September 25, 2018. Retrieved December 20, 2018.
  27. ^ Trouton, Rich (September 26, 2017). "Using the macOS High Sierra OS installer's startosinstall tool to avoid APFS conversion". Der Flounder. Retrieved January 16, 2018.
  28. ^ APFS’s “Bag of Bytes” Filenames
  29. ^ APFS is currently unusable with most non-English languages – The Eclectic Light Company Archived June 8, 2017, at the Wayback Machine
  30. ^ "How to Format a Drive With the APFS File System on macOS Sierra". Archived from the original on October 26, 2016. Retrieved October 26, 2016.
  31. ^ "jakepetroules/Filesystem". GitHub. Retrieved March 29, 2017.
  32. ^ "DiskWarrior 5.2 & Apple File System (APFS)". Retrieved June 28, 2020.
  33. ^ "Paragon Software Group Releases Free Paragon APFS SDK Community Edition for Software Developers, OEMs, Forensic Experts". Paragon Software Group. GitHub
  34. ^ "libyal/libfsapfs". GitHub. November 7, 2019. Library and tools to access the Apple File System (APFS)
  35. ^ Ross, Alistair (February 23, 2019). "How to mount macOS APFS disk volumes in Linux". The Ultimate Linux Newbie Guide. (Github)
  36. ^ "linux-apfs/linux-apfs-oot: APFS module for linux (out-of-tree repository)". GitHub. APFS for Linux. March 30, 2020.
Retrieved from "https://en.wikipedia.org/w/index.php?title=Apple_File_System&oldid=972332103"