compress (software)
 | This article needs additional citations for verification. (June 2012) |
| Original author(s) | Spencer Thomas |
|---|---|
| Initial release | February 1985 |
| Operating system | Unix and Unix-like |
| Type | Command |
| Filename extension |
.Z |
|---|---|
| Internet media type |
application/x-compress |
| Developed by | Spencer Thomas |
| Type of format | data compression |
compress is a Unix shell compression program based on the LZW compression algorithm.[1] Compared to more modern compression utilities such as gzip and bzip2, compress performs faster and with less memory usage, at the cost of a significantly lower compression ratio.
The uncompress utility will restore files to their original state after they have been compressed using the compress utility. If no files are specified, the standard input will be uncompressed to the standard output.
In the up-coming POSIX and Single Unix Specification revision, it is planned that DEFLATE algorithm used in gzip format be supported in those utilities.[2]
Description of program
Files compressed by compress are typically given the extension ".Z" (modeled after the earlier pack program which used the extension ".z"). Most tar programs will pipe their data through compress when given the command line option "-Z". (The tar program in its own does not compress; it just stores multiple files within one tape archive.)
Files can be returned to their original state using uncompress. The usual action of uncompress is not merely to create an uncompressed copy of the file, but also to restore the timestamp and other attributes of the compressed file.
For files produced by compress on other systems, uncompress supports 9- to 16-bit compression.
History
The LZW algorithm used in compress was patented by Sperry Research Center in 1983. Terry Welch published an IEEE article on the algorithm in 1984,[3] but failed to note that he had applied for a patent on the algorithm. Spencer Thomas of the University of Utah took this article and implemented compress in 1984, without realizing that a patent was pending on the LZW algorithm. The GIF image format also incorporated LZW compression in this way, and Unisys later claimed royalties on implementations of GIF. Joseph M. Orost led the team and worked with Thomas et al. to create the 'final' (4.0) version of compress and published it as free software to the 'net.sources' USENET group in 1985. U.S. patent 4,558,302 was granted in 1985, and this is why compress could not be used without paying royalties to Sperry Research, which was eventually merged into Unisys. compress has fallen out of favor in particular user-groups because it makes use of the LZW algorithm, which was covered by a Unisys patent – because of this, gzip and bzip2 increased in popularity on Linux-based operating systems due to their alternative algorithms, along with better file compression. compress has, however, maintained a presence on Unix and BSD systems. The US LZW patent expired in 2003, so it is now in the public domain in the United States. All patents on the LZW worldwide have also expired (see Graphics Interchange Format#Unisys and LZW patent enforcement).
In the up-coming POSIX and Single Unix Specification revision, it is planned that DEFLATE algorithm used in gzip format be supported in those utilities.
Special output format
Output binary consists of bit groups. Each bit group consists of codes with fixed amount of bits (9-16). Each group (except last) should be aligned by amount of bits multiplied by 8 and right padded with zeroes. Last group should be aligned by 8 and padded with zeroes. You can find more information in ncompress issue.
For example, you want to output 10 9 bit codes and then output 5 10 bit codes. You have 2 bit groups: 100 bits and 50 bits. First group should be aligned by 72 and right padded with zeroes. Second group should be aligned by 8 and right padded with zeroes. You need to output 100 bits, then 44 zero bits, then 50 bits, then 6 zero bits.
It is actually a bug. LZW doesn't require any alignment. This bug is a part of original UNIX compress, ncompress, gzip and even windows port. It exists more than 35 years. All application/x-compress files were created using this bug. So we have to include it in output specification.
Some compress implementations write random bits from uninitialized buffer as alignment bits. There is no guarantee that alignment bits will be zeroes. So in terms of 100% compatibility decompressor have to just ignore alignment bit values.
See also
References
- ^ Frysinger, Mike. "ncompress: a public domain project". Retrieved 2014-07-30.
Compress is a fast, simple LZW file compressor. Compress does not have the highest compression rate, but it is one of the fastest programs to compress data. Compress is the de facto standard in the UNIX community for compressing files.
- ^ "0001041: Encourage implementations to include better integrity checksum, compression and decompression utilities if possible". Austin Group Bug Tracker. Retrieved 2017-11-23.
- ^ Welch, Terry A. (1984). "A technique for high performance data compression" (PDF). IEEE Computer. 17 (6): 8–19. doi:10.1109/MC.1984.1659158.
External links
- : compress data – Shell and Utilities Reference, The Single UNIX Specification, Version 4 from The Open Group
- ncompress - public domain compress/uncompress implementation for POSIX systems
- compress - original Unix compress (in a compress'd archive)
- compress - original Unix compress executable (gzip'd)
- Source Code for compress v4.0 (gzip'd sharchives)
- ZIP File containing a Windows port of the compress utility
- source code to the current version of fcompress.c from compress
- bit groups alignment - Explanation of bit groups alignment.
- lzws - New library and CLI, implemented without legacy code.