|This article needs additional citations for verification. (September 2007)|
Lossy data compression involves discarding some of the media's data so that it becomes simplified enough to be stored within the desired disk space or be transmitted (or streamed) within the bandwidth limitations (known as a data rate or bit rate for media that is streamed). If the compressor could not reproduce enough data in the compressed version to reproduce the original, the result is a diminishing of quality, or introduction of artifacts. Alternatively, the compression algorithm may not be intelligent enough to discriminate between distortions of little subjective importance and those objectionable to the viewer.
Compression artifacts occur in many common media such as DVDs, common computer file formats such as JPEG, MP3, or MPEG files, and some alternatives to the compact disc, such as Sony's MiniDisc format. Uncompressed media (such as on Laserdiscs, Audio CDs, and WAV files) or losslessly compressed media (such as FLAC or PNG) do not suffer from compression artifacts.
The minimization of perceivable artifacts is a key goal in implementing a lossy compression algorithm. However, artifacts are occasionally intentionally produced for artistic purposes, a style known as glitch art or datamoshing.
Technically speaking, a compression artifact is a particular class of data error that is usually the consequence of quantization in lossy data compression. Where transform coding is used, they typically assume the form of one of the basis functions of the coder's transform space.
When performing block-based coding for quantization, as in JPEG-compressed images, several types of artifacts can appear.
- Staircase noise (aliasing) along curving edges
- Blockiness in "busy" regions (sometimes called quilting or checkerboarding)
Other lossy algorithms, which use pattern matching to deduplicate similar symbols, are prone to introducing hard to detect errors in printed text. For example the numbers "6" and "8" may get replaced. This has been observed to happen with JBIG2 in certain photocopier machines.
Image artifact reduction
Various approaches have been proposed to reduce image compression effects, but to use standardized compression/decompression techniques and retain the benefits of compression (for instance, lower transmission and storage costs), many of these methods focus on "post-processing"—that is, processing images when received or viewed. No post-processing technique has been shown to improve image quality in all cases; consequently, none has garnered widespread acceptance, though some have been implemented and are in use in proprietary systems. Many photo editing programs, for instance, have proprietary JPEG artifact reduction algorithms built-in.
When motion prediction is used, as in MPEG-1, MPEG-2 or MPEG-4, compression artifacts tend to remain on several generations of decompressed frames, and move with the optic flow of the image, leading to a peculiar effect, part way between a painting effect and "grime" that moves with objects in the scene.
Data errors in the compressed bit-stream can lead to errors similar to large quantization errors, or can disrupt the parsing of the data stream entirely for a short time, leading to "break-up" of the picture. Where gross errors have occurred in the bit-stream, decoders continue to apply updates to the damaged picture for a short interval, creating a "ghost image" effect, until receiving the next independently compressed frame. In MPEG picture coding, these are known as "I-frames", with the 'I' standing for "intra".
Video compression artifacts include cumulative results of compression of the comprising still images, for instance ringing or other edge busyness in successive still images appear in sequence as a shimmering blur of dots around edges, called mosquito noise, as they resemble mosquitoes swarming around the object.
Lossy audio compression typically works with a psychoacoustic model—a model of human hearing perception. Lossy audio formats typically involve the use of a time/frequency domain transform, such as a modified discrete cosine transform. With the psychoacoustic model, masking effects such as frequency masking and temporal masking are exploited, so that sounds that should be imperceptible are not recorded. For example, in general, human beings are unable to perceive a quiet tone played simultaneously with a similar but louder tone. A lossy compression technique might identify this quiet tone and attempt to remove it. Also, quantization noise can be "hidden" where they would be masked by more prominent sounds. With low compression, a conservative psy-model is used with small block sizes.
When the psychoacoustic model is inaccurate, when the transform block size is restrained, or when aggressive compression is used, this may result in compression artifacts. Compression artifacts in compressed audio typically show up as ringing, pre-echo, "birdie artifacts", drop-outs, rattling, warbling, metallic ringing, an underwater feeling, hissing, or "graininess".
A good way to observe compression artifacts in audio is to listen to the applause in a relatively highly compressed audio file (e.g. 96 kbit/sec MP3). In general, musical tones have repeating waveforms and more predictable variations in volume, whereas applause is essentially random, therefore hard to compress. A highly compressed track of applause will illustrate the "metallic ringing" and other compression artifacts very well.
|This section requires expansion. (June 2008)|
Compression artifacts may intentionally be used as a visual style, sometimes known as glitch art.
In still images, an example is Jpegs by German photographer Thomas Ruff, which uses intentional JPEG artifacts as the basis of the picture's style. Another example is the webcomic Sweet Bro and Hella Jeff, which uses artifacts heavily in comic pages.
In video art, one technique is datamoshing, where two videos are interleaved so intermediate frames are interpolated from two separate sources. Another technique involves simply transcoding from one lossy video format to another, which exploits the difference in the how the separate video codecs process motion and color information. The technique was pioneered by artists Bertrand Planes in collaboration with Christian Jacquemin in 2006 with DivXPrime, Sven König, Takeshi Murata, Jacques Perconte and Paul B. Davis in collaboration with Paperrad, and more recently used by David OReilly and within music videos for Chairlift and Kanye West.
|Wikimedia Commons has media related to Compression artefacts.|
- Geere, Duncan (2011-12-13). "Glitch art created by 'databending'". Wired. Retrieved 2011-12-23.
- Baker-Smith, Ben (2009-04-28). "Datamoshing – The Beauty of Glitch". Bitsynthesis.com. Retrieved 2009-04-28.
- "Xerox scanners/photocopiers randomly alter numbers in scanned documents". 2013-08-02. Retrieved 2013-08-04.
- "Confused Xerox copiers rewrite documents, expert finds". BBC News. 2013-08-06. Retrieved 2013-08-06.
- Phuc-Tue Le Dinh and Jacques Patry. Video compression artifacts and MPEG noise reduction. Video Imaging DesignLine. February 24, 2006. Retrieved May 28, 2009.
- "3.9 mosquito noise: Form of edge busyness distortion sometimes associated with movement, characterized by moving artifacts and/or blotchy noise patterns superimposed over the objects (resembling a mosquito flying around a person's head and shoulders)." ITU-T Rec. P.930 (08/96) Principles of a reference impairment system for video
- jpegs, Thomas Ruff, Aperture, May 31, 2009, 132 pp., ISBN 978-1-59711-093-8
- Review: jpegs by Thomas Ruff, by Joerg Colberg, Apr 17, 2009
- "sweet bro and hella jeff". Mspaintadventures.com. Retrieved 2013-10-17.
- Anoniem zei (2009-02-19). "From compression artifact to filter". Rosa-menkman.blogspot.com. Retrieved 2011-12-23.
- Jacquemin, Christian (2008), Le bug dans l'oeuvre DivXPrime de Bertrand Planes: Invention et mutation. In, Ivan Toulouse and Daniel Danétis, editors, Eurêka: Le moment de l'invention, un dialogue entre art et science, L'Harmattan, Paris. pages 245-256, retrieved November, 2012
- Pixel Bleed, by John Michael Boling. Rhizome. February 25, 2009.
- Rodriguez, Jayson (2009-02-18). "Kanye West Rushes New Video Onto His Web Site - MTV News". Mtv.com. Retrieved 2011-12-23.
- DivXPrime First known experiments of datamoshing video software by Bertrand Planes & Christian Jacquemin (based on Xvid algorithm)
- Teaser for "Accouchement Sonique" a short movie directed by Jérome Blanquet, datamoshing effect by David Olivari, produced by [Metronomic].
- datamosher A GPL video datamoshing software.
- Example of heavy video compression artefacts.
- JPEG Tutor, an interactive applet allowing you to investigate the effects of changing the quantization matrix.
- JPEG deringing and deblocking: Matlab software and Photoshop plug-in
- Vernacular of File Formats, a guide to different compression artifacts from the most used file formats