Frame rate: Difference between revisions

Content deleted Content added

Inline

Revision as of 18:43, 18 March 2011

Frame rate, or frame frequency, is the frequency (rate) at which an imaging device produces unique consecutive images called frames. The term applies equally well to computer graphics, video cameras, film cameras, and motion capture systems. Frame rate is most often expressed in frames per second (FPS), and is also expressed in progressive scan monitors as hertz (Hz).

Frame rates in film and television

As of 2011, there are currently three main frame rate standards in the TV and movie-making business: 24p, 25p, and 30p. However, there are many variations on these as well as newer emerging standards.

50i (50 interlaced fields = 25 frames) is an interlaced format and is the standard video field rate per second for PAL and SECAM television.

60i (actually 59.94, or 60 x 1000/1001 to be more precise; 60 interlaced fields = 30 frames) is an interlaced format and is the standard video field rate per second for NTSC television (e.g. in the US), whether from a broadcast signal, DVD, or home camcorder. This interlaced field rate was developed separately by Farnsworth and Zworykin in 1934,^[1] and was part of the NTSC television standards mandated by the FCC in 1941. When NTSC color was introduced in 1953, the older rate of 60 fields per second was reduced by a factor of 1000/1001 to avoid interference between the chroma subcarrier and the broadcast sound carrier.

24p is a progressive format and is now widely adopted by those planning on transferring a video signal to film. Film and video makers use 24p even if their productions are not going to be transferred to film, simply because of the on-screen "look" of the (low) frame rate which matches native film. When transferred to NTSC television, the rate is effectively slowed to 23.976 frame/s, and when transferred to PAL or SECAM it is sped up to 25 frame/s. 35 mm movie cameras use a standard exposure rate of 24 frames per second, though many cameras offer rates of 23.976 frame/s for NTSC television and 25 frame/s for PAL/SECAM. The 24 frame/s rate became the de facto standard for sound motion pictures in the mid-1920s.^[2]
- Practically all hand-drawn animation is designed to be played at 24 frames per second. Actually hand drawing 24 unique frames per second ("1's") is costly. Even big budget films usually hand-draw animation shooting on "2's" -- one hand drawn frame is shown 2 times, so only 12 unique frames per second^[3]^[4] -- and a lot of animation is drawn on "4's" -- one hand drawn frame is shown 4 times, so only 6 unique frames per second.

25p is a progressive format and runs 25 progressive frames per second. This frame rate derives from the PAL television standard of 50i (or 50 interlaced fields per second). Film and Television companies use this rate in 50 Hz regions for direct compatibility with television field and frame rates. Conversion for 60 Hz countries is enabled by slowing down the media to 24p then converted to 60 Hz systems using pulldown. While 25p captures half the temporal resolution or motion that normal 50i PAL registers, it yields a higher vertical spacial resolution per frame. Like 24p, 25p is often used to achieve "cine"-look, albeit with virtually the same motion artifacts. It is also better suited to progressive-scan output (e.g., on LCD displays, computer monitors and projectors) because the interlacing is absent.

30p is a progressive format and produces video at 30 frames per second. Progressive (noninterlaced) scanning mimics a film camera's frame-by-frame image capture. The effects of inter-frame judder are less noticeable than 24p yet retains a cinematic-like appearance. Shooting Video in 30p mode gives no interlace artifacts but can introduce judder on image movement and on some camera pans. The widescreen film process Todd-AO used this frame rate in 1954–1956.^[5]

50p/60p is a progressive format and is used in high-end HDTV systems. While it is not technically part of the ATSC or DVB broadcast standards, it is rapidly gaining ground in the areas of set-top boxes and video recordings.^{[citation needed]}

72p is a progressive format and is currently in experimental stages. Major institutions such as Snell have demonstrated 720p72 pictures as a result of earlier analogue experiments, where 768 line television at 75 Hz looked subjectively better than 1150 line 50 Hz progressive pictures with higher shutter speeds available (and a corresponding lower data rate).^[6] Modern cameras such as the Red can use this frame rate to produce slow motion replays at 24 frame/s. Douglas Trumbull, who undertook experiments with different frame rates that led to the Showscan film format, found that 72 frame/s was the maximum frame rate at which emotional impact peaked for viewers.^[7] 72 frame/s is the maximum rate available in the WMV video file format.

Higher frame rates including 300 Hz have been tested by BBC R&D over concerns with sports and other broadcasts where fast motion with large HD displays could have a disorientating effect on viewers.^[8] 300 frame/s can be converted to both 50 and 60 Hz transmission formats without major issues.

Owing to their flexibility, software-based video formats can specify arbitrarily high frame rates, and many (cathode ray tube) consumer PC monitors operate at hundreds of frames per second, depending on selected video mode. LCD screens are usually 24, 25, 50, 60, or 120 frame/s.

Computing

Frame rate is also a term used in real-time computing. In a fashion somewhat comparable to the moving-picture definition presented above, a real-time frame is the time it takes to complete a full round of the system's processing tasks. If the frame rate of a real-time system is 60 hertz, the system reevaluates all necessary inputs and updates the necessary outputs 60 times per second under all circumstances.

The designed frame rates of real-time systems vary depending on the equipment. For a real-time system that is steering an oil tanker, a frame rate of 1 Hz may be sufficient, while a rate of even 100 Hz may not be adequate for steering a guided missile. The designer must choose a frame rate appropriate to the application's requirements.

Frame rates in video games

Frame rates in video games refer to the speed at which the image is refreshed (typically in frames per second, or FPS). Many underlying processes, such as collision detection and network processing, run at different or inconsistent frequencies or in different physical components of a computer. FPS affect the experience in two ways: low FPS does not give the illusion of motion effectively and affects the user's capacity to interact with the game, while FPS that vary substantially from one second to the next depending on computational load produce uneven, “choppy” animation. Many games lock their frame rate at lower but more sustainable levels to give consistently smooth motion.

The first 3D first-person shooter game for a personal computer, 3D Monster Maze, had a frame rate of approximately 6 frame/s, and was still a success. In modern action-oriented games where players must visually track animated objects and react quickly, frame rates of between 30 to 100+ FPS are considered acceptable by most, though this can vary significantly from game to game. Modern action games, including popular console shooters such as Halo 3, are locked at 30 frame/s maximum, while others, such as Unreal Tournament 3, can run well in excess of 100 frame/s on sufficient hardware. The frame rate within games varies considerably depending upon what is currently happening at a given moment, or with the hardware configuration (especially in PC games.) When the computation of a frame consumes more time than is alloted between frames, the frame rate decreases.

A culture of competition has arisen among game enthusiasts with regard to frame rates, with players striving to obtain the highest FPS possible, due to their utility in demonstrating a system's power and efficiency. Indeed, many benchmarks (such as 3DMark) released by the marketing departments of hardware manufacturers and published in hardware reviews focus on the FPS measurement. Even though the typical LCD monitors of today are locked at 60 frame/s, making extremely high frame rates impossible to see in realtime, playthroughs of game “timedemos” at hundreds or thousands of FPS for benchmarking purposes are still common.

Beyond measurement and bragging rights, such exercises do have practical bearing in some cases. A certain amount of discarded “headroom” frames are beneficial for the elimination of uneven (“choppy” or “jumpy”) output, and to prevent FPS from plummeting during the intense sequences when players need smooth feedback most.

Aside from frame rate, a separate but related factor unique to interactive applications such as gaming is latency. Excessive preprocessing can result in a noticeable delay between player commands and computer feedback, even when a full frame rate is maintained, often referred to as input lag.

Without realistic motion blurring, video games and computer animations do not look as fluid as film, even with the same frame rate. When a fast moving object is present on two consecutive frames, a gap between the images on the two frames contributes to a noticeable separation of the object and its afterimage in the eye. Motion blurring mitigates this effect, since it tends to reduce the image gap when the two frames are strung together The effect of motion blurring is essentially superimposing multiple images of the fast-moving object on a single frame. Motion blurring makes the motion more fluid to the human eye, even as the image of the object becomes blurry on each individual frame.

A high frame rate still does not guarantee fluid movements, especially on hardware with more than one GPU. This effect is known as micro stuttering.

Visible frame rate

The human visual system does not see in terms of frames; it works with a continuous flow of light information.^{[citation needed]} A related question is, “how many frames per second are needed for an observer to not see artifacts?” However, this question also does not have a single straight-forward answer. If the image switches between black and white each frame, the image appears to flicker at frame rates slower than 30 frame/s (interlaced). In other words, the flicker-fusion point, where the eyes see gray instead of flickering tends to be around 60 Hz (inconsistent). However, fast moving objects may require higher frame rates to avoid judder (non-smooth motion) artifacts—and the retinal fusion point can vary in different people, as in different lighting conditions. The flicker-fusion point can only be applied to digital images of absolute values, such as black and white. Where as a more analogous representation can run at lower frame rates, and still be perceived by a viewer. For example, motion blurring in digital games allows the frame rate to be lowered, while the human perception of motion remains unaffected. This would be the equivalent of introducing shades of gray into the black–white flicker.

Although human vision has no “frame rate”, it may be possible to investigate the consequences of changes in frame rate for human observers. The most famous example may be the wagon-wheel effect, a form of aliasing in the time domain; in which a spinning wheel suddenly appears to change direction when its speed approaches the frame rate of the image capture/reproduction system.

Different capture/playback systems may operate at the same frame rate, and still give a different level of "realism" or artifacts attributed to frame rate. One reason for this may be the temporal characteristics of the camera and display device.

Judder is a real problem in this day where 46 and 52-inch (1,300 mm) television sets have become the norm. The amount an object moves between frames physically on screen is now of such a magnitude that objects and backgrounds can no longer be classed as "clear". Letters cannot be read and looking at vertical objects like trees and lamp posts while the camera is panning sideways have even been known to cause headaches. The actual amount of motion blur needed to make 24 frames per second smooth eliminates every remnant of detail from the frames. Where adding the right amount of motion blur eliminates the uncomfortable side effects, it is more than often simply not done. It requires extra processing to turn the extra frames of a 120 frame/s source (which is the current recording "standard"^{[citation needed]}) into adequate motion blur for a 24 frame/s target. It would also potentially remove the detail and clarity of background advertising. Today, devices are up to the task of displaying 60 frames per second, using them all on the source media is very much possible. For example, the amount of data that can be stored on blu-ray and the processing power to decode it is more than adequate. Though the extra frames when not filtered correctly, can produce a somewhat video-esque quality to the whole, the improvement to motion heavy sequences is undeniable. Televisions these days often have an option to do some kind of frame interpolation (what would be a frame between 2 real frames gets calculated to some degree), where for frames that are almost identical this can give some manner of improvement in judder, it comes nowhere close to a source having a higher number of frames, it is merely a trick to compensate for sources not having a high enough FPS rate. This interpolation creates artifacts on screen that are clearly noticeable also.

A JavaScript, web-browser based application is available for users to be able to observe the visual differences between frame rates as a form of reference.^[9]

References

^ Gary Edgerton, The Columbia History of American Television, Columbia University Press, 2009, p. 51–52. ISBN 978-0231121651.
^ Kevin Brownlow, Silent Films: What Was the Right Speed? (1980).
^ "How many cels does a typical cartoon yield?" http://www.cartoon-factory.com/faq.html
^ "Cartoon Animation Basics" http://www.freeopenbook.com/flash8-bible/BBL0120.html
^ Todd-AO Specifications at a Glance, Widescreen Museum.
^ Snell & Willcox
^ Trumball
^ High Frame-Rate Television, BBC White Paper WHP 169, September 2008, M Armstrong, D Flynn, M Hammond, S Jolly, R Salmon
^ http://eapdesign.vndv.com/fps/

External links

[1] Gary Edgerton, The Columbia History of American Television, Columbia University Press, 2009, p. 51–52. ISBN 978-0231121651.

[2] Kevin Brownlow, Silent Films: What Was the Right Speed? (1980).

[3] "How many cels does a typical cartoon yield?" http://www.cartoon-factory.com/faq.html

[4] "Cartoon Animation Basics" http://www.freeopenbook.com/flash8-bible/BBL0120.html

[5] Todd-AO Specifications at a Glance, Widescreen Museum.

[6] Snell & Willcox

[7] Trumball

[8] High Frame-Rate Television, BBC White Paper WHP 169, September 2008, M Armstrong, D Flynn, M Hammond, S Jolly, R Salmon

[9] ttp://eapdesign.vndv.com/fps/

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

@@ Line 11: / Line 11: @@
 * '''[[24p]]''' is a [[Progressive scan|progressive]] format and is now widely adopted by those planning on transferring a [[video]] signal to [[film]]. Film and video makers use 24p even if their productions are not going to be transferred to film, simply because of the on-screen "look" of the (low) frame rate which matches native film. When transferred to NTSC television, the rate is effectively slowed to 23.976 frame/s, and when transferred to PAL or SECAM it is sped up to 25 frame/s. 35&nbsp;mm movie cameras use a standard exposure rate of 24 frames per second, though many cameras offer rates of 23.976 frame/s for NTSC television and 25 frame/s for PAL/SECAM. The 24 frame/s rate became the [[de facto]] standard for sound motion pictures in the mid-1920s.<ref>Kevin Brownlow, ''[http://www.cinemaweb.com/silentfilm/bookshelf/18_kb_2.htm Silent Films: What Was the Right Speed?]'' (1980).</ref>
+** Practically all [[hand-drawn animation]] is designed to be played at 24 frames per second. Actually hand drawing 24 unique frames per second ("1's") is costly. Even big budget films usually hand-draw animation [[traditional animation#.22Shooting on twos.22 | shooting on "2's"]] -- one hand drawn frame is shown 2 times, so only 12 unique frames per second<ref>
+"How many cels does a typical cartoon yield?"
+http://www.cartoon-factory.com/faq.html
+</ref><ref>
+"Cartoon Animation Basics"
+http://www.freeopenbook.com/flash8-bible/BBL0120.html
+</ref> -- and a lot of animation is drawn on "4's" -- one hand drawn frame is shown 4 times, so only 6 unique frames per second.
 * '''25p''' is a [[Progressive scan|progressive]] format and runs 25 progressive frames per second. This frame rate derives from the [[PAL]] [[television]] standard of 50i (or 50 [[Interlaced video|interlace]]d fields per second). Film and Television companies use this rate in 50&nbsp;Hz regions for direct compatibility with television field and frame rates. Conversion for 60&nbsp;Hz countries is enabled by slowing down the media to 24p then converted to 60&nbsp;Hz systems using pulldown. While 25p captures half the temporal resolution or motion that normal 50i PAL registers, it yields a higher vertical spacial resolution per frame. Like 24p, 25p is often used to achieve "cine"-look, albeit with virtually the same motion artifacts. It is also better suited to progressive-scan output (e.g., on LCD displays, computer monitors and projectors) because the interlacing is absent.