Physically based rendering
Physically based rendering (PBR) is an approach in computer graphics that seeks to render graphics in a way that more accurately models the flow of light in the real world. Many PBR pipelines have the accurate simulation of photorealism as their goal. Feasible and quick approximations of the bidirectional reflectance distribution function and rendering equation are of mathematical importance in this field. Photogrammetry may be used to help discover and encode accurate optical properties of materials. Shaders may be used to implement PBR principles.
Starting in the 1980s, a number of rendering researchers worked on establishing a solid theoretical basis for rendering, including physical correctness. Much of this work was done at the Cornell University Program of Computer Graphics; a 1997 paper from that lab describes the work done at Cornell in this area to that point.
The phrase "Physically Based Rendering" was more widely popularized by Matt Pharr, Greg Humphreys, and Pat Hanrahan in their book of the same name from 2014, a seminal work in modern computer graphics that won its authors a Technical Achievement Academy Award for special effects.
PBR is, as Joe Wilson puts it, "more of a concept than a strict set of rules" – but the concept contains several distinctive points of note. One of these is that – unlike many previous models that sought to differentiate surfaces between non-reflective and reflective – PBR recognizes that, in the real world, as John Hable puts it, "everything is shiny". Even "flat" or "matte" surfaces in the real world such as concrete will reflect a small degree of light, and many metals and liquids will reflect a great deal of it. Another thing that PBR models attempt to do is to integrate photogrammetry - measurements from photographs of real-world materials - to study and replicate real physical ranges of values to accurately simulate albedo, gloss, reflectivity, and other physical properties. Finally, PBR puts a great deal of emphasis on microfacets, and will often contain additional textures and mathematical models intended to model small-scale specular highlights and cavities resulting from smoothness or roughness in addition to traditional specular or reflectivity maps.
PBR topics that deal with surfaces often rely on a simplified model of the bidirectional reflectance distribution function (BRDF), that approximates well optical properties of the material using only handful of intuitive parameters, and that is quick to compute on a computer. Common techniques are approximations and simplified models, that try to fit approximate models to more accurate data from other more time consuming methods or laboratory measurements (such as those of a gonioreflectometer).
As described by researcher Jeff Russell of Marmoset, a surface-focused physically based rendering pipeline may also focus on the following areas of research:
- Translucency and transparency
- Conservation of energy
- Fresnel reflection
- Microsurface scattering
PBR is also often extended into volume renderings, with areas of research like:
- Lens-related/Angle of view/Depth of field effects
- Light scattering
- Participating media
- Atmospheric visual properties such as:
Thanks to high performance and low costs of modern hardware it has become feasible to use PBR not only for industrial but also entertainment purposes wherever photorealistic images are desired including video games and movie making. Since consumer-grade mobile devices such as smartphones are totally incapable of running VR content in real-time, PBR is not applicable to them, however, mid to high end desktop hardware can be capable and has a market for easy-to-use programmes for free that define and render content in real-time where sacrifices in visual fidelity are acceptable:
- Unity Engine
- Unreal Engine 4
- Godot (game engine)
- Minecraft GLSL Shaders
- Roblox Studio
- Cinema 4D
- 3ds Max
A typical application provides an intuitive graphical user interface that allows artists to define and layer materials with arbitrary properties and to assign them to a given 2D or 3D object to recreate the appearance of any synthetic or organic material. Environments can be defined with procedural shaders or textures as well as procedural geometry or meshes or pointclouds. If possible all changes are made visible in real-time and therefore allow for quick iterations. Sophisticated applications allow savvy users to write custom shaders in a shading language such as HLSL or GLSL, though increasingly node-based material editors that allow a graph-based workflow with native support for important concepts such as light position, levels of reflection and emission and metallicity, and a wide range of other math and optics functions are replacing hand-written shaders for all but the most complex applications.
- Greenberg, Donald P. (1 August 1999). "A framework for realistic image synthesis" (PDF). Communications of the ACM. 42 (8): 44–53. doi:10.1145/310930.310970. Archived (PDF) from the original on 24 September 2018. Retrieved 27 November 2017.
- Pharr, Matt, Humphreys, Greg, and Hanrahan, Pat. "Physically Based Rendering". Retrieved on 14 November 2016.
- Wilson, Joe. "Physically Based Rendering – And You Can Too!" Retrieved on 12 Jan 2017.
- Hable, John . "Everything Is Shiny" Archived 2016-12-05 at the Wayback Machine. Retrieved on 14 November 2016.
- Russell, Jeff, "PBR Theory". Retrieved on 20 August 2019.
- Kam, Ken. "How Moore's Law Now Favors Nvidia Over Intel". Forbes. Retrieved 2018-05-29.
- "Physically Based Rendering: From Theory to Implementation". www.pbrt.org. Retrieved 2018-05-29.
- "Physically Based Shading on Mobile". Unreal Engine. Retrieved 2018-05-29.
- "Point Clouds". Sketchfab Help Center. Retrieved 2018-05-29.