Image analysis is the extraction of meaningful information from images; mainly from digital images by means of digital image processing techniques. Image analysis tasks can be as simple as reading bar coded tags or as sophisticated as identifying a person from their face.
Computers are indispensable for the analysis of large amounts of data, for tasks that require complex computation, or for the extraction of quantitative information. On the other hand, the human visual cortex is an excellent image analysis apparatus, especially for extracting higher-level information, and for many applications — including medicine, security, and remote sensing — human analysts still cannot be replaced by computers. For this reason, many important image analysis tools such as edge detectors and neural networks are inspired by human visual perception models.
Digital Image Analysis or Computer Image Analysis is when a computer or electrical device automatically studies an image to obtain useful information from it. Note that the device is often a computer but may also be an electrical circuit, a digital camera or a mobile phone. It involves the fields of computer or machine vision, and medical imaging, and makes heavy use of pattern recognition, digital geometry, and signal processing. This field of computer science developed in the 1950s at academic institutions such as the MIT A.I. Lab, originally as a branch of artificial intelligence and robotics.
It is the quantitative or qualitative characterization of two-dimensional (2D) or three-dimensional (3D) digital images. 2D images are, for example, to be analyzed in computer vision, and 3D images in medical imaging. The field was established in the 1950s—1970s, for example with pioneering contributions by Azriel Rosenfeld, Herbert Freeman, Jack E. Bresenham, or King-Sun Fu.
There are many different techniques used in automatically analysing images. Each technique may be useful for a small range of tasks, however there still aren't any known methods of image analysis that are generic enough for wide ranges of tasks, compared to the abilities of a human's image analysing capabilities. Examples of image analysis techniques in different fields include:
- 2D and 3D object recognition,
- image segmentation,
- motion detection e.g. Single particle tracking,
- video tracking,
- optical flow,
- medical scan analysis,
- 3D Pose Estimation.
The applications of digital image analysis are continuously expanding through all areas of science and industry, including:
- assay micro plate reading, such as detecting where a chemical was manufactured.
- astronomy, such as calculating the size of a planet.
- automated species identification (e.g. plant and animal species)
- error level analysis
- machine vision, such as to automatically count items in a factory conveyor belt.
- materials science, such as determining if a metal weld has cracks.
- medicine, such as detecting cancer in a mammography scan.
- metallography, such as determining the mineral content of a rock sample.
- microscopy, such as counting the germs in a swab.
- automatic number plate recognition;
- optical character recognition, such as automatic license plate detection.
- remote sensing, such as detecting intruders in a house, and producing land cover/land use maps.
- robotics, such as to avoid steering into an obstacle.
- security, such as detecting a person's eye color or hair color.
Object-Based Image Analysis (OBIA) employs two main processes, segmentation and classification. Traditional image segmentation is on a per-pixel basis. However, OBIA groups pixels into homogeneous objects. These objects can have different shapes and scale. Objects also have statistics associated with them which can be used to classify objects. Statistics can include geometry, context and texture of image objects. The analyst defines statistics in the classification process to generate for example land cover.
When applied to earth images, OBIA is known as Geographic Object-Based Image Analysis (GEOBIA), defined as "a sub-discipline of geoinformation science devoted to (...) partitioning remote sensing (RS) imagery into meaningful image-objects, and assessing their characteristics through spatial, spectral and temporal scale". The international GEOBIA conference has been held biannually since 2006.
Object-based image analysis is also applied in other fields, such as cell biology or medicine. It can for instance detect changes of cellular shapes in the process of cell differentiation.
- Archeological imagery
- Imaging technologies
- Image processing
- Land cover mapping
- Military intelligence
- Remote sensing
- Solomon, C.J., Breckon, T.P. (2010). Fundamentals of Digital Image Processing: A Practical Approach with Examples in Matlab. Wiley-Blackwell. doi:10.1002/9780470689776. ISBN 978-0470844731.CS1 maint: multiple names: authors list (link)
- Xie, Y.; Sha, Z.; Yu, M. (2008). "Remote sensing imagery in vegetation mapping: a review". Journal of Plant Ecology. 1 (1): 9–23. doi:10.1093/jpe/rtm005.
- Wilschut, L.I.; Addink, E.A.; Heesterbeek, J.A.P.; Dubyanskiy, V.M.; Davis, S.A.; Laudisoit, A.; Begon, M.; Burdelov, L.A.; Atshabar, B.B.; de Jong, S.M (2013). "Mapping the distribution of the main host for plague in a complex landscape in Kazakhstan: An object-based approach using SPOT-5 XS, Landsat 7 ETM+, SRTM and multiple Random Forests". International Journal of Applied Earth Observation and Geoinformation. 23 (100): 81–94. Bibcode:2013IJAEO..23...81W. doi:10.1016/j.jag.2012.11.007. PMC 4010295. PMID 24817838.
- G.J. Hay & G. Castilla: Geographic Object-Based Image Analysis (GEOBIA): A new name for a new discipline. In: T. Blaschke, S. Lang & G. Hay (eds.): Object-Based Image Analysis – Spatial Concepts for Knowledge-Driven Remote Sensing Applications. Lecture Notes in Geoinformation and Cartography, 18. Springer, Berlin/Heidelberg, Germany: 75-89 (2008)
- Blaschke, Thomas; Hay, Geoffrey J.; Kelly, Maggi; Lang, Stefan; Hofmann, Peter; Addink, Elisabeth; Queiroz Feitosa, Raul; van der Meer, Freek; van der Werff, Harald; van Coillie, Frieke; Tiede, Dirk (2014). "Geographic Object-Based Image Analysis – Towards a new paradigm". ISPRS Journal of Photogrammetry and Remote Sensing. Elsevier BV. 87 (100): 180–191. Bibcode:2014JPRS...87..180B. doi:10.1016/j.isprsjprs.2013.09.014. ISSN 0924-2716. PMC 3945831. PMID 24623958.
- Salzmann, M.; Hoesel, B.; Haase, M.; Mussbacher, M.; Schrottmaier, W. C.; Kral-Pointner, J. B.; Finsterbusch, M.; Mazharian, A.; Assinger, A. (2018-02-20). "A novel method for automated assessment of megakaryocyte differentiation and proplatelet formation" (PDF). Platelets. 29 (4): 357–364. doi:10.1080/09537104.2018.1430359. ISSN 1369-1635. PMID 29461915. S2CID 3785563.
- The Image Processing Handbook by John C. Russ, ISBN 0-8493-7254-2 (2006)
- Image Processing and Analysis - Variational, PDE, Wavelet, and Stochastic Methods by Tony F. Chan and Jianhong (Jackie) Shen, ISBN 0-89871-589-X (2005)
- Front-End Vision and Multi-Scale Image Analysis by Bart M. ter Haar Romeny, Paperback, ISBN 1-4020-1507-0 (2003)
- Practical Guide to Image Analysis by J.J. Friel, et al., ASM International, ISBN 0-87170-688-1 (2000).
- Fundamentals of Image Processing by Ian T. Young, Jan J. Gerbrands, Lucas J. Van Vliet, Paperback, ISBN 90-75691-01-7 (1995)
- Image Analysis and Metallography edited by P.J. Kenny, et al., International Metallographic Society and ASM International (1989).
- Quantitative Image Analysis of Microstructures by H.E. Exner & H.P. Hougardy, DGM Informationsgesellschaft mbH, ISBN 3-88355-132-5 (1988).
- "Metallographic and Materialographic Specimen Preparation, Light Microscopy, Image Analysis and Hardness Testing", Kay Geels in collaboration with Struers A/S, ASTM International 2006.