Video content analysis: Difference between revisions

Content deleted Content added

Inline

Revision as of 15:35, 6 July 2010

Video Content Analysis (VCA) is the capability of analyzing video to detect and determine temporal events not based on a single image. It is used in a wide range of domains including entertainment^[1], health care, retail, automotive, transport, domotica, safety and security^[2]. The algorithms can be implemented as software on general purpose machines, or as hardware in specialized video processing units.

Many different functionalities can be implemented in VCA. Video Motion Detection is one of the simpler forms where motion is detected with regard to a fixed background scene. More advanced functionalities include video tracking and egomotion estimation.

Based on the internal representation that VCA generates in the machine, it is possible to build other functionalities, such as identification, behavior analysis or other forms of situation awareness.

VCA relies on good input video, so it is often combined with video enhancement technologies such as video denoising, image stabilization, unsharp masking and super-resolution.

Commercial applications

VCA is a new technology. New applications are frequently found, however the track record of different types of VCA differs widely. Functionalities such as motion detection and people counting are believed to be available as COTS products with a decent track-record.

In many domains VCA is implemented on CCTV systems, either distributed on the camera's (at-the-edge) or centralized on dedicated processing systems. Video Analytics and Smart CCTV are commercial terms for VCA in the security domain. In the UK the BSIA has developed an introduction guide for VCA in the security domain^[3].

Kinect is an add-on peripheral for the Xbox 360 gaming console that uses VCA for part of the user input.^[4]

The quality of VCA in the commercial setting is difficult to determine. It depends on many variables such as use case, implementation, system configuration and computing platform. Typical methods to get an objective idea of the quality in commercial settings include independent benchmarking^[5] and designated test-locations.

Academic Research

Video Content Analysis is a subset of Computer Vision and thereby of Artificial Intelligence. Two major academic benchmark initiatives are TRECVID^[6] and the PETS Benchmark Data^[7]. They focus on functionalities such as tracking, left luggage detection and virtual fencing. Significant academic research into the field is ongoing at the LIVS, University of Calgary, University of Waterloo, University of Kingston, Georgia Institute of Technology, Carnegie Mellon University, and The British Columbia Institute of Technology.

References

^ KINECT, add-on peripheral for the Xbox 360 console
^ VCA usage increase in British Security, BSIA report
^ British Industry VCA Guide, 262 An Introduction to Video Content Analysis Industry Guide
^ "Project Natal 101". Microsoft. 2009-06-01. Archived from the original on 2009-06-01. Retrieved 2009-06-02.
^ i-Lids, Benchmarking initiative by the UK Home Office
^ TRECVID, Academic benchmark initiative by NIST
^ PETS Benchmark Data, Performance Evaluation of Tracking and Surveillance (PETS) by University of Reading

External links

ipvideomarket.info: Commercial news outlet
Demystifying video analytics - is "intelligent" now a dirty word?: Criteria to determine intelligence of video analytics solutions by Edward Troha, Director of Marketing for ObjectVideo
Video Analytics: Understanding their limitations by Oliver Vellacott, CEO of IndigoVision
Video analytics: the new magic solution? by Jeremy Kimber, Honeywell's EMEA Marketing Leader

[KINECT-1] KINECT, add-on peripheral for the Xbox 360 console

[VCA_in_Security-2] VCA usage increase in British Security, BSIA report

[BSIA-3] British Industry VCA Guide, 262 An Introduction to Video Content Analysis Industry Guide

[Natal_101-4] "Project Natal 101". Microsoft. 2009-06-01. Archived from the original on 2009-06-01. Retrieved 2009-06-02.

[i-Lids-5] -Lids, Benchmarking initiative by the UK Home Office

[TRECVID-6] TRECVID, Academic benchmark initiative by NIST

[PETS_Benchmark_Data-7] PETS Benchmark Data, Performance Evaluation of Tracking and Surveillance (PETS) by University of Reading

[1]

[2]

[3]

[4]

[5]

[6]

[7]

@@ Line 8: / Line 8: @@
 ==Commercial applications==
+VCA is a new technology. New applications are frequently found, however the track record of different types of VCA differs widely. Functionalities such as motion detection and people counting are believed to be available as [[COTS]] products with a decent track-record.
-The quality of VCA in the commercial setting is difficult to determine. It depends on many variables such as [[use case]], [[implementation]], [[computer configuration|system configuration]] and [[computing platform]]. Typical methods to get an objective idea of the quality in commercial settings include independent [[benchmarking]]<ref name="i-Lids">[http://www.ilids.co.uk/ i-Lids], Benchmarking initiative by the [[UK Home Office]]</ref> and designated test-locations.
-Video Analytics and Smart CCTV are commercial terms for VCA in the security domain.
-In the UK the [[BSIA]] has developed an introduction guide for VCA in the security domain<ref name="BSIA">[http://www.bsia.co.uk/web_images/publications/262%20Intro%20to%20Video%20Content%20Analysis.pdf British Industry VCA Guide], 262 An Introduction to Video Content Analysis Industry Guide</ref>.
+In many domains VCA is implemented on [[CCTV]] systems, either distributed on the camera's (at-the-edge) or centralized on dedicated processing systems. Video Analytics and Smart CCTV are commercial terms for VCA in the security domain. In the UK the [[BSIA]] has developed an introduction guide for VCA in the security domain<ref name="BSIA">[http://www.bsia.co.uk/web_images/publications/262%20Intro%20to%20Video%20Content%20Analysis.pdf British Industry VCA Guide], 262 An Introduction to Video Content Analysis Industry Guide</ref>.
-[[Kinect]] is an add-on peripheral for the Xbox 360 console that uses VCA for part of the user input.<ref name="Natal 101">{{cite web |title=Project Natal 101 |url=http://download.microsoft.com/download/A/4/A/A4A457B3-DF5D-4BF2-AD4E-963454BA0BCC/ProjectNatalFactSheetMay09.zip |publisher=Microsoft |date=2009-06-01 |accessdate=2009-06-02 |archiveurl=http://blog.seattlepi.com/digitaljoystick/archives/169993.asp |archivedate=2009-06-01}}</ref>
+[[Kinect]] is an add-on peripheral for the Xbox 360 gaming console that uses VCA for part of the user input.<ref name="Natal 101">{{cite web |title=Project Natal 101 |url=http://download.microsoft.com/download/A/4/A/A4A457B3-DF5D-4BF2-AD4E-963454BA0BCC/ProjectNatalFactSheetMay09.zip |publisher=Microsoft |date=2009-06-01 |accessdate=2009-06-02 |archiveurl=http://blog.seattlepi.com/digitaljoystick/archives/169993.asp |archivedate=2009-06-01}}</ref>
+The quality of VCA in the commercial setting is difficult to determine. It depends on many variables such as [[use case]], [[implementation]], [[computer configuration|system configuration]] and [[computing platform]]. Typical methods to get an objective idea of the quality in commercial settings include independent [[benchmarking]]<ref name="i-Lids">[http://www.ilids.co.uk/ i-Lids], Benchmarking initiative by the [[UK Home Office]]</ref> and designated test-locations.
 ==Academic Research==