Visage SDK
.png){kind=logo} | |
| Developer(s) | Visage Technologies AB |
|---|---|
| Stable release | 7.3.1860
/ 31 July 2015 |
| Platform | |
| Type | Software development kit |
| Website | www.visagetechnologies.com |
visage|SDK is a multiplatform software development kit (SDK) created by Visage Technologies AB. visage|SDK allows software programmers to build a wide variety of face and head tracking and eye tracking applications for various operating systems, mobile and tablet environments, and embedded systems, using computer vision and machine learning algorithms.
Technology
FaceTrack[1] is a face tracking engine that tracks the face and facial features in video sequences in real time (e.g. 30 frames per seconds) and returns 3D head pose, gaze direction, facial feature coordinates and similar outputs. Tracking works in color, grayscale and near-infrared video.
HeadTrack[2] is aimed at applications that require accurate 3D head pose tracking in video, and returns 3D head translation and rotation, like the FaceTrack kit.
FaceDetect[3] identifies faces and facial features in still images containing one or more human faces in roughly frontal poses. The output is a set of MPEG-4 facial features (such as lips contour, nose, eyes, eyebrows and chin). Still images include JPEG, GIF and other standard image formats, and can be in color or grayscale, and the algorithm works on near-infrared images as well.
FaceAnalysis[4] finds/tracks faces in images or video, and then uses provides the user with gender, age and emotions for the faces in roughly frontal position. Emotions include six basic emotions, and the algorithm returns the probability of every basic emotion. Gender estimation provides the user with male or female estimation, while the age estimation returns the detected age of the user.
History
The development of Visage|SDK started in 2002 when Visage Technologies AB was founded in Linköping, Sweden. The founders were among the contributors to the MPEG-4 Face and Body Animation International Standard.[5][6]
Features
- For each processed video frame, returns detailed facial information,[7] such as:
- Fully automatic operation and instantaneous initialization
- Reinitialization if a new person appears in front of the camera
- Recovers from any losses due to occlusions, face turning away, tracked person coming and going etc.
- Tracks from webcam or AVI video files
- Raw image interface allows tracking from any video source
- Tracks in color or grayscale video (internal processing performed on grayscale), and in near-infrared video
- Minimal size of the face in the video image is approx. 80 pixels wide, minimum input video resolution is approximately 320×240, while higher resolutions (e.g. 640×480, 800×600) give better results
- Head rotation is tracked up to approximately 50 degrees.
See also
- Biometrics
- Computer vision
- Emotion recognition
- Eye tracking
- Face detection
- Facial recognition system
- Marketing research
- Three-dimensional face recognition
References
- ^ Visage Technologies: FaceTrack
- ^ Visage Technologies: HeadTrack
- ^ Visage Technologies: FaceDetect
- ^ Visage Technologies: FaceAnalysis
- ^ Pandžić, Igor and Robert Forchheimer (2002): "The origins of the MPEG-4 Facial Animation standard", in: MPEG-4 Facial Animation - The standard, implementations and applications (eds. Igor S. Pandžić and Robert Forchheimer). Chichester: John Wiley & Sons (ISBN 0-470-84465-5).
- ^ Pandžić, Igor and Robert Forchheimer (2002): "MPEG-4 Facial Animation Framework for the Web and Mobile Platforms", in: MPEG-4 Facial Animation - The standard, implementations and applications (eds. Igor S. Pandžić and Robert Forchheimer). Chichester: John Wiley & Sons (ISBN 0-470-84465-5)
- ^ Visage Technologies: Products and main features