ZCam is a brand of time-of-flight camera products for video applications by Israeli developer 3DV Systems. The ZCam supplements full-color video camera imaging with real-time range imaging information, allowing for the capture of video in 3D.
The original ZCam,[fn 1] released in 2000, was an ENG video camera add-on used for digital video compositing. Before agreeing in March 2009 to sell its assets to Microsoft, 3DV had planned to release a ranging video webcam (previously called the Z-Sense), also under the name ZCam.[fn 1] The ZCam webcam was one of several competing real-time range imaging camera products in development that target home game controller applications.[fn 2]
The ZCam's time-of-flight camera system features a near-infrared (NIR) pulse illumination component, as well as an image sensor with a fast gating mechanism. Based on the known speed of light, ZCam coordinates the timing of NIR pulse wave emissions from the illuminator with the gating of the image sensor, so that the signal reflected from within a desired depth range is captured exclusively. The amount of pulse signal collected for each pixel corresponds to where within the depth range the pulse was reflected from, and can thus be used to calculate the distance to a corresponding point on the captured subject.
Due to the fast timing required for light-based time-of-flight, the ZCam uses custom hardware for illumination and gating. The illuminator is a series of NIR laser diodes around the lens barrel, switched by special high-speed driver circuits that produce pulses with a rise time and fall time of less than one nanosecond. Previously using an image intensifier for gating the image sensor, 3DV later developed a special solid-state image shutter, in the form of a gallium arsenide-based electro-optical chip that is mounted atop the image sensor. The company was reportedly developing a gating solution based on less-expensive CMOS-process fabrication.
The time-of-flight camera is optically matched with a corresponding video camera, allowing the RGB video and range imaging to integrated together. 3DV refers to the combination as "RGBD," in which "D" refers to a "depth" or "distance" channel.
Targeted primarily at the video game market, the ZCam webcam was designed to be used as a game controller like the EyeToy, using gesture recognition to interpret hand and body gestures for controlling the interface, but without many of the complications of a purely 2D-based computer vision approach. Developing the device since 2005, 3DV completed the initial prototype in late 2006, and officially announced the product in late 2007.
The ZCam webcam had a 60-degree field of view, a frame rate of 60 Hz, a 1.3 megapixel full color video resolution, and an 8-bit Quarter VGA ranging resolution (320x240 pixels with 256 depth levels per pixel). Precision was fine as 1-2 centimeters, with a practical ranging limit of 0.5–2.5 meters distance. The webcam connected via a USB 2.0 interface. Demonstrations included a boxing game, an airplane demo, Windows Media Center hand-gesture control, and a body-gesture Second Life interface.
3DV stated that the webcam would be priced comparably to other peripherals in the gaming market such as the PlayStation Eye: less than US$100, with a bundled US$69.99 price mentioned as a possibility. The webcam was to include software development kits for camera control and gesture recognition. 3DV originally projected the ZCam to be released before the end of 2008, then later revised the projection to 2009. In March 2009, the company agreed to sell its assets including the ZCam to a third party, later confirmed to be Microsoft. Following these reports, it was speculated that Microsoft would use the ZCam technology for a motion-sensing controller system for the Xbox 360 video game console or its successor. This speculation increased in the month leading up to Microsoft's announcement of the Kinect 3D depth-sensing device at the 2009 Electronic Entertainment Expo, during which leaked information about that device prompted frequent comparisons with the ZCam.
- The name has been formatted several different ways, including "ZCAM" and "Zcam". Although the "ZCam" styling had been used for the studio camera add-on, the 3DV website currently refers to the original product as "Z-Cam", and the webcam product as "ZCam".
- Other companies developing competing cameras included Canesta and PrimeSense.
- "3DV Systems Ltd. Introduces ZCAM, World's First Real-Time 3D Studio Camera". 3DV Systems. 1999-04-19. Archived from the original on 2005-02-11. Retrieved 2009-02-19.
- "JVC enters strategic alliances with cutting edge technology leaders". JVC. 2000-04-10. Retrieved 2009-02-19.
- "Products". 3DV Systems. Archived from the original on 2006-11-02. Retrieved 2009-02-19.
- "Product Evolution". 3DV Systems. Archived from the original on 2009-02-28. Retrieved 2009-02-19.
- "ZCAM 3D Camera". JVC Professional. JVC. 2003-09-24. Retrieved 2009-06-20.
- Richard Marks (2004-01-21). EyeToy: A New Interface for Interactive Entertainment (Windows Media v7). Stanford University. Event occurs at 58:24. Retrieved 2009-06-20.
- "Elron Group company 3DV signs definitive asset sale agreement" (PDF). Elron Electronic Industries. 2009-03-29. Retrieved 2009-03-30.
- Shelah, Shmulik (2009-06-22). "Microsoft confirms 3DV acquisition". Globes. Tel Aviv: Globes Publisher Itonut. Archived from the original on 2009-06-22. Retrieved 2009-06-23.
[Microsoft corporate vice president of Israel Research & Development Moshe Lichtman] said, for the first time officially, that "the R&D center helped Microsoft in buying the intellectual property of 3DV Systems, and in the wake of that dozens of the company's employees were recruited to work at the development center."
- Takahashi, Dean (2009-05-29). "Peeling back another layer of detail on Microsoft’s secret gesture-control system for games". VentureBeat. Retrieved 2009-06-15.
- Johnson, R. Colin (2009-02-04). "3D sensor moves from car to CE". EE Times. TechInsights. Retrieved 2009-06-15.
- Katz, Sagi (2008-02-28). "Boxing with ZCam (part 1)". Engineering TV. Penton Media. Archived from the original on 2008-02-28. Retrieved 2009-03-12.
- Iddan, Gavriel J.; Yahav, Giora (2001-01-24). "3D imaging in the studio (and elsewhere…)" (PDF). Proceedings of SPIE 4298 (San Jose, CA: SPIE, published 2003-04-29). p. 48. doi:10.1117/12.424913. Archived from the original (PDF) on 2009-06-12. Retrieved 2009-02-19.
- Captain, Sean (2008-05-01). "Out of Control Gaming". PopSci.com. Popular Science. Retrieved 2009-06-15.
- Nutt, Christian (2008-01-17). "Q&A: 3DV's Barel On The Future Of Camera-Based Game Control". Gamasutra. Think Services. Retrieved 2009-02-19.
- "3DV Systems announces ZCam, low cost real-time depth sensing camera". 3DV Systems. 2007-12-02. Archived from the original (Portable Document Format) on 2009-02-10. Retrieved 2009-02-19.
- "ZCam Product Data Sheet" (JPEG). StudioGE. p. 2. Retrieved 2009-06-03.
- "3DV Announces ZCam Real Time 3D Camera for the PC". PC Magazine. Ziff Davis. 2008-01-08. Retrieved 2009-02-19.
- Barel, Tomer (2008-02-07). "ZCam - CES 2008: Interview" (Flash Video). GameTrailers. Retrieved 2009-02-19.
- Flier, Rich (2008-02-28). "Boxing with ZCam (part 2)". Engineering TV. Penton Media. Archived from the original on 2008-02-28. Retrieved 2009-03-12.
- Markoff, John (2008-04-11). "The Coming of the Holodeck". Bits Blog. The New York Times Company. Retrieved 2009-02-19.
- Takahashi, Dean (2008-07-10). "3DV fleshes out gesture-based gaming plans, hires North American chief". VentureBeat. Retrieved 2008-12-02.
- Takahashi, Dean (2009-02-21). "Sources confirm Microsoft is buying 3DV Systems". VentureBeat. Retrieved 2009-02-23.
- Thorsen, Tor (May 12, 2009). "Xbox 360 motion-sensing camera in development - WSJ". Gamespot. Retrieved 2009-05-13.