DIPS (Digital Image Processing with Sound)

From Wikipedia, the free encyclopedia
Jump to: navigation, search
Screenshot, DIPS4 version 1.1 for Max 5.jpg
Developer(s) DIPS Development Group
Stable release 4.1.1 / August 1, 2009; 5 years ago (2009-08-01)
Operating system Mac OS X
Type music and multimedia development
Website http://dips.kcm-sd.ac.jp

DIPS (Digital Image Processing with Sound) is a set of plug-in objects that handle real-time digital image processing in Max/MSP programming environment. Combining with the built-in objects of the environment, DIPS enables to program the interaction between audio and visual events with ease, and supports the realization of interactive multimedia art as well as interactive computer music.

Summary of Features[edit]

  • A plug-in software for Max/MSP (Max 5 and 6)
  • More than 300 Max external objects and abstractions
  • More than 90 OpenGL objects included
  • More than 110 visual effect objects (Dfx library, Core Image Filters)
  • A utility library for the easy of programming (prefix Dlib)
  • A comprehensive set of sample patches, and a detailed tutorial
  • Handling images & movie files (QuickTime, OpenGL)
  • Render and move 3D models (OpenGL)
  • Video signal input (QuickTime, video texture)
  • Video input analysis: motion detect, face tracking (OpenCV, OpenGL)
  • Importing 3D models (.obj file)
  • Importing Quartz Composer files
  • OpenGL Shading Language (GLSL) programming interface
  • Easy integration of visual events using DIPSWindowMixer (OpenGL)


DIPS is a free plug-in software (a set of external objects) for Max/MSP. It supports the designing of the interaction between sound and visual events in Max using Apple’s Core Image, OpenGL and OpenCV technologies, and consequently, provides a powerful and user-friendly programming environment for the creation of interactive multimedia art.

DIPS can be used to detect a performer’s motions and to track positions of subtle details, such as the face, mouth, and eyes. It can also be used to measure the distance between objects and a Kinect sensor system, and offers powerful tools for realtime image processing of incoming video stream and stored movie files. In addition, it can be used to create complex images in a virtual three-dimensional space.

The DIPS consists of a library of more than 300 Max external objects and abstractions, a comprehensive set of sample patches, and a detailed tutorial. Some of its strong points, in comparison with other similar plug-ins and software, are its ease of programming, power, and efficiency.

The sample patches and tutorial contained in the installation package allows composers and artists who are interested in the creation of interactive art to realize sophisticated realtime video effects on a live video signal at their first practice. And because of its ease of programming, it is likely that one will soon acquire skills needed to create state-of-the-art interactive performance works, multimedia installations, interactive multimedia artworks, and Max VJ applications using DIPS.


Initially developed by Shu Matsuda in 1997, DIPS was a plug-in software for Max/FTS running on SGI Octane and O2 computers. Since 2000, it has been developed by the DIPS Development Group supervised by Takayuki Rai. Current active group members are Shu Matsuda, Yota Morimoto, Takuto Fukuda, and Keitaro Takahashi. Previously, Chikashi Miyama, Daichi Ando and Takayuki Hamano also contributed to its development.

  • 2013 DIPS5 for Max (Mac OS X)[1]
  • 2009 DIPS4 for Max/MSP (Mac OS X)
  • 2006 DIPS3 for Max/MSP (Mac OS X)[2]
  • 2003 DIPS2 for jMax4 (Mac OS X)[3]
  • 2002 DIPS for jMax2 (Mac OS X & Linux)[4]
  • 2000 DIPS for jMax (Linux)[5]


  1. ^ Rai, T., Matsuda, S., Morimoto, Y., Fukuda, T., Takahashi, K., "DIPS5 for Max -Digital Image Processing with sound, version 5", Proceedings, International Computer Music Conference, Perth, Australia, 2013
  2. ^ Rai, T., Miyama, C., Matsuda, S., Hamano, T., Morimoto, Y. "Introduction of DIPS3 (version 2) for Max/MSP", Proceedings Volume II, pp.176-179, International Computer Music Conference, Copenhagen, Denmark, 2007
  3. ^ Miyama, C., Rai, T., Matsuda, S., Ando, D. "Introduction of DIPS Programming Technique", Proceedings, pp. 459-462, International Computer Music Conference, Singapore, 2003
  4. ^ Matsuda, S., Miyama, C., Ando, D., Rai, T. "DIPS for Linux and Mac OS X", Proceedings, pp. 317-320, International Computer Music Conference, Gothenburg, Sweden, 2002
  5. ^ Rai, T., Matsuda, S. "DIPS: the real-time digital image processing objects for Max environment", Proceedings, pp. 284-287, International Computer Music Conference, Berlin, Germany, 2000

External links[edit]