M-Labs (formerly known as the Milkymist project) is a company and community who develop, manufacture and sell advanced open hardware devices and solutions. It is best known for the Milkymist system-on-chip (SoC) which is among the first commercialized system-on-chip designs with free HDL source code.
M-Labs technologies have been reused in diverse applications. For example, NASA's Communication Navigation and Networking Reconfigurable Testbed (CoNNeCT) experiment uses the memory controller that was originally developed for the Milkymist One and published under the terms of the GNU General Public License (GPL).
The project was presented at several open source and hacker conferences such as the Chaos Communication Congress, FOSDEM, Libre Software Meeting, and Libre Graphics Meeting 2011. It was also featured on the Make magazine blog and the Milkymist One board was included in their "ultimate open source hardware gift guide 2010".
The Milkymist system-on-chip uses the LatticeMico32 (LM32) core as a general purpose processor. It is a RISC 32-bit big endian CPU with a memory management unit (MMU) developed later by M-Labs contributors. It is supported by the GCC compiler and can run RTEMS and μClinux. There is also an experimental back-end for LLVM targeting this microprocessor.
The LM32 microprocessor is assisted by a texture mapping unit and a programmable floating point VLIW coprocessor which are used by the Flickernoise video synthesis software. It is also surrounded by various peripheral cores to support every I/O device of the Milkymist One. The system-on-chip interconnect uses three bridged buses and mixes the Wishbone protocol with two custom protocols used for configuration registers and high performance DMA with the SDRAM.
The architecture of the Milkymist system-on-chip is largely documented in the project founder's Master thesis report. Most components of the system-on-chip, except the LatticeMico32 core, were custom developed and placed under the GNU GPL license.
Milkymist One and Flickernoise
|Release date||December 27, 2010(early developer kit), September 28, 2011 (final version)|
|Introductory price||380 EUR (early developer kit), 499 USD (final version)|
|Operating system||RTEMS, Linux|
|CPU||LatticeMico32 in a Xilinx Spartan-6 FPGA|
|Memory||128 MB DDR SDRAM|
|Storage||32 MB built-in NOR flash, memory card|
|Display||SVGA up to 140 MHz pixel clock (1280x1024)|
|Input||USB keyboard and mouse|
|Camera||External (CVBS digitizer)|
|Connectivity||DMX512, MIDI, OpenSoundControl, AC97 audio, Ethernet, RC-5 infrared, USB, GPIO|
|Dimensions||172 × 145 × 45 mm|
The Milkymist One video synthesizer and reconfigurable computer is the main product released by the project. It was manufactured by Qi Hardware, a start-up founded by former Openmoko employees. It was first sold at the Chaos Communication Congress in 2010, as an "early developer kit" for interested hackers, open source activists and pioneers who could stand the remaining software and FPGA design bugs. The hardware still came with a warranty against manufacturing defects.
The technical specifications of the Milkymist One are as follows:
- Multi-standard video input (PAL/SECAM/NTSC)
- Two DMX512 (RS485) ports
- MIDI IN and MIDI OUT ports
- SVGA output, 24 bpp, up to 140 MHz pixel clock (about 1280×1024)
- AC97 audio
- Xilinx XC6SLX45 Spartan-6 FPGA supporting the open source Milkymist SoC
- 128 MB 32-bit DDR333 SDRAM
- 32 MB parallel flash
- 10/100 Ethernet
- Memory card
- Two USB host connectors
- RC-5 compatible infrared receiver
- RS-232 debug port
Flickernoise is the video synthesis software that runs on the Milkymist One. It is heavily inspired by MilkDrop and uses a similar, and largely compatible, scripting language to define and program the visual effects. However, while MilkDrop is designed to run automatically in a music player, Flickernoise puts the accent on the interactivity of the visuals and live performance uses. The software supports the programming of visual effects that transform a live video stream coming from a camera connected to the Milkymist One, as well as input from OpenSoundControl, DMX512 and MIDI controllers.
Flickernoise runs on the RTEMS real-time operating system, and uses many POSIX software libraries that were ported to this operating system such as libpng, libjpeg, jbig2dec, OpenJPEG, FreeType, MuPDF and liblo for OpenSoundControl support. The streamlined hardware platform along with the use of a real-time operating system allows the system to have a lower response time than an equivalent PC-based setup. The user interface is based on a variant of the Genode FX toolkit.
In May 2014, M-Labs entered a partnership with NIST to develop a next-generation open source control system for quantum information experiments. The system, called ARTIQ (Advanced Real-Time Infrastructure for Quantum physics), is a combination of software and gateware that enables nanosecond-level timing control and sub-microsecond latency while retaining features of high level programming languages.
Some of the ideas and code from Milkymist SoC have been reused in ARTIQ.
- "The Register: Open-source hardware group puts out vid system-on-a-chip". Retrieved 2013-05-02.
- "JPL acknowledgement letter". Retrieved 2014-02-13.
- "Tech the Future: Open source hardware". Retrieved 2013-05-02.
- Bourdeauducq, Sebastien (June 2010). "A performance-driven SoC architecture for video synthesis". KTH. Retrieved 2011-04-22.
- "26C3 schedule". Retrieved 2011-04-22.
- "Milkymist : Pushing further the limits of electronics openness". Retrieved 2011-04-22.
- "Milkymist : a free System-on-Chip for real-time video". Retrieved 2011-04-22.
- "Milkymist One video synthesizer shown at 6th Libre Graphics Meeting in Montreal". Retrieved 2011-05-14.
- "Milkymist One Shown at Libre Graphics Meeting". Retrieved 2011-05-14.
- "Make: Online: Milkymist :: Interactive VJ Station". Retrieved 2011-04-22.
- "Make: Online: The Ultimate Open Source Hardware Gift Guide 2010". Retrieved 2011-04-22.
- "QEMU development mailing list". Retrieved 2011-04-22.
- "OpenMoko Layoffs Lead to New Open Hardware Venture". Retrieved 2011-04-22.
- "First Milkymist One Early Developer Kits are coming!". Retrieved 2011-04-22.
- "M-Labs official website: Milkymist One". Retrieved 2013-05-02.
- "NIST: Open-Source Software for Quantum Information". Retrieved 2015-01-25.
- "M-Labs official website: ARTIQ". Retrieved 2015-01-25.