Singularity (software)
This article, Singularity (software), has recently been created via the Articles for creation process. Please check to see if the reviewer has accidentally left this template after accepting the draft and take appropriate action as necessary.
Reviewer tools: Inform author |
- Comment: My feeling is this would pass an AfD with the provided refs. Looking for another opinion Legacypac (talk) 02:24, 28 May 2018 (UTC)
Original author(s) | Gregory Kurtzer (gmk), et al. |
---|---|
Developer(s) | Community Gregory Kurtzer |
Stable release | 2.4.5.[1]
/ March 19, 2018 |
Repository | github |
Written in | C, Go[2] |
Operating system | Linux |
Platform | x86-64 |
Type | Operating-system-level virtualization |
License | 3-clause BSD License[3] |
Website | singularity |
Singularity is a free, cross-platform and open-source computer program that performs operating-system-level virtualization also known as containerization[4].
One of the main uses of Singularity is to bring containers and reproducibility to scientific computing and the high-performance computing (HPC) world[5].
The need for reproducibility requires the ability to use containers to move applications from system to system[6].
Using Singularity containers, developers can work in reproducible environments of their choosing and design, and these complete environments can easily be copied and executed on other platforms[7].
History
Singularity began as an open-source project in 2015, when a team of researchers at Lawrence Berkeley National Laboratory, led by Gregory Kurtzer, developed the initial version and released it[8] under the BSD license[9].
By the end of 2016, many developers from different research facilities joined forces with the team at Lawrence Berkeley National Laboratory to further the development of Singularity[10]
Singularity quickly attracted the attention of computing-heavy scientific institutions worldwide[11]:
- Stanford University Research Computing Center deployed Singularity on their XStream [12][13] and Sherlock[14] clusters
- National Institutes of Health installed Singularity on Biowulf[15], their 95,000+ core/30 PB Linux cluster[16]
- various sites of the Open Science Grid Consortium including Fermilab started adopting Singularity[17]; by April 2017, Singularity was deployed on 60% of the Open Science Grid network[18].
For two years in a row, in 2016 and 2017, Singularity was recognized by HPCwire editors as "One of five new technologies to watch"[19][20]. In 2017 Singularity also won the first place for the category ″Best HPC Programming Tool or Technology″[21].
As of 2018, based on the data entered on a voluntary basis in a public registry, Singularity user base is estimated to be greater than 25,000 installations[22] and includes users at academic institutions such as Ohio State University, and Michigan State University, as well as top HPC centers like Texas Advanced Computing Center, San Diego Supercomputer Center, and Oak Ridge National Laboratory.
Features
Singularity is able to support natively high-performance interconnects, such as InfiniBand[23] and Intel Omni-Path Architecture (OPA)[24].
Similar to the support for InfiniBand and Intel OPA devices, Singularity can support any PCIe-attached device within the compute node, such as graphic accelerators[25].
Singularity has also native support for Open MPI by utilizing a hybrid MPI container approach where OpenMPI exists both inside and outside the container[26]
These features make Singularity increasingly useful in areas such as Machine learning, Deep learning and most data-intensive workloads where the applications benefit from the high bandwidth and low latency characteristics of these technologies[27].
Integration
HPC systems traditionally already have resource management and job scheduling systems in place, so the container runtime environments must be integrated into the existing system resource manager.
Using other enterprise container solutions like Docker in HPC systems would require modifications to the software[28].
Singularity seamlessly integrate with many resource managers[29] including:
See also
References
- ^ "Singularity Releases". singularity.lbl.gov. Singularity Team. 2018-03-19. Retrieved 2018-03-19.
- ^ "Singularity+GoLang".
- ^ "Singularity Licence". singularity.lbl.gov. Singularity Team. 2018-03-19. Retrieved 2018-03-19.
- ^ "Singularity presentation at FOSDEM 17".
- ^ Kurtzer, Gregory M; Sochat, Vanessa; Bauer, Michael W (2017). "Singularity: Scientific containers for mobility of compute". Plos. 12 (5): e0177459. doi:10.1371/journal.pone.0177459.
{{cite journal}}
: CS1 maint: unflagged free DOI (link) - ^ "Singularity, a container for HPC". admin-magazine.com. 2016-04-24.
- ^ "Singularity Manual: Mobility of Compute".
- ^ "Sylabs brings Singularity containers into commercial HPC".
- ^ "Singularity Licence". singularity.lbl.gov. Singularity Team. 2018-03-19. Retrieved 2018-03-19.
- ^ "Changes to the AUTHORS.md file in Singularity source code made in April 2017".
- ^ "Berkeley Lab's Open-Source Spinoff Serves Science". 2017-06-07.
- ^ "XStream online user manual, section on Singularity".
- ^ "XStream cluster overview".
- ^ "Sherlock Supercomputer: What's New, Containers and Deep Learning Tools".
- ^ "NIH HPC online user manual, section on Singularity".
- ^ "NIH HPC Systems".
- ^ "Singularity on the OSG".
- ^ "Singularity in CMS: Over a million containers served" (PDF).}
- ^ "HPCwire Reveals Winners of the 2016 Readers' and Editors' Choice Awards at SC16 Conference in Salt Lake City".
- ^ "HPCwire Reveals Winners of the 2017 Readers' and Editors' Choice Awards at SC17 Conference in Denver".
- ^ "HPCwire Reveals Winners of the 2017 Readers' and Editors' Choice Awards at SC17 Conference in Denver".
- ^ "Voluntary registry of Singularity installations".
- ^ "Intel Advanced Tutorial: HPC Containers & Singularity - Advanced Tutorial - Intel" (PDF).
- ^ "Intel Application Note: Building Containers for Intel® Omni-Path Fabrics using Docker* and Singularity" (PDF).
- ^ "Singularity Manual: A GPU example".
- ^ "Intel Advanced Tutorial: HPC Containers & Singularity - Advanced Tutorial - Intel" (PDF).
- ^ Tallent, Nathan R; Gawande, Nitin A; Siegel, Charles; Vishnu, Abhinav; Hoisie, Adolfy (2018). "Evaluating On-Node GPU Interconnects for Deep Learning Workloads". Plos. Lecture Notes in Computer Science. 10724: 3. doi:10.1007/978-3-319-72971-8_1. ISBN 978-3-319-72970-1.
- ^ Jonathan Sparks, Cray Inc. (2017). "HPC Containers in use" (PDF).
- ^ "Support on existing traditional HPC".
Further reading
- Proceedings of the 10th International Conference on Utility and Cloud Computing: Is Singularity-based Container Technology Ready for Running MPI Applications on HPC Clouds?
- Singularity prepares version 3.0, nears 1 million containers served daily
- Dell HPC: Containerizing HPC Applications with Singularity
- Intel HPC Developer Conference 2017: Introduction to High-Performance Computing HPC Containers and Singularity
- HPCwire Reveals Winners of the 2017 Readers’ and Editors’ Choice Awards at SC17 Conference in Denver: Singularity awarded for Best HPC Programming Tool or Technology category
External links
Category:Free software Category:Free software programmed in Go Category:Linux Containerization Category:Operating system security Category:Operating system technology Category:Software using the Apache license Category:Virtualization software Category:Virtualization-related software for Linux