The MareNostrum 4 supercomputer (2017)
|Location||Barcelona Supercomputing Center|
|Architecture||Main cluster Intel Xeon Platinum based and three small clusters of emerging technologies|
|Operating system||SUSE Linux|
|Ranking||TOP500: 13, June 2017|
MareNostrum (Catalan: [ˌmaɾəˈnɔstɾum], Spanish: [ˌmaɾeˈnostɾun]) is the name of the main supercomputer in the Barcelona Supercomputing Center (BSC). It is the most powerful supercomputer in Spain, one of thirteen supercomputers in the Spanish Supercomputing Network and one of the seven supercomputers of the European infrastructure PRACE (Partnership for Advanced Computing in Europe).
The supercomputer is used in human genome research, protein research, astrophysical simulations, weather forecasting, geological or geophysical modeling, and the design of new drugs. It was booted up for the first time on 12 April 2005, and is available to the national and international scientific community.
Mare Nostrum ("our sea") was the Roman name for the Mediterranean Sea. The supercomputer is housed in the deconsecrated Chapel Torre Girona at the Polytechnic University of Catalonia, Barcelona, Spain.
- MareNostrum 4
MareNostrum 4 has been dubbed the most diverse and likely the most interesting supercomputer in the world thanks to the heterogeneity of the architecture it will include once installation of the supercomputer is complete. Its total speed will be 13.7 petaflops. It has five storage racks with the capacity to store 14 petabytes (14 million gigabytes) of data. A high-speed Omnipath network connects all the components in the supercomputer to one another.
The supercomputer includes two separate parts: a general-purpose block and a block featuring emerging technologies.
The general-purpose block has 48 racks with 3,456 Lenovo ThinkSystem SD530 compute nodes. Each node has two Intel Xeon Platinum chips, each with 24 processors, amounting to a total of 165,888 processors and a main memory of 390 terabytes. Its peak performance is 11.15 petaflops. While its performance is 10 times greater than its predecessor, MareNostrum 3, its power will only increase by 30% to 1.3 MW.
The block of emerging technologies is formed of clusters of three different technologies, which will be incorporated and updated as they become available on the market. These technologies are currently being developed in the United States and Japan to speed up the arrival of the new generation of pre-exascale supercomputers. They are as follows:
- Cluster comprising IBM POWER9 and NVIDIA Volta GPUs, with a computational capacity of over 1.5 petaflops. IBM and NVIDIA will use these processors for the Summit and Sierra supercomputers that the US Department of Energy has ordered for its Oak Ridge and Lawrence Livermore National Laboratories.
- Cluster formed of Intel Knights Hill (KNH) processors, with a computational capacity of over 0.5 petaflops. These are the same processors as those to be used in the Theta and Aurora supercomputers that the US Department of Energy has ordered for the Argonne National Laboratory.
- Cluster composed of 64-bit ARMv8 processors in a prototype machine with a computational capacity of over 0.5 petaflops. This cluster will use the cutting-edge technology of the Japanese supercomputer Post-K.
The aim of gradually incorporating these emerging technologies into MareNostrum 4 is to allow BSC to experiment with what are expected to be the most advanced technological developments over the next few years and evaluate their suitability for future iterations of MareNostrum.
MareNostrum 4 has a disk storage capacity of 14 petabytes and is connected to BSC’s big data facilities, which have a total capacity of 24.6 petabytes. Like its predecessors, MareNostrum 4 will also be connected to European research centres and European universities via the RedIris and Géant networks.
- MareNostrum 3
The previous version, MareNostrum 3, consisted of 3,056 IBM DataPlex DX360M4 compute nodes, for a total of 48,896 physical Intel Sandy Bridge cores running at 2.6 GHz, and 84 Xeon Phi 5110P in 42 nodes. MareNostrum 3 had 36 racks dedicated to calculations. In total, each rack had 1,344 cores and 2,688 GB of memory. Each IBM iDataPlex Compute rack was composed of 84 IBM iDataPlex dx360 M4 compute nodes and four Mellanox 36-port Managed FDR10 IB Switches. dx360 M4 compute nodes were grouped into a 2U Chassis, having two columns of 42 2U chassis.
The computing nodes of MareNostrum 3 communicate primarily through a high bandwidth, low latency InfiniBand FDR10 network. The different nodes were interconnected via fibre optic cables and Mellanox 648-port FDR10 Infiniband Core Switches. In addition, there was a more traditional local area network consisting of Gigabit Ethernet adapters.
- IBM BladeCenter and POWER Microprocessor Fuel Europe's Most Powerful Supercomputer IBM press release, 5 November 2004
- BLDG|BLOG, War/Photography: An Interview with Simon Norfolk
- MareNostrum 4 begins operation MareNostrum 4 Launch on BSC website, 29 June 2017
- / Barcelona Plans the most divers supercomputer, PCMag, March 2017]
- Johnson, Rob (23 October 2017). "BSC Builds 21st Century HPC In A 19th Century Cathedral". The Next Platform. Retrieved 30 October 2017.
- "Chapel Torre Girona". BSC-CNS. Barcelona Supercomputing Center. Retrieved 30 October 2017.
- / MareNostrum 4 begins operation , HC Wire, July 2017]
- "MareNostrum - iDataPlex DX360M4, Xeon E5-2670 8C 2.600GHz, Infiniband FDR | TOP500 Supercomputer Sites". www.top500.org. Retrieved 2016-10-08.
- "MareNostrum-Computer Racks"
- "MareNostrum-Infiniband racks"
|Wikimedia Commons has media related to MareNostrum.|
- IBM's MareNostrum page
- Barcelona Supercomputing Center
- Top 500 supercomputers
- IBM's MareNostrum page
- Slashdot: Building The MareNostrum COTS Supercomputer
- MoDEL Database
- MareNostrum III User's guide
- MareNostrum IV User's guide