European Middleware Initiative

From Wikipedia, the free encyclopedia
Jump to: navigation, search
EMI
EMI Logo.jpg
Developer(s) EMI Project, partially funded by EU grant RI-261611
Stable release 3.0 / 28 February 2013
Operating system Scientific Linux 5 64bit, Scientific Linux 6 64bit, Debian 6 64bit
Type Grid computing
License Multiple. Each product has its own. Most of them are Apache or BSD.
Website www.eu-emi.eu

The European Middleware Initiative (EMI) is a computer software platform for high performance distributed computing. It is developed and distributed directly by the EMI project.[1][2][3] It is the base for other grid middleware distributions used by scientific research communities and distributed computing infrastructures all over the world especially in Europe,[4] South America[5] and Asia.[6] EMI supports broad scientific experiments and initiatives, such as the Worldwide LHC Computing Grid (for the Large Hadron Collider).

The EMI middleware is a cooperation among three general purpose grid platforms, the Advanced Resource Connector, gLite and UNICORE and the dCache storage software.[7]

Purpose[edit]

The purpose of the EMI distribution is to consolidate, harmonize and support the original software platforms, evolve and extend them. Redundant or duplicate services resulting from the merging are deprecated, in favour of new services added to satisfy user requirements or specific consolidation needs, standardizing and developing common interfaces. These include the adoption of a common structure for accounting, resource information exchange or authentication and authorization.

Input for the development activities is taken from users, infrastructures projects, standardization initiatives or changing technological innovations. The software products will be adapted as necessary to comply with standard open source guidelines to facilitate the integration in mainstream operating system distributions.[8]

Collaborations[edit]

A cooperation with FutureGrid, a US distributed testbed for Clouds, Grids and high-performance computing, was announced in December 2011.[9]

In January 2012, the EMI project formalized a partnership with the iMarine project to create an open data e-infrastructure for fisheries management and marine conservation.[10][11]

Users[edit]

By 2008 the EMI software distribution provided most of the middleware components which support the execution and completion of the millions of computational jobs handled by the 350 centers of the European Grid Infrastructure and the tens of petabytes of data transfers occurring between the storage systems of those centers.[12][13]

EMI middleware was used in the WLCG infrastructure which supports, for example, the search for the Higgs boson (the God Particle)[14] and new types of matter searches of the physicists at LHC together with other research in astronomy, biology, computational chemistry and other sciences.[15]

License[edit]

There is no common EMI license though all licenses used by EMI are open source. Each product has a long history behind its own license. Most are Apache or BSD.[16]

dCache products are released under the dCache Software License[17] but they adopted the Affero General Public License license from 1 January 2012.

Products[edit]

The EMI products (components of the release) can be grouped in four categories (areas): computing, data, security and infrastructure.[18]

The first release[19] of the software is composed of 56 products packaged for Scientific Linux 5 (32, 64bit).

The second release[20] is also made of 56 products which are available for Scientific Linux 5 64bit and Scientific Linux 6 64bit. A subset of services is also available for Debian 6 64bit with more planned with the updates.

The third and final release[21] contains 61 products for the Scientific Linux 5 64bit (480 packages), Scientific Linux 6 64bit (474 packages) and Debian 6 (233 packages) Linux distributions. All components are supported on the Scientific Linux platforms while some are not on Debian.

Releases[edit]

EMI releases are of two types. Major releases include most if not all components and Component Releases which is related to a single product. A collection of components may be released as an update to a major release.[22]

Major releases[edit]

Major releases are delivered once per year. Three planned major releases were named after European mountains.

Release Name Release Date End of Full Support End of Standard Updates End of Security Updates and Support
1.0 Kebnekaise 2011-05-12 2012-04-30 2012-10-31 2013-04-30
2.0 Matterhorn 2012-05-21 2013-04-30 2013-10-31 2014-04-30
3.0 Monte Bianco 2013-02-28 2014-04-30 2014-10-31 2015-04-30

Full Support: updates are released to address issues in the code and new features are provided (lasts 12 months)

Standard Updates: updates are released to address issues in the code but no new features are provided (lasts 6 months)

Security Updates and Support: only updates targeting security vulnerabilities are provided (6 months)

As older versions of the EMI products are superseded by newer versions, an end-of-life announcement is made which coincides with the end of the security updates and support period.

As of May 2013, 24 updates were released for EMI 1 Kebnekaise,[23] 13 for EMI 2 Matterhorn[24] and 3 for EMI 3 Monte Bianco.[25]

Component releases[edit]

Minor Releases: contain interface or functional changes that are backwards-compatible with those of the current major release. They are issued a few times per year.

Revision Releases: available every week or two weeks. They contain only bug fixes.

Emergency Releases: contain only very specific bug fixes, typically security-related and are available as need, using emergency release procedures.

References[edit]

  1. ^ "Featured article: EMI, home to middleware". iSGTW. June 2010. Retrieved 22 December 2011. 
  2. ^ "Presentation of the European Middleware Initiative project". GridCast. 16 September 2010. Retrieved 22 December 2011. 
  3. ^ "European Middleware Initiative project presentation". GridCafè. 2010. Retrieved 22 December 2011. 
  4. ^ "The EGI Software Repository Portal". EGI. Retrieved 22 December 2011. 
  5. ^ "Iniciativa de Grid de America Latina-Caribe. Resource Center Reference". IGALC. Retrieved 25 December 2011. 
  6. ^ "Taiwan Grid Portal". TWGrid. Retrieved 26 December 2011. 
  7. ^ "EMI web site home page". EMI. Retrieved 22 December 2011. 
  8. ^ "EMI software releases introduction". EMI. Retrieved 22 December 2011. 
  9. ^ "EMI collaboration announcement. FutureGrid Portal". FutureGrid. Retrieved 26 December 2011. 
  10. ^ "iMarine collaboration announcement on CORDIS portal". CORDIS. Retrieved 14 February 2012. 
  11. ^ "iMarine collaboration announcement on iSGTW". iSGTW. Retrieved 14 February 2012. 
  12. ^ Vetterli, M. (2 July 2008). "ATLAS Computing: Dealing with Petabytes of Data per Year". High Performance Computing Systems and Applications, 2008. HPCS 2008. IEEE. p. 84. ISBN 978-0-7695-3250-9. ISSN 1550-5243. Retrieved 23 December 2011. 
  13. ^ Jacqui Hayes (21 December 2011). "Happy 10th Birthday, WLCG!". isgtw. Retrieved 23 December 2011. 
  14. ^ Leslie Versweyveld (13 September 2010). "WLCG working hard to make the Higgs particle theory come true". PRIMEUR. Retrieved 23 December 2011. 
  15. ^ "EMI services used in neuro-scientific grand challenge". isgtw. 3 October 2011. Retrieved 23 December 2011. 
  16. ^ "EMI DNA2.4.2, Exploitation and Sustainability Plan, EU Deliverable: D2.4.2" (PDF). EMI. 30 April 2011. p. 13. Retrieved 22 December 2011. 
  17. ^ "dCache Software License". dCache. Retrieved 22 December 2011. 
  18. ^ "EMI Software products categories". EMI. Retrieved 22 December 2011. 
  19. ^ "1st EMI Release (Kebnekaise)". EMI. Retrieved 22 May 2012. 
  20. ^ "2nd EMI Release (Matterhorn)". EMI. Retrieved 22 May 2012. 
  21. ^ "3rd EMI Release (Monte Bianco)". EMI. Retrieved 13 May 2013. 
  22. ^ "EMI Software Releases". EMI. Retrieved 22 December 2011. 
  23. ^ "Updates for the 1st EMI Release (Kebnekaise)". EMI. Retrieved 13 May 2013. 
  24. ^ "Updates for the 2nd EMI Release (Matterhorn)". EMI. Retrieved 13 May 2013. 
  25. ^ "Updates for the 3rd EMI Release (Monte Bianco)". EMI. Retrieved 13 May 2013. 

External links[edit]