Advanced Resource Connector: Difference between revisions

From Wikipedia, the free encyclopedia
Browse history interactively
← Previous editNext edit →
Content deleted Content added
VisualWikitext
Release number updated
m fix wrong doi
Line 92: Line 92:
*{{cite journal|last=Qiang|first=Weizhong|coauthors=Konstantinov, Aleksandr|date=June 2009|title=Towards cross-middleware authentication and single sign-on for ARC Grid middleware|journal=Computer Science - Research and Development|publisher=Springer|volume=23|issue=3-4|pages=267–274|doi=10.1007/s00450-009-0084-6}}
*{{cite journal|last=Qiang|first=Weizhong|coauthors=Konstantinov, Aleksandr|date=June 2009|title=Towards cross-middleware authentication and single sign-on for ARC Grid middleware|journal=Computer Science - Research and Development|publisher=Springer|volume=23|issue=3-4|pages=267–274|doi=10.1007/s00450-009-0084-6}}
*{{cite journal|last=Anderlik|first=Csaba|coauthors=Gregersen, Anders Rhod; Kleist, Josva; Peters, Anders; Saiz, Pablo|date=2008|title=ALICE-ARC Integration|journal=Journal of Physics: Conference Series|publisher=IOP Publishing|volume=119|issue=062006|pages=6pp|doi=10.1088/1742-6596/119/6/062006}}
*{{cite journal|last=Anderlik|first=Csaba|coauthors=Gregersen, Anders Rhod; Kleist, Josva; Peters, Anders; Saiz, Pablo|date=2008|title=ALICE-ARC Integration|journal=Journal of Physics: Conference Series|publisher=IOP Publishing|volume=119|issue=062006|pages=6pp|doi=10.1088/1742-6596/119/6/062006}}
*{{cite journal|last=Jensen|first=Henrik Thostrup|coauthors=Kleist, Josva; Leth, Jesper Ryge|date=2005|title=A Framework for Job Management in the NorduGrid ARC Middleware|journal=Lecture Notes in Computer Science|publisher=Springer|location=Berlin/Heidelberg|volume=3470|pages=861–871|doi=10.1007/11508380|doi_brokendate=2010-01-05}}
*{{cite journal|last=Jensen|first=Henrik Thostrup|coauthors=Kleist, Josva; Leth, Jesper Ryge|date=2005|title=A Framework for Job Management in the NorduGrid ARC Middleware|journal=Lecture Notes in Computer Science|publisher=Springer|location=Berlin/Heidelberg|volume=3470|pages=861–871|doi=10.1007/11508380_88}}


== Related projects ==
== Related projects ==

Revision as of 19:47, 23 October 2010

ARC
Developer(s)NorduGrid, KnowARC and NDGF
Stable release
0.8.2.2 / 14 June 2010
Preview release
Nox 1.1.0 / 5 May 2010
Operating systemLinux (Nox also on Microsoft Windows, Mac OS X, Solaris)
TypeGrid computing
LicenseApache License
Websitehttp://www.nordugrid.org/

Advanced Resource Connector, or ARC, is a Grid middleware introduced by NorduGrid. ARC is an open source software distributed under the Apache License. It enables production quality computational and data Grids[1].

History

ARC appeared (and is still often referred to) as the NorduGrid middleware, originally proposed as an architecture on top of the Globus Toolkit[2] optimized for the needs of High-Energy Physics computing for the Large Hadron Collider experiments[3]. First deployment of ARC at the NorduGrid testbed took place in summer 2002, and by 2003 it was used to support complex computational challenges[4].

The first stable release of ARC (version 0.4) came out in April 2004[5], under the GNU General Public License. The name "Advanced Resource Connector" was introduced for this release in order to distinguish the middleware from the infrastructure. Same year, the Swedish national Grid project Swegrid became the first large cross-discipline infrastructure to be based on ARC[6].

In 2005, NorduGrid was formally established as a collaboration aiming to support and coordinate ARC development[7]. This paved the way for more investment into ARC development, and in 2006 two closely related projects were launched: the Nordic Data Grid Facility, deploying a pan-Nordic e-Science infrastructure based on ARC, and KnowARC, focused on transforming ARC into a next generation Grid middleware.

ARC v0.6 was released in May 2007[8], becoming the second stable release. Its key feature was introduction of the client library enabling easy development of higher-level applcations. It was also the first ARC release making use of open standards, as it included support for JSDL. Later this year, the first technology preview of the next generation ARC middleware was made available[9].

In 2008, NorduGrid consortium took decision to switch to the Apache License for ARC.

Key middleware components

  • Hosting environment:
  • Computing services:
    • Grid Manager - server providing computing capability
    • A-REX - next generation of Grid Manager, WS-based
  • Storage services:
    • Classic Storage Element - a simple GridFTP-based disk storage
    • Chelonia - a lightweight distributed storage solution
    • Hopi - a basic HTTP storage front-end
  • Information services:
    • Classic information server - local service information publishing
    • Classic information index - distributed information indexing
    • ALIS - local service information publishing, WS-based
    • ISIS - distributed information indexing, WS-based
  • Accounting:
    • JURA - job record publisher for A-REX
  • Security:
    • Charon - authorization and policy decision service
  • Software management:
    • Janitor - provisioning of dynamic runtime environments
  • Clients:
    • ng* job and data CLI - command-line interface for job and data management
    • arc* job and data CLI - next generation command-line interface for job and data management, interoperable with other middlewares like gLite and UNICORE
    • arcproxy - universal Grid proxy generation utility
    • Grid Monitor - graphical interface to the classic information services
  • Libraries and API:
    • libarcclient - job management and information
    • libarcdata2 - data management
    • HED security API

ARC middleware availability

ARC is a free software available from the NorduGrid public repository, both as binary packages for a variety of Linux systems and source. Source code is also available from the NorduGrid SVN repository. Write access to this repository can be granted to developers willing to contribute, following an application.

Development

The open source development of the ARC middleware is coordinated by the NorduGrid collaboration. Contributions to the software, documentation and dissemination activities are coming from the community and from various projects, such as the EU KnowARC project, NDGF and various national Grid projects.

Standards and interoperability

ARC development follows latest Open Grid Forum standardization guidelines. In particular, ARC already implements JSDL, and through the KnowARC project activities it will be transformed into a service-based solution, conformant with other specifications, such as Glue2, BES, UR/RUS etc..

KnowARC project

Grid-enabled Know-how Sharing Technology Based on ARC Services and Open Standards(KnowARC) is a Sixth Framework Programme Specific Targeted Research Project, funded under Priority IST-2005-2.5.4 "Advanced Grid Technologies, Systems and Services" from June 2006 to November 2009[10][11]. It was initiated by the NorduGrid and brought together 11 participants from 8 European countries[12]. As stems from the title, the goal of the project has been defined as transforming ARC into a new technology based on open community standards, and the key objectives were broadly defined as[13]:

  • creation of a novel, powerful Next Generation Grid middleware based on ARC;
  • promotion Grid standardization and interoperability;
  • contributing to the take-up of Grid technologies.

KnowARC has been the main group developing the ARC software since the project began in 2006. Apart from its main aim of hardening and further developing ARC[14] it has contributed to the development of standards[15], and is increasing Grid and ARC usage in areas such as medicine and bioinformatics [16][17].

KnowARC introduced a large range of ARC components, including: HED, A-REX, Chelonia, Hopi, ALIS, ISIS, JURA, Charon, Janitor, arc* CLI, arcproxy, libarcclient, libarcdata2 and HED security API.

In July 2009, KnowARC announced it had contributed to the integration of Grid technologies into official Linux repositories by adding Globus Toolkit components into Fedora and Debian repositories[18].

References

  1. ^ Ellert, Mattias (2007). "Advanced Resource Connector middleware for lightweight computational Grids". Future Generation Computer Systems. 23: 219–240. doi:10.1016/j.future.2006.05.008. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help); Unknown parameter |month= ignored (help)
  2. ^ Ellert, Mattias (2003). "The NorduGrid project: using Globus toolkit for building GRID infrastructure". Nuclear Instruments and Methods in Physics Research A. 502 (2–3). Elsevier Science B.V.: 407–410. doi:10.1016/S0168-9002(03)00453-4. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  3. ^ Wäänänen, Anders (2002). "An Overview of an Architecture Proposal for a High Energy Physics Grid". Lecture Notes in Computer Science. 2367. Springer: 76–86. doi:10.1007/3-540-48051-X. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  4. ^ Eerola, Paula (2003). "Atlas Data-Challenge 1 on NorduGrid". Proceedings of 2003 Conference for Computing in High Energy and Nuclear Physics. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  5. ^ ARC 0.4 Release Notes
  6. ^ "SweGrid gets set for future challenges". International Journal of High-Energy Physics - CERN Courier. IOP Publishing. 2004. ISSN 0304-288X.
  7. ^ NorduGrid Web site
  8. ^ ARC 0.6 Release Notes
  9. ^ KnowARC report D5.1-2_07
  10. ^ KnowARC fact-sheet, EU IST database
  11. ^ Hämmerle, Hannelore (November 2006). "KnowARC project gets going". International Journal of High-Energy Physics - CERN Courier. 46 (11). Geneva, Switzerland: IOP Publishing: 12. ISSN 0304-288X. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  12. ^ KnowARC partners list
  13. ^ KnowARC Web site
  14. ^ Smirnova, Oxana (2009). "ARC middleware:evolution towards standards-based interoperability". To appear in Proceedings of the 17th International Conference on Computing in High Energy and Nuclear Physics. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  15. ^ Field, Laurence (2008). "Grid Information System Interoperability: The Need For A Common Information Model". Proceedings of the IEEE Fourth International Conference on eScience: 501–507. doi:10.1109/eScience.2008.159. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  16. ^ Zhou, Xin (2009). "An Easy Setup for Parallel Medical Image Processing: Using Taverna and ARC". Studies in Health Technology and Informatics. 147. IOS Press: 41–50. doi:10.3233/978-1-60750-027-8-41. PMID 19593043. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  17. ^ Krabbenhöft, Hajo (2008). "Integrating ARC grid middleware with Taverna workflows". Bioinformatics. 24 (9). Oxford University Press: 1221–1222. doi:10.1093/bioinformatics/btn095. PMID 18353787. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  18. ^ "KnowARC Project Brings Grids to Debian". HPC Wire. July 9, 2009.

More reading

  • Qiang, Weizhong (June 2009). "Towards cross-middleware authentication and single sign-on for ARC Grid middleware". Computer Science - Research and Development. 23 (3–4). Springer: 267–274. doi:10.1007/s00450-009-0084-6. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  • Anderlik, Csaba (2008). "ALICE-ARC Integration". Journal of Physics: Conference Series. 119 (062006). IOP Publishing: 6pp. doi:10.1088/1742-6596/119/6/062006. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)
  • Jensen, Henrik Thostrup (2005). "A Framework for Job Management in the NorduGrid ARC Middleware". Lecture Notes in Computer Science. 3470. Berlin/Heidelberg: Springer: 861–871. doi:10.1007/11508380_88. {{cite journal}}: Unknown parameter |coauthors= ignored (|author= suggested) (help)

Related projects

A number of projects and initiatives contribute to development or make use of ARC middleware, such as:

External links

Retrieved from "https://en.wikipedia.org/w/index.php?title=Advanced_Resource_Connector&oldid=392461515"