Jump to content

Collective operation

Edit links
From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by Kvng (talk | contribs) at 14:50, 27 June 2015 (computing topic). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

A collective operation is a concept in parallel computing in which data is simultaneously sent to or received from many nodes.

Common examples of collective operations are gather (in which data is collected from all nodes), scatter (in which a set of data is broken up into pieces, and a different piece is sent to all nodes), and broadcast (in which the same data is sent to all nodes).

Parallel computing frameworks with collective operations

Collective operations are present in the following parallel programming frameworks:

References

  1. ^ Intercommunicator Collective Operations. The Message Passing Interface (MPI) standard, chapter 7.3.1. Mathematics and Computer Science Division, Argonne National Laboratory.
Stub icon

This computing article is a stub. You can help Wikipedia by expanding it.

Retrieved from "https://en.wikipedia.org/w/index.php?title=Collective_operation&oldid=668910586"