Federation

In a federation, clusters cooperate with one another to enable distributed workflows that are coordinated by a remote client, without having to funnel data/code/notifications through the remote client.

Canonical example (draft!):
  • The user agent has a slow network connection to several clusters which, although they have reasonably fast network connections between them, must not have unrestricted access to one another's data.
  • The user must run an analysis A on Cluster A. The inputs to A are large datasets, and they are the outputs of analyses B and C, which must run on Cluster B and C respectively.
Subtopics and related features: