Feature #15370

[arvados-dispatch-cloud] loopback driver

Added by Tom Clegg almost 2 years ago. Updated 14 days ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
Crunch
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

The loopback driver implements cloud.Driver by presenting a fake cloud in which
  • Instances() returns a single instance named "localhost"
  • Create() fails
  • Destroy() fails
  • Instance address points to an SSH server (brought up by the driver) that accepts the dispatcher's key and executes shell commands
Using the loopback driver will involve some special configuration.
  • InstanceTypes should be configured with a single instance type, with the host's RAM/CPU specs

When combined with #14922 this should make crunch-dispatch-local redundant.

This will also facilitate an arvados-dispatch-cloud integration test that uses the real crunch-run program instead of a stub. This might involve a few other changes, like a configurable location for lockfiles.

It's okay that this will be useless until #14922 is implemented, because it will also make #14922 easier to test.


Related issues

Related to Arvados - Feature #14922: [crunch-dispatch-cloud] Run multiple containers concurrently on a single VMNew

Related to Arvados - Story #13908: [Epic] Replace SLURM for cloud job scheduling/dispatchingResolved

History

#1 Updated by Tom Clegg almost 2 years ago

  • Related to Feature #14922: [crunch-dispatch-cloud] Run multiple containers concurrently on a single VM added

#2 Updated by Tom Clegg almost 2 years ago

  • Related to Story #13908: [Epic] Replace SLURM for cloud job scheduling/dispatching added

#3 Updated by Peter Amstutz 29 days ago

  • Target version changed from To Be Groomed to 2021-03-31 sprint

#4 Updated by Peter Amstutz 28 days ago

  • Target version changed from 2021-03-31 sprint to 2021-04-14 sprint

#5 Updated by Peter Amstutz 15 days ago

  • Description updated (diff)

#6 Updated by Peter Amstutz 14 days ago

  • Target version changed from 2021-04-14 sprint to 2021-05-26 sprint

Also available in: Atom PDF