Story #14796

[crunch-dispatch-cloud] Document installation / migration from c-d-slurm + node manager

Added by Tom Clegg 9 months ago. Updated 7 months ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
Deployment
Target version:
Start date:
01/29/2019
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Story points:
1.0
Release relationship:
Auto

14796-preview.png (250 KB) 14796-preview.png Tom Clegg, 04/03/2019 08:29 PM

Subtasks

Task #14898: Review 14796-dispatchcloud-install-docsResolvedTom Clegg


Related issues

Blocks Arvados - Story #13908: [Epic] Replace SLURM for cloud job scheduling/dispatchingNew

Follows Arvados - Feature #14325: [crunch-dispatch-cloud] Dispatch containers to cloud VMs directly, without slurm or nodemanagerResolved01/28/2019

Associated revisions

Revision cae02ce8
Added by Tom Clegg 7 months ago

Merge branch '14796-dispatchcloud-install-docs'

refs #14796

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <>

History

#1 Updated by Tom Clegg 9 months ago

  • Blocks Story #13908: [Epic] Replace SLURM for cloud job scheduling/dispatching added

#2 Updated by Tom Clegg 9 months ago

  • Due date set to 01/29/2019
  • Start date set to 01/29/2019
  • Follows Feature #14325: [crunch-dispatch-cloud] Dispatch containers to cloud VMs directly, without slurm or nodemanager added

#3 Updated by Tom Clegg 9 months ago

  • Target version set to 2019-02-13 Sprint
  • Story points set to 1.0

#4 Updated by Tom Clegg 8 months ago

  • Status changed from New to In Progress

#5 Updated by Tom Clegg 8 months ago

  • Description updated (diff)

#6 Updated by Tom Clegg 8 months ago

  • Target version changed from 2019-02-13 Sprint to 2019-02-27 Sprint

#7 Updated by Tom Morris 8 months ago

  • Target version changed from 2019-02-27 Sprint to 2019-03-13 Sprint

#8 Updated by Tom Morris 8 months ago

  • Release set to 15

#9 Updated by Tom Clegg 7 months ago

  • Target version changed from 2019-03-13 Sprint to 2019-03-27 Sprint

#10 Updated by Tom Clegg 7 months ago

  • Target version changed from 2019-03-27 Sprint to 2019-04-10 Sprint

#11 Updated by Tom Clegg 7 months ago

14796-dispatchcloud-install-docs @ effeb16e5b9a05edd53c2ff99834be266d8ce912

Copies install/migration info from Migrating from arvados-node-manager to arvados-dispatch-cloud wiki, and refers to default config file in source tree for further info about config (will need to update link when #13996 is merged).

#12 Updated by Nico César 7 months ago

I reviewed the documentation and looks ok to me.

we'll have to puppetize this, should we start with c97qk to start playing around and finding out how to do it in puppet ?

#13 Updated by Ward Vandewege 7 months ago

Nico César wrote:

I reviewed the documentation and looks ok to me.

we'll have to puppetize this, should we start with c97qk to start playing around and finding out how to do it in puppet ?

It is already mostly puppetized, I did that when I enabled it on c97qk. The loose ends are the disabling/removing of c-d-s and a-n-m. I don't want to do that yet until we retire a-n-m (and stop using c-d-s in the cloud), we may want to switch back and forth a bit in the mean time...

Things missing from this doc:

  • SystemRootToken and Services/Contoller/ExternalURL dependencies in config.yml
  • Only the Azure driver is documented, need to add the EC2 driver

#14 Updated by Tom Clegg 7 months ago

added example EC2 config

14796-dispatchcloud-install-docs @ c43a02955183854a3fcf542cd4def33243e4063b

#16 Updated by Tom Clegg 7 months ago

  • Status changed from In Progress to Resolved

Also available in: Atom PDF