Feature #13611
closed
Nodemanager reads instance sizes from the system config file to avoid duplication
Added by Lucas Di Pentima over 6 years ago.
Updated over 3 years ago.
Description
Both crunch-dispatch-slurm and nodemanager need to a list of configured node sizes. Currently, this information is duplicated in both the nodemanager config file as the master arvados config.yml. To eliminate duplication nodemanager should read the node size configurations, and possibly the rest of its configuration, from the master arvados config.yml.
- Description updated (diff)
- As described on https://dev.arvados.org/projects/arvados/wiki/Cluster_configuration, ProviderType attribute would be the same as the newly implemented instance_type on nodemanager. I think neither GoSDK nor dispatchcloud need to know about it, at least for now as the only user would be nodemanager.
- Reading nodemanager’s cloud sizes from config.yml seems to be pretty straightforward.
- Should we add a section about nodemanager’s specific configs on this story or leave that for another?
- Cloud settings & credentials.
- Daemon values (max nodes, poll time, dispatcher, etc).
- Logging levels.
- If going the hybrid path of having nodemanager’s config temporarily spread in 2 configuration files, should we ignore arvados-node-manager.ini’s cloud sizes?
- Update nodemanager docs, possibly adding a migration guide.
- Related to Idea #13569: Add units tera / giga / mega / kilo for configurations added
- Related to Idea #13648: [Epic] Use one cluster configuration file for all components added
- Related to Bug #13674: [crunch-dispatch-slurm] Use hash instead of array for InstanceTypes config added
- Related to deleted (Bug #13674: [crunch-dispatch-slurm] Use hash instead of array for InstanceTypes config)
- Blocked by Bug #13674: [crunch-dispatch-slurm] Use hash instead of array for InstanceTypes config added
- Target version changed from To Be Groomed to Arvados Future Sprints
- Blocked by Idea #13731: Design new nodemanager config data organization for cluster-wide config added
- Status changed from New to Closed
- Target version deleted (
Arvados Future Sprints)
Also available in: Atom
PDF
Updated by 
Updated by 
Updated by Tom Morris 
Updated by 
Updated by