Crunch2 installation » History » Revision 2
« Previous |
Revision 2/18
(diff)
| Next »
Tom Clegg, 06/15/2016 09:16 PM
Crunch2 installation¶
(DRAFT -- when ready, this will move to doc.arvados.org→install)
- Table of contents
- Crunch2 installation
Set up a crunch-dispatch service¶
Currently, dispatching containers via SLURM is supported.
Install crunch-dispatch-slurm on a node that can submit SLURM jobs. This can be the slurm controller node, a worker node, or any other node that has the appropriate SLURM/munge configuration.
sudo apt-get install crunch-dispatch-slurm
Create a privileged token for use by the dispatcher. If you have multiple dispatch processes, you should give each one a different token.
apiserver:~$ cd /var/www/arvados-api/current
apiserver:/var/www/arvados-api/current$ sudo -u webserver-user RAILS_ENV=production bundle exec script/create_superuser_token.rb
zzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzz
Save the token on the dispatch node, in /etc/sv/env/ARVADOS_API_TOKEN
Example runit script:
#!/bin/sh
export ARVADOS_API_HOST=uuid_prefix.your.domain
exec chpst -e ./env -u crunch crunch-dispatch-slurm
Ensure the crunch
user exists -- and has the same UID, GID, and home directory -- on the dispatch node and all SLURM compute nodes. Ensure the crunch
user can run docker containers on SLURM compute nodes.
Install crunch-run on compute nodes¶
Configure kernel cgroup accounting on compute nodes¶
Configure docker¶
Test the dispatcher¶
Updated by Tom Clegg about 8 years ago · 2 revisions