Bug #10898: [Documentation] we should not use github.com copy of arvados in the tutorial - Arvados

Actions

Copy link

Bug #10898

closed

[Documentation] we should not use github.com copy of arvados in the tutorial

Added by Nico César over 7 years ago. Updated almost 2 years ago.

Status:

Resolved

Priority:

Low

Assigned To:

Category:

Target version:

Story points:

Description

in http://doc.arvados.org/user/cwl/cwl-runner.html there should be options for slow connections (i.e. China's data centers)

nico@shell:~$ time git clone https://github.com/curoverse/arvados
Cloning into 'arvados'...
remote: Counting objects: 98828, done.
remote: Compressing objects: 100% (236/236), done.
remote: Total 98828 (delta 133), reused 2 (delta 2), pack-reused 98579
Receiving objects: 100% (98828/98828), 25.32 MiB | 29.00 KiB/s, done.
Resolving deltas: 100% (69869/69869), done.
Checking connectivity... done.

real    13m37.378s
user    0m3.540s
sys     0m1.084s

Coparing this to my laptop from Boston:

$ time git clone https://github.com/curoverse/arvados                
Cloning into 'arvados'...
remote: Counting objects: 98828, done.
remote: Compressing objects: 100% (236/236), done.
remote: Total 98828 (delta 133), reused 2 (delta 2), pack-reused 98579
Receiving objects: 100% (98828/98828), 25.32 MiB | 10.97 MiB/s, done.
Resolving deltas: 100% (69869/69869), done.
Checking connectivity... done.

real    0m3.848s
user    0m2.872s
sys     0m0.956s

So the options here are:

git clone from the arvados repo via https¶

nico@shell:~$ HISTIGNORE=$HISTIGNORE:'export ARVADOS_API_TOKEN=*'
nico@shell:~$ export ARVADOS_API_TOKEN=XXXXXX
nico@shell:~$ export ARVADOS_API_HOST=zzzzz.arvadosapi.com
nico@shell:~$ unset ARVADOS_API_HOST_INSECURE
nico@shell:~$ time git clone https://git.zzzzz.arvadosapi.com/arvados.git
Cloning into 'arvados'...
remote: Counting objects: 98832, done.
remote: Compressing objects: 100% (24017/24017), done.
remote: Total 98832 (delta 69914), reused 98689 (delta 69818)
Receiving objects: 100% (98832/98832), 25.28 MiB | 26.63 MiB/s, done.
Resolving deltas: 100% (69914/69914), done.
Checking connectivity... done.

real    0m3.509s
user    0m3.016s
sys     0m0.704s

git clone from the arvados repo via git¶

nico@shell:~$ ssh-keygen
Generating public/private rsa key pair.
(..)
nico@shell:~$ cat /home/nico/.ssh/id_rsa.pub
ssh-rsa AAAAB3N.... nico@shell.zzzzz.arvadosapi.com

(and copied that to my SSH keys )

nico@shell:~$ time git clone https://git.zzzzz.arvadosapi.com/arvados.git
Cloning into 'arvados'...
remote: Counting objects: 98832, done.
remote: Compressing objects: 100% (24017/24017), done.
remote: Total 98832 (delta 69914), reused 98689 (delta 69818)
Receiving objects: 100% (98832/98832), 25.28 MiB | 25.97 MiB/s, done.
Resolving deltas: 100% (69914/69914), done.
Checking connectivity... done.

real    0m3.529s
user    0m3.060s
sys     0m0.688s

Actions

Copy link

Updated by Tom Morris over 6 years ago

Target version set to Arvados Future Sprints

Actions

Copy link

Updated by Tom Morris about 5 years ago

Priority changed from Normal to Low

I'm not sure we want to optimize for the case where people don't have reasonable connectivity to Github, but if we don't want to be maintaining multiple copies of the tutorials, so we'd need a way to update local cluster-based versions.

Actions

Copy link