Bug #10898

[Documentation] we should not use github.com copy of arvados in the tutorial

Added by Nico C├ęsar about 2 years ago. Updated 20 days ago.

Status:
New
Priority:
Low
Assigned To:
-
Category:
-
Target version:
Start date:
01/17/2017
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

in http://doc.arvados.org/user/cwl/cwl-runner.html there should be options for slow connections (i.e. China's data centers)

nico@shell:~$ time git clone https://github.com/curoverse/arvados
Cloning into 'arvados'...
remote: Counting objects: 98828, done.
remote: Compressing objects: 100% (236/236), done.
remote: Total 98828 (delta 133), reused 2 (delta 2), pack-reused 98579
Receiving objects: 100% (98828/98828), 25.32 MiB | 29.00 KiB/s, done.
Resolving deltas: 100% (69869/69869), done.
Checking connectivity... done.

real    13m37.378s
user    0m3.540s
sys     0m1.084s

Coparing this to my laptop from Boston:

$ time git clone https://github.com/curoverse/arvados                
Cloning into 'arvados'...
remote: Counting objects: 98828, done.
remote: Compressing objects: 100% (236/236), done.
remote: Total 98828 (delta 133), reused 2 (delta 2), pack-reused 98579
Receiving objects: 100% (98828/98828), 25.32 MiB | 10.97 MiB/s, done.
Resolving deltas: 100% (69869/69869), done.
Checking connectivity... done.

real    0m3.848s
user    0m2.872s
sys     0m0.956s

So the options here are:

git clone from the arvados repo via https

nico@shell:~$ HISTIGNORE=$HISTIGNORE:'export ARVADOS_API_TOKEN=*'
nico@shell:~$ export ARVADOS_API_TOKEN=XXXXXX
nico@shell:~$ export ARVADOS_API_HOST=zzzzz.arvadosapi.com
nico@shell:~$ unset ARVADOS_API_HOST_INSECURE
nico@shell:~$ time git clone https://git.zzzzz.arvadosapi.com/arvados.git
Cloning into 'arvados'...
remote: Counting objects: 98832, done.
remote: Compressing objects: 100% (24017/24017), done.
remote: Total 98832 (delta 69914), reused 98689 (delta 69818)
Receiving objects: 100% (98832/98832), 25.28 MiB | 26.63 MiB/s, done.
Resolving deltas: 100% (69914/69914), done.
Checking connectivity... done.

real    0m3.509s
user    0m3.016s
sys     0m0.704s

git clone from the arvados repo via git

nico@shell:~$ ssh-keygen
Generating public/private rsa key pair.
(..)
nico@shell:~$ cat /home/nico/.ssh/id_rsa.pub
ssh-rsa AAAAB3N.... nico@shell.zzzzz.arvadosapi.com

(and copied that to my SSH keys )
nico@shell:~$ time git clone https://git.zzzzz.arvadosapi.com/arvados.git
Cloning into 'arvados'...
remote: Counting objects: 98832, done.
remote: Compressing objects: 100% (24017/24017), done.
remote: Total 98832 (delta 69914), reused 98689 (delta 69818)
Receiving objects: 100% (98832/98832), 25.28 MiB | 25.97 MiB/s, done.
Resolving deltas: 100% (69914/69914), done.
Checking connectivity... done.

real    0m3.529s
user    0m3.060s
sys     0m0.688s

History

#1 Updated by Tom Morris over 1 year ago

  • Target version set to Arvados Future Sprints

#2 Updated by Tom Morris 20 days ago

  • Priority changed from Normal to Low

I'm not sure we want to optimize for the case where people don't have reasonable connectivity to Github, but if we don't want to be maintaining multiple copies of the tutorials, so we'd need a way to update local cluster-based versions.

Also available in: Atom PDF