[SDK] arv-put does not resume upload
I started an upload from my local machine to a remote keep store by issuing an 'arv-put' and killed it after it reported 192M uploaded. Resuming after the kill had the file upload restart from the beginning.
This was after a fresh 'sudo pip install --upgrade arvados-python-client'.
$ ls -lah tile_md5sum_hu154_sort.csv.gz -rw-r--r-- 1 abram abram 961M Jul 29 12:25 tile_md5sum_hu154_sort.csv.gz $ arv-put tile_md5sum_hu154_sort.csv.gz arv-put: No --project-uuid or --name specified. This data will be cached in Keep. You will need to find this upload by its locator(s) later. 192M / 960M 20.0% ^C $ arv-put tile_md5sum_hu154_sort.csv.gz arv-put: No --project-uuid or --name specified. This data will be cached in Keep. You will need to find this upload by its locator(s) later. 0M / 960M 0.0%
The following might be relevant as well:
$ which arv-put /usr/local/bin/arv-put $ sudo pip freeze | grep arvados arvados-python-client==0.1.1406400797.673a10d
$ df -h Filesystem Size Used Avail Use% Mounted on /dev/sdb1 205G 74G 121G 38% / none 4.0K 0 4.0K 0% /sys/fs/cgroup udev 7.4G 4.0K 7.4G 1% /dev tmpfs 1.5G 1.2M 1.5G 1% /run none 5.0M 0 5.0M 0% /run/lock none 7.5G 4.4M 7.5G 1% /run/shm none 100M 12K 100M 1% /run/user /dev/sda1 1.8T 1.6T 180G 90% /scratch $ cd ~/.cache/arvados/arv-put ~/.cache/arvados/arv-put$ ls -lah total 8.0K drwx------ 2 abram abram 4.0K Jul 30 17:27 . drwxrwxr-x 4 abram abram 4.0K Jul 24 16:59 .. -rw-rw-r-- 1 abram abram 0 Jul 24 16:57 6513a274b009750531dc2aeaaa52d692 -rw-rw-r-- 1 abram abram 0 Jul 30 17:27 9e04856f702db1742d23c6907db465da -rw-rw-r-- 1 abram abram 0 Jul 28 09:06 daf08842da8fa0415899872f983b914e
3427: Restore arv-put's resume functionality.
The refactoring in 0d1a48e accidentally introduced a bug where arv-put
wipes its resume cache clean before building the uploader. Because
the refactor always arranges `resume_cache = None` when the user
doesn't want to resume, we can fix the bug by just skipping the wipe.