Project

General

Profile

Actions

Idea #16578

closed

Scripted setup of the tutorial cluster by copying data from data cluster

Added by Peter Amstutz almost 4 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
Sample Pipelines
Target version:
Start date:
09/09/2020
Due date:
Story points:
-
Release relationship:
Auto

Subtasks 1 (0 open1 closed)

Task #16765: Review 16578-copy-tutorialResolvedPeter Amstutz09/09/2020Actions

Related issues

Related to Arvados - Bug #17960: [arv-copy] document ability to copy projectsResolvedPeter Amstutz09/08/2021Actions
Actions #1

Updated by Peter Amstutz almost 4 years ago

  • Assigned To set to Peter Amstutz
Actions #2

Updated by Peter Amstutz almost 4 years ago

  • Target version changed from 2020-07-15 to 2020-08-12 Sprint
Actions #3

Updated by Peter Amstutz almost 4 years ago

  • Assigned To deleted (Peter Amstutz)
Actions #4

Updated by Peter Amstutz almost 4 years ago

  • Target version changed from 2020-08-12 Sprint to 2020-08-26 Sprint
Actions #5

Updated by Peter Amstutz over 3 years ago

  • Target version changed from 2020-08-26 Sprint to 2020-09-09 Sprint
Actions #6

Updated by Peter Amstutz over 3 years ago

  • Assigned To set to Peter Amstutz
Actions #7

Updated by Peter Amstutz over 3 years ago

  • Category set to Sample Pipelines
Actions #8

Updated by Peter Amstutz over 3 years ago

  • Status changed from New to In Progress
Actions #9

Updated by Peter Amstutz over 3 years ago

16578-copy-tutorial @ b07b70d9024e7203f4cae3bbc526fc36e9cca19e

Adds project copying feature to arv-copy. This copies collections and workflows contained in the source project.

Adds tools/copy-tutorial/copy-tutorial.sh

This is a simple script that uses arv-copy project copying to copy tutorials from the data cluster (jutro).

Also partially addresses a long-standing efficiency bug in copying large collections, building up the new manifest that will be sent to the destination cluster no longer involves geometric growth in string copying.

developer-run-tests: #2074

Actions #10

Updated by Peter Amstutz over 3 years ago

  • Target version changed from 2020-09-09 Sprint to 2020-09-23 Sprint
Actions #11

Updated by Nico César over 3 years ago

  • Target version deleted (2020-09-23 Sprint)

I red the code at b07b70d9024e7203f4cae3bbc526fc36e9cca19e and seems fine but tests are missing for the new paramenters

I noticed sdk/python/tests/test_arv_copy.py is kind of skinny and probably to test this would be a combination of arv-put, arv-copy then arv-get

Is there any way we can test this easily? Just to have more coverage in case we change something down the road (or some 3rd party dependency does!)

Actions #12

Updated by Nico César over 3 years ago

  • Target version set to 2020-09-23 Sprint
Actions #13

Updated by Peter Amstutz over 3 years ago

Nico César wrote:

I red the code at b07b70d9024e7203f4cae3bbc526fc36e9cca19e and seems fine but tests are missing for the new paramenters

I noticed sdk/python/tests/test_arv_copy.py is kind of skinny and probably to test this would be a combination of arv-put, arv-copy then arv-get

Is there any way we can test this easily? Just to have more coverage in case we change something down the road (or some 3rd party dependency does!)

16578-copy-tutorial @ 3489a9b5ce083cd17dae6d50c8c5ceeee29b074b

Added a copy project (which includes copy collection) integration test.

developer-run-tests: #2081

Actions #14

Updated by Nico César over 3 years ago

LGTM, ready to merge

Actions #15

Updated by Peter Amstutz over 3 years ago

  • Status changed from In Progress to Resolved
Actions #16

Updated by Peter Amstutz over 3 years ago

  • Release set to 25
Actions #17

Updated by Ward Vandewege over 2 years ago

  • Related to Bug #17960: [arv-copy] document ability to copy projects added
Actions

Also available in: Atom PDF