Project

General

Profile

Actions

Bug #5653

closed

[SDKs] arv-copy of Pipeline Template did not copy all branches required to remote Repository

Added by Sarah Guthrie about 9 years ago. Updated about 9 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
SDKs
Target version:
Story points:
0.5

Description

Copying Pipeline Template tb05z-p5p6p-wp8680agywvi2fo (which has two steps, each using a different branch of the sguthrie repository on tb05z) from tb05z to su92l produced a pipeline template that was able to run the first step, but produced an error when trying to execute the second step:
Error creating job for component run-cava: error searching sguthrie from '5a13a2fcf52fdb537ba3d3d6409cd81a505e43b5' to '5a13a2fcf52fdb537ba3d3d6409cd81a505e43b5', excluding []

Original arv copy:
arv copy --src tb05z --dst su92l --dst-git-repo=sguthrie --project-uuid=su92l-j7d0g-zv5erbjcb01xvt2 tb05z-p5p6p-wp8680agywvi2fo

Running this arv copy resolved the issue, since this pipeline template has one step which uses the sguthrie:run-cava branch.
arv copy --src tb05z --dst su92l --dst-git-repo=sguthrie --project-uuid=su92l-j7d0g-zv5erbjcb01xvt2 tb05z-p5p6p-lyrpc3tqejuag3q


Subtasks 1 (0 open1 closed)

Task #5673: Review 5653-arv-copy-multiple-branches-wipResolvedPeter Amstutz04/06/2015Actions

Related issues

Copied to Arvados - Feature #5676: [SDK] arv-copy automatically creates new repository(ies) on the destination clusterNewActions
Actions #1

Updated by Brett Smith about 9 years ago

  • Subject changed from arv copy of Pipeline Template did not copy all branches required to remote Repository to [SDKs] arv-copy of Pipeline Template did not copy all branches required to remote Repository
  • Category set to SDKs
Actions #2

Updated by Brett Smith about 9 years ago

  • Status changed from New to In Progress
  • Assigned To set to Brett Smith
  • Target version changed from Bug Triage to 2015-04-29 sprint
  • Story points set to 0.5
Actions #3

Updated by Brett Smith about 9 years ago

5653-arv-copy-multiple-branches-wip is up for review. I tested it by copying the same pipeline template in this bug report to my Docker installation, and it correctly copied over both branches. Here's a transcript for illustration (it doesn't copy over any collections because that was already done in a previous run):

brinstar % arv-copy --src tb05z --dst bcsdk --dst-git-repo=brett/copy5653b --project-uuid=bcsdk-j7d0g-bwfjcexaeflb36m tb05z-p5p6p-wp8680agywvi2fo
WARNING: 'sguthrie' is an alias for 'tb05z-s0uqq-y6tb5g8u0fzdizd'
remote: Counting objects: 158, done.
remote: Compressing objects: 100% (78/78), done.
remote: Total 158 (delta 34), reused 0 (delta 0)
Receiving objects: 100% (158/158), 16.18 KiB, done.
Resolving deltas: 100% (34/34), done.
WARNING: 'brett/copy5653b' is an alias for 'bcsdk-s0uqq-3mcn7ujkrec3997'
Counting objects: 82, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (24/24), done.
Writing objects: 100% (82/82), 8.57 KiB, done.
Total 82 (delta 16), reused 81 (delta 16)
To git@api.dev.arvados:brett/copy5653b.git
 * [new branch]      git_git_tb05z_arvadosapi_com_sguthrie_git_filter_vcfs -> git_git_tb05z_arvadosapi_com_sguthrie_git_filter_vcfs
WARNING: 'brett/copy5653b' is an alias for 'bcsdk-s0uqq-3mcn7ujkrec3997'
Counting objects: 71, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (18/18), done.
Writing objects: 100% (68/68), 6.97 KiB, done.
Total 68 (delta 16), reused 68 (delta 16)
To git@api.dev.arvados:brett/copy5653b.git
 * [new branch]      git_git_tb05z_arvadosapi_com_sguthrie_git_run_cava -> git_git_tb05z_arvadosapi_com_sguthrie_git_run_cava
2015-04-06 14:39:08 arvados.arv-copy[478] INFO:
2015-04-06 14:39:08 arvados.arv-copy[478] INFO: Success: created copy with uuid bcsdk-p5p6p-v1f4wqe910dqxei
Actions #4

Updated by Peter Amstutz about 9 years ago

This probably qualifies as bikeshedding, but would this be a good opportunity to take advantage of the new capability to create repositories, instead of the current practice of cramming branches into unrelated repositories?

Actions #5

Updated by Brett Smith about 9 years ago

Peter Amstutz wrote:

This probably qualifies as bikeshedding, but would this be a good opportunity to take advantage of the new capability to create repositories, instead of the current practice of cramming branches into unrelated repositories?

It's not exactly bikeshedding (the same idea crossed my mind) but as part of my support work I think addressing some of the other bugs in triage is higher priority than this. Users have an easy workaround of making the repository themselves, then feeding it to arv-copy if they want. Thanks for filing #5676.

Actions #6

Updated by Peter Amstutz about 9 years ago

9b0ace3 LGTM.

Repository creating feature request filed separately at #5676.

Actions #7

Updated by Brett Smith about 9 years ago

  • Status changed from In Progress to Resolved

Applied in changeset arvados|commit:407ac18e99051a67d4a615bfe2189d5562334f12.

Actions

Also available in: Atom PDF