[SDKs] arv-copy of Pipeline Template did not copy all branches required to remote Repository
Copying Pipeline Template tb05z-p5p6p-wp8680agywvi2fo (which has two steps, each using a different branch of the sguthrie repository on tb05z) from tb05z to su92l produced a pipeline template that was able to run the first step, but produced an error when trying to execute the second step:
Error creating job for component run-cava: error searching sguthrie from '5a13a2fcf52fdb537ba3d3d6409cd81a505e43b5' to '5a13a2fcf52fdb537ba3d3d6409cd81a505e43b5', excluding 
Original arv copy:
arv copy --src tb05z --dst su92l --dst-git-repo=sguthrie --project-uuid=su92l-j7d0g-zv5erbjcb01xvt2 tb05z-p5p6p-wp8680agywvi2fo
Running this arv copy resolved the issue, since this pipeline template has one step which uses the sguthrie:run-cava branch.
arv copy --src tb05z --dst su92l --dst-git-repo=sguthrie --project-uuid=su92l-j7d0g-zv5erbjcb01xvt2 tb05z-p5p6p-lyrpc3tqejuag3q
#3 Updated by Brett Smith over 4 years ago
5653-arv-copy-multiple-branches-wip is up for review. I tested it by copying the same pipeline template in this bug report to my Docker installation, and it correctly copied over both branches. Here's a transcript for illustration (it doesn't copy over any collections because that was already done in a previous run):
brinstar % arv-copy --src tb05z --dst bcsdk --dst-git-repo=brett/copy5653b --project-uuid=bcsdk-j7d0g-bwfjcexaeflb36m tb05z-p5p6p-wp8680agywvi2fo WARNING: 'sguthrie' is an alias for 'tb05z-s0uqq-y6tb5g8u0fzdizd' remote: Counting objects: 158, done. remote: Compressing objects: 100% (78/78), done. remote: Total 158 (delta 34), reused 0 (delta 0) Receiving objects: 100% (158/158), 16.18 KiB, done. Resolving deltas: 100% (34/34), done. WARNING: 'brett/copy5653b' is an alias for 'bcsdk-s0uqq-3mcn7ujkrec3997' Counting objects: 82, done. Delta compression using up to 4 threads. Compressing objects: 100% (24/24), done. Writing objects: 100% (82/82), 8.57 KiB, done. Total 82 (delta 16), reused 81 (delta 16) To email@example.com:brett/copy5653b.git * [new branch] git_git_tb05z_arvadosapi_com_sguthrie_git_filter_vcfs -> git_git_tb05z_arvadosapi_com_sguthrie_git_filter_vcfs WARNING: 'brett/copy5653b' is an alias for 'bcsdk-s0uqq-3mcn7ujkrec3997' Counting objects: 71, done. Delta compression using up to 4 threads. Compressing objects: 100% (18/18), done. Writing objects: 100% (68/68), 6.97 KiB, done. Total 68 (delta 16), reused 68 (delta 16) To firstname.lastname@example.org:brett/copy5653b.git * [new branch] git_git_tb05z_arvadosapi_com_sguthrie_git_run_cava -> git_git_tb05z_arvadosapi_com_sguthrie_git_run_cava 2015-04-06 14:39:08 arvados.arv-copy INFO: 2015-04-06 14:39:08 arvados.arv-copy INFO: Success: created copy with uuid bcsdk-p5p6p-v1f4wqe910dqxei
#5 Updated by Brett Smith over 4 years ago
Peter Amstutz wrote:
This probably qualifies as bikeshedding, but would this be a good opportunity to take advantage of the new capability to create repositories, instead of the current practice of cramming branches into unrelated repositories?
It's not exactly bikeshedding (the same idea crossed my mind) but as part of my support work I think addressing some of the other bugs in triage is higher priority than this. Users have an easy workaround of making the repository themselves, then feeding it to arv-copy if they want. Thanks for filing #5676.