Bug #17219

refactor scripts that move old packages to attic repos

Added by Ward Vandewege 5 months ago. Updated 4 months ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Target version:
Start date:
01/04/2021
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Story points:
-

Description

This script is called from a jenkins job, see https://ci.arvados.org/job/monthly-repository-move-packages-from-dev-attic/

The invocation path seems needlessly convoluted, and the scripts used are not public. Refactor and move to the resulting script(s) to the arvados-dev repo.


Subtasks

Task #17230: review 17219-refactor-attic-scriptsResolvedWard Vandewege


Related issues

Related to Arvados - Feature #17218: debian package repos: switch from freight to something fasterResolved

Associated revisions

Revision 6a11712a (diff)
Added by Ward Vandewege 5 months ago

Make the run_upload_packages.py script more verbose.

refs #17219

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <>

Revision b67ed2f0 (diff)
Added by Ward Vandewege 5 months ago

Iterate over packages one by one in run_upload_packages.py

refs #17219

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <>

Revision ab8f5649 (diff)
Added by Ward Vandewege 4 months ago

Add packaging-move-dev-to-attic.py, which now supports aptly. This is a
modified version of an old internal script that supported freight.

refs #17219

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <>

Revision 406aeeef (diff)
Added by Ward Vandewege 4 months ago

packaging-move-dev-to-attic.py: remove hardcoded list of supported
distributions, instead validate the distribution name by pattern.

refs #17219

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <>

Revision 4e1dfa0b (diff)
Added by Ward Vandewege 4 months ago

Address review comments.

closes #17219

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <>

Revision 963c173e
Added by Ward Vandewege 4 months ago

Merge branch '17219-refactor-attic-scripts'

closes #17219

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <>

Revision 5e28ab32 (diff)
Added by Ward Vandewege 4 months ago

Bugfixes for packaging-move-dev-to-attic.py

refs #17219

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <>

History

#1 Updated by Ward Vandewege 5 months ago

  • Related to Feature #17218: debian package repos: switch from freight to something faster added

#2 Updated by Ward Vandewege 4 months ago

  • Status changed from New to In Progress

#3 Updated by Ward Vandewege 4 months ago

  • Description updated (diff)

#4 Updated by Ward Vandewege 4 months ago

Ready for review in commit:406aeeef5614f60844d92bed6d6aa3440547d077 on branch 17219-refactor-attic-scripts (arvados-dev).

I intend to call this directly from https://ci.arvados.org/job/monthly-repository-move-packages-from-dev-attic/, eliminating the glue script on disk in the process.

#5 Updated by Nico C├ęsar 4 months ago

review at commit:406aeeef5614f60844d92bed6d6aa3440547d077

I think we can remove DebugExecutor(), the original idea was to have a --debug that will use that class. Right now is an evolutionary leftover, like an appendix.

Besides that looks fairly straight forward, we had the default='2017-06-31' because we started around that time, we can update that to something that makes sense now. but probably in production we'll always have a '--cutoff_date' parameter explicit

#6 Updated by Ward Vandewege 4 months ago

  • % Done changed from 0 to 100
  • Status changed from In Progress to Resolved

Also available in: Atom PDF