Idea #21089: Release Arvados 2.7.1 - Arvados

Custom queries

All assigned issues
All issues assigned for grooming
My issues for grooming
My issues for grooming (no story pts)
Prioritized open issues

Actions

Copy link

Idea #21089

closed

Release Arvados 2.7.1

Added by Peter Amstutz 7 months ago. Updated 5 months ago.

Status:

Resolved

Priority:

Normal

Assigned To:

Peter Amstutz

Category:

Target version:

Development 2024-01-03 sprint

Start date:

11/29/2023

Due date:

Story points:

Release:

Arvados 2.7.1

Release relationship:

Auto

Files

Download all files

Screenshot from 2023-12-08 12-20-17.png (142 KB) Screenshot from 2023-12-08 12-20-17.png		Sarah Zaranek, 12/08/2023 05:21 PM
Screenshot from 2023-12-08 12-27-44.png (51.8 KB) Screenshot from 2023-12-08 12-27-44.png		Sarah Zaranek, 12/08/2023 05:28 PM
Screenshot from 2023-12-08 12-36-04.png (604 Bytes) Screenshot from 2023-12-08 12-36-04.png		Sarah Zaranek, 12/08/2023 05:37 PM

Subtasks 27 (1 open — 26 closed)

Task #21090: 1. Prepare X.Y-staging branch	Resolved	Peter Amstutz	11/29/2023	Actions
Task #21091: 2. Update the "Upgrading Arvados and Release notes" doc page (main and release branch), update provision.sh, formula and arvbox to point to release	Resolved		11/29/2023	Actions
Task #21092: 3. Ensure that the entire automated testing pipeline is passing on Jenkins	Resolved		11/29/2023	Actions
Task #21093: 4. Review release branch	Resolved	Brett Smith	11/29/2023	Actions
Task #21094: 5. Draft release notes and publish them to www-dev	Resolved	Brett Smith	12/06/2023	Actions
Task #21095: 6. Review release notes	Resolved	Peter Amstutz	12/07/2023	Actions
Task #21096: 7. Create next redmine release	Resolved		12/06/2023	Actions
Task #21097: 8. Build RC packages	Resolved		12/06/2023	Actions
Task #21098: 9. Build RC arvados/jobs image	Resolved		12/07/2023	Actions
Task #21099: 10. Ensure installer tests are passing	Resolved		12/07/2023	Actions
Task #21100: 11. Build compute image & deploy RC packages to playground	Resolved		12/08/2023	Actions
Task #21101: 12. Run bam-to-vcf demo pipeline	Resolved		12/08/2023	Actions
Task #21102: 13. Manual testing	Resolved		12/08/2023	Actions
Task #21103: 14. Approve RC for release	Resolved		12/12/2023	Actions
Task #21104: 15. Build final release packages	Resolved		12/12/2023	Actions
Task #21105: 16. Publish stable arvados/jobs Docker image	Resolved		12/12/2023	Actions
Task #21106: 17. Push packages to stable	Resolved		12/12/2023	Actions
Task #21107: 18. Publish Python and Ruby packages	Resolved		12/12/2023	Actions
Task #21108: 19. Publish Java package (skipped no change)	Resolved		12/12/2023	Actions
Task #21109: 20. Publish R package	Resolved		12/12/2023	Actions
Task #21110: 21. Publish arvados/arvbox-demo image	In Progress		12/12/2023	Actions
Task #21111: 22. Tag commits, fast-forward X.Y-release branch to match X.Y-staging	Resolved		12/12/2023	Actions
Task #21112: 23. Ensure doc.arvados.org is up to date	Resolved		12/12/2023	Actions
Task #21113: 24. Merge release notes (step 6) from "develop" to "main" on arvados.org	Resolved		12/12/2023	Actions
Task #21114: 25. Send out release announcements	Resolved	Brett Smith	12/12/2023	Actions
Task #21115: (n/a) 26. Major releases only: Copy "run-tests" jobs in jenkins	Resolved		12/12/2023	Actions
Task #21116: 27. Add the release to zenodo.org	Resolved		12/12/2023	Actions

History
Notes
Property changes
Associated revisions

Actions

Copy link

Updated by Peter Amstutz 7 months ago

Target version changed from Development 2023-11-08 sprint to Development 2023-11-29 sprint

Actions

Copy link

Updated by Peter Amstutz 6 months ago

Release set to 67

Actions

Copy link

Updated by Peter Amstutz 6 months ago

Assigned To set to Peter Amstutz

Actions

Copy link

Updated by Peter Amstutz 5 months ago

b198eda19443c899602fb11d800a999ccd3521a8

2.7-developer-run-tests: #5

re-run: 2.7-developer-run-tests-apps-workbench-integration: #3

arvados-workbench2|ba244d0282e8dc6c21ebf6a509750717bae35783

developer-tests-workbench2: #1391

Actions

Copy link

Updated by Peter Amstutz 5 months ago

Target version changed from Development 2023-11-29 sprint to Development 2024-01-03 sprint

Actions

Copy link

Updated by Peter Amstutz 5 months ago

~~2.7.1~rc1-1~~

arvados|b198eda19443c899602fb11d800a999ccd3521a8

arvados-workbench2|ba244d0282e8dc6c21ebf6a509750717bae35783

2.7-developer-run-tests: #6

developer-tests-workbench2: #1400

Actions

Copy link

Updated by Peter Amstutz 5 months ago

~~2.7.1~rc1-1~~

arvados|d53b38d1fa91725b10c7359278e52a7f2f6a15db

arvados-workbench2|ba244d0282e8dc6c21ebf6a509750717bae35783

2.7-developer-run-tests: #7

developer-tests-workbench2: #1403

Actions

Copy link

Updated by Peter Amstutz 5 months ago

~~2.7.1~rc1-1~~

arvados|1dd06b9c849b4cf20b6f21e6004d5b11234cf348

arvados-workbench2|ba244d0282e8dc6c21ebf6a509750717bae35783

2.7-developer-run-tests: #8

developer-tests-workbench2: #1405

build-and-publish-rc-packages: #204

workbench2-build-release-candidate-package: #133

Actions

Copy link

Updated by Peter Amstutz 5 months ago

centos 7 error:

16:20:39 Installing pg 1.5.4 with native extensions
16:20:40 Gem::Ext::BuildError: ERROR: Failed to build gem native extension.
16:20:40 
16:20:40     current directory: /usr/local/rvm/gems/ruby-2.7.2/gems/pg-1.5.4/ext
16:20:40 /usr/local/rvm/rubies/ruby-2.7.2/bin/ruby -I
16:20:40 /usr/local/rvm/rubies/ruby-2.7.2/lib/ruby/2.7.0 -r
16:20:40 ./siteconf20231206-13-1ngyg3s.rb extconf.rb
16:20:40 Calling libpq with GVL unlocked
16:20:40 checking for pg_config... yes
16:20:40 Using config values from /usr/bin/pg_config
16:20:40 Using libpq from /usr/lib64
16:20:40 checking for libpq-fe.h... yes
16:20:40 checking for libpq/libpq-fs.h... yes
16:20:40 checking for pg_config_manual.h... yes
16:20:40 checking for PQconnectdb() in -lpq... yes
16:20:40 checking for PQconninfo() in libpq-fe.h... no
16:20:40 Your PostgreSQL is too old. Either install an older version of this gem or
16:20:40 upgrade your database to at least PostgreSQL-9.3.

rocky 8 error:

16:23:35 Installing zlib 3.0.0 with native extensions
16:23:35 Gem::Ext::BuildError: ERROR: Failed to build gem native extension.
16:23:35 
16:23:35     current directory: /usr/local/rvm/gems/ruby-2.7.2/gems/zlib-3.0.0/ext/zlib
16:23:35 /usr/local/rvm/rubies/ruby-2.7.2/bin/ruby -I
16:23:35 /usr/local/rvm/rubies/ruby-2.7.2/lib/ruby/2.7.0 -r
16:23:35 ./siteconf20231206-13-1isgqwl.rb extconf.rb
16:23:35 checking for deflateReset() in -lz... yes
16:23:35 checking for zlib.h... yes
16:23:35 checking for crc32_combine() in zlib.h... yes
16:23:35 checking for adler32_combine() in zlib.h... yes
16:23:35 checking for z_crc_t in zlib.h... yes
16:23:35 checking for z_size_t in zlib.h... yes
16:23:35 creating Makefile
16:23:35 
16:23:35 current directory: /usr/local/rvm/gems/ruby-2.7.2/gems/zlib-3.0.0/ext/zlib
16:23:35 make --jobs $(grep -c processor /proc/cpuinfo) "DESTDIR=" clean
16:23:35 
16:23:35 current directory: /usr/local/rvm/gems/ruby-2.7.2/gems/zlib-3.0.0/ext/zlib
16:23:35 make --jobs $(grep -c processor /proc/cpuinfo) "DESTDIR=" 
16:23:35 compiling zlib.c
16:23:35 zlib.c:16:11: fatal error: valgrind/memcheck.h: No such file or directory
16:23:35  # include <valgrind/memcheck.h>
16:23:35            ^~~~~~~~~~~~~~~~~~~~~
16:23:35 compilation terminated.
16:23:35 make: *** [Makefile:245: zlib.o] Error 1
16:23:35 
16:23:35 make failed, exit code 2

Actions

Copy link

#10

Updated by Brett Smith 5 months ago

Peter Amstutz wrote in #note-9:

rocky 8 error:

This is the same error as #21028. Maybe pick fe8da34676be7c6fbb1042fcfcabee19bfa424d0 and 7a26b8b5d6691e51647dda8a1c4a73abf3b3c097?

Actions

Copy link

#11

Updated by Peter Amstutz 5 months ago

Cherry picked some additional fixes for rocky 8:

build-publish-packages-testing-rocky8: #7

Actions

Copy link

#12

Updated by Peter Amstutz 5 months ago

2.7.1~rc1-1

arvados|8d8328c0715408ab888cd050039cd90e2de9ba96

arvados-workbench2|ba244d0282e8dc6c21ebf6a509750717bae35783

developer-tests-workbench2: #1406

build-and-publish-rc-packages: #208

build-publish-packages-testing-centos7: #208

workbench2-build-release-candidate-package: #134

Actions

Copy link

#13

Updated by Peter Amstutz 5 months ago

2.7.1~rc2-1

The rc1 builds are messy so let's see if we can build a clean rc2:

arvados|8d8328c0715408ab888cd050039cd90e2de9ba96

arvados-workbench2|2c7f44ed77a3df21088ec608f6a5d58dd7f65518

developer-tests-workbench2: #1407

build-and-publish-rc-packages: #209

workbench2-build-release-candidate-package: #138

docker-jobs-image-release: #64

test-provision: #740

packer-build-compute-image: #243

Actions

Copy link

#14

Updated by Peter Amstutz 5 months ago

Status changed from New to In Progress

Actions

Copy link

#15

Updated by Peter Amstutz 5 months ago

Tracker changed from Bug to Idea

Actions

Copy link

#16

Updated by Peter Amstutz 5 months ago

Blockers:

live logs not showing up on pirca -- configuration issue, resolved
search panel layout issue -- in progress (#21280)
if we're merging workbench fixes at the last minute, we can include the log sorting issue as well (#21204)

Actions

Copy link

#17

Updated by Sarah Zaranek 5 months ago

File Screenshot from 2023-12-08 12-20-17.png Screenshot from 2023-12-08 12-20-17.png added

Strange behavior that logs don't seem to be filtering correctly from the project view...

Actions

Copy link

#18

Updated by Sarah Zaranek 5 months ago

Same for ouptuts --

for instance this output is showing up --

https://workbench.pirca.arvadosapi.com/collections/pirca-4zz18-69a1mjjzi54ju37

Actions

Copy link

#19

Updated by Sarah Zaranek 5 months ago

This jobs is showing odd things for subprocess -- the graphs says there are 156 but none are listed below:
https://workbench.pirca.arvadosapi.com/processes/pirca-xvhdp-llbg30zqukrb942

Actions

Copy link

#20

Updated by Sarah Zaranek 5 months ago

Actually it was just so slow that it tooks over a minute for them to show up :(

It also puts the "No subprocesses available for listing.

The current process may not have any or none matches current filtering." while waiting which really seems off

Actions

Copy link

#21

Updated by Sarah Zaranek 5 months ago

File Screenshot from 2023-12-08 12-27-44.png Screenshot from 2023-12-08 12-27-44.png added

The space between the bar and the list of suprocesses is so big that I barely see 1 process -- this is on my laptop - my guess is that it has only been tested on bigger screens --- I mentioned this when we reviewed that it should not take up this much space vertically.

I do make my Arvados at 120% because otherwise I have real troupble reading the text on my laptop.

Actions

Copy link

#22