Arvados

This started failing at the same time as test-provision-ubuntu2004, so whatever is causing that to fail (still under investigation) is probably causing this too.

It's fun when the scope of the ticket changes without anyone doing anything. This week it has started failing like this:

Err:1 http://packages.cloud.google.com/apt cloud-sdk-bullseye InRelease
  The following signatures couldn't be verified because the public key is not available: NO_PUBKEY B53DC80D13EDEF05
Err:2 http://packages.cloud.google.com/apt google-cloud-packages-archive-keyring-bullseye InRelease
  The following signatures couldn't be verified because the public key is not available: NO_PUBKEY B53DC80D13EDEF05
Err:3 http://packages.cloud.google.com/apt google-compute-engine-bullseye-stable InRelease
  The following signatures couldn't be verified because the public key is not available: NO_PUBKEY B53DC80D13EDEF05
Reading package lists...
W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: http://packages.cloud.google.com/apt cloud-sdk-bullseye InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY B53DC80D13EDEF05
E: The repository 'http://deb.debian.org/debian buster-backports Release' no longer has a Release file.
W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: http://packages.cloud.google.com/apt google-cloud-packages-archive-keyring-bullseye InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY B53DC80D13EDEF05
W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: http://packages.cloud.google.com/apt google-compute-engine-bullseye-stable InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY B53DC80D13EDEF05
Build step 'Execute shell' marked build as failure

This problem predates anything in the Arvados code. The Salt installer needs apt to be working to bootstrap itself. We might need to build a new compute image with Google's current GPG keys?

Brett Smith wrote in #note-5:

We might need to build a new compute image with Google's current GPG keys?

Listing currently-available base images requires GCP permissions that I don't have. So I'm happy to try to help steer this but at the very least I'm going to need someone to tell me the name of the current Debian 11 image.

Made some tweaks to Packer in arvados-dev commit fb2bb48b6bcf4884d016ec4ce5d87363d51c6ebe

That successfully built a new debian11 image: packer-build-provision-testing-image: #47

Between that and the changes from the #21383 branch, this is now passing: test-provision-debian11: #664