Arvados

Checking c97qk's files, it seems that the structure.sql file is from rails 5 but the rest of the code is from 4.2.

The ar_internal_metadata table causing this error was added on 261543dfc3, and the Gemfile on c97qk asks for rails 4.2. Also, the app/models/arvados_model.rb file is from rails 4.2 because the class is subclassing ActiveRecord::Base instead of ApplicationRecord

Now that #15163 is out of the way I tried to downgrade the API server ... ended up with another issue:

c97qk:~# apt-get install arvados-api-server=1.3.1.20190422202321-8
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following packages will be DOWNGRADED:
  arvados-api-server
0 upgraded, 0 newly installed, 1 downgraded, 0 to remove and 320 not upgraded.
Need to get 0 B/28.1 MB of archives.
After this operation, 1,262 kB disk space will be freed.
Do you want to continue? [Y/n] 
dpkg: warning: downgrading arvados-api-server from 1.3.2-1 to 1.3.1.20190422202321-8
(Reading database ... 110469 files and directories currently installed.)
Preparing to unpack .../arvados-api-server_1.3.1.20190422202321-8_amd64.deb ...
Unpacking arvados-api-server (1.3.1.20190422202321-8) over (1.3.2-1) ...
Setting up arvados-api-server (1.3.1.20190422202321-8) ...

Assumption: nginx is configured to serve Rails from
            /var/www/arvados-api/current
Assumption: nginx and passenger run as www-data

Creating symlinks to configuration in /etc/arvados/api ...... done.
Running bundle install... done.
Ensuring directory and file permissions ...... done.
Running db:migrate...Defaulting to memory cache, because /var/www/arvados-api/current/tmp/cache owner (uid=33) is not me (uid=0)
DEPRECATION WARNING: `config.serve_static_files` is deprecated and will be removed in Rails 5.1.
Please use `config.public_file_server.enabled = false` instead.
 (called from block in <top (required)> at /var/www/arvados-api/current/config/environments/production.rb:12)
 done.
Checking application.yml for completeness...Defaulting to memory cache, because /var/www/arvados-api/current/tmp/cache owner (uid=33) is not me (uid=0)
rake aborted!
Don't know how to build task 'config:check' (See the list of available tasks with `rake --tasks`)
/var/www/arvados-api/shared/vendor_bundle/ruby/2.3.0/gems/rake-12.3.2/exe/rake:27:in `<top (required)>'
/usr/local/rvm/gems/ruby-2.3.5/gems/bundler-1.16.0/lib/bundler/cli/exec.rb:75:in `load'
/usr/local/rvm/gems/ruby-2.3.5/gems/bundler-1.16.0/lib/bundler/cli/exec.rb:75:in `kernel_load'
/usr/local/rvm/gems/ruby-2.3.5/gems/bundler-1.16.0/lib/bundler/cli/exec.rb:28:in `run'
/usr/local/rvm/gems/ruby-2.3.5/gems/bundler-1.16.0/lib/bundler/cli.rb:424:in `exec'
/usr/local/rvm/gems/ruby-2.3.5/gems/bundler-1.16.0/lib/bundler/vendor/thor/lib/thor/command.rb:27:in `run'
/usr/local/rvm/gems/ruby-2.3.5/gems/bundler-1.16.0/lib/bundler/vendor/thor/lib/thor/invocation.rb:126:in `invoke_command'
/usr/local/rvm/gems/ruby-2.3.5/gems/bundler-1.16.0/lib/bundler/vendor/thor/lib/thor.rb:387:in `dispatch'
/usr/local/rvm/gems/ruby-2.3.5/gems/bundler-1.16.0/lib/bundler/cli.rb:27:in `dispatch'
/usr/local/rvm/gems/ruby-2.3.5/gems/bundler-1.16.0/lib/bundler/vendor/thor/lib/thor/base.rb:466:in `start'
/usr/local/rvm/gems/ruby-2.3.5/gems/bundler-1.16.0/lib/bundler/cli.rb:18:in `start'
/usr/local/rvm/gems/ruby-2.3.5/gems/bundler-1.16.0/exe/bundle:30:in `block in <top (required)>'
/usr/local/rvm/gems/ruby-2.3.5/gems/bundler-1.16.0/lib/bundler/friendly_errors.rb:122:in `with_friendly_errors'
/usr/local/rvm/gems/ruby-2.3.5/gems/bundler-1.16.0/exe/bundle:22:in `<top (required)>'
/usr/local/rvm/gems/ruby-2.3.5/bin/bundle:23:in `load'
/usr/local/rvm/gems/ruby-2.3.5/bin/bundle:23:in `<main>'
/usr/local/rvm/gems/ruby-2.3.5/bin/ruby_executable_hooks:15:in `eval'
/usr/local/rvm/gems/ruby-2.3.5/bin/ruby_executable_hooks:15:in `<main>'
(See full trace by running task with --trace)
 failed.
Precompiling assets... skipped.
Initializing git_internal_dir... skipped.

PLEASE NOTE:

The arvados-api-server package was not configured completely because
/etc/arvados/api/application.yml needs some tweaking.
Please refer to the documentation at
<http://doc.arvados.org/install/install-api-server.html#configure> for more details.

When application.yml has been modified,
reconfigure or reinstall this package.

Tomorrow we'll investigate why

Don't know how to build task 'config:check'

The config:check rake task was removed on 2ea729f97166cb5fda4a6ca0818f0a0ab15388ab -- if this is part of a unified rails package building mechanism, maybe we should have made it a no-op instead of deleting it?

Update at 0cd5f7190 - branch: 15161-config-check-rake-fix

Re-adds the config:check task as a no-op, because build/rails-package-scripts/postinst.sh assumes that the task exists on all rails apps.

As requested by Peter, I did a manual test by invalidating the config.yml file and running rake config:check. This is the result:

lucas@veritas:~/arvados/services/api$ rake config:check
rake aborted!
missing Services.SSO.ExternalURL
/media/psf/arvados/services/api/lib/config_loader.rb:93:in `block in coercion_and_check'
/media/psf/arvados/services/api/lib/config_loader.rb:80:in `each'
/media/psf/arvados/services/api/lib/config_loader.rb:80:in `coercion_and_check'
/media/psf/arvados/services/api/config/arvados_config.rb:220:in `<top (required)>'
/media/psf/arvados/services/api/config/application.rb:48:in `require_relative'
/media/psf/arvados/services/api/config/application.rb:48:in `<class:Application>'
/media/psf/arvados/services/api/config/application.rb:44:in `<module:Server>'
/media/psf/arvados/services/api/config/application.rb:43:in `<top (required)>'
/media/psf/arvados/services/api/rakefile:9:in `require'
/media/psf/arvados/services/api/rakefile:9:in `<top (required)>'
/home/lucas/.rvm/gems/ruby-2.4.4@test/gems/rake-12.3.2/exe/rake:27:in `<top (required)>'
/home/lucas/.rvm/gems/ruby-2.4.4@test/bin/ruby_executable_hooks:24:in `eval'
/home/lucas/.rvm/gems/ruby-2.4.4@test/bin/ruby_executable_hooks:24:in `<main>'
(See full trace by running task with --trace)

Tom: Yes, forgot to close it, doing it now.