https://dev.arvados.org/https://dev.arvados.org/favicon.ico?15576888422015-12-16T20:40:31ZArvadosArvados - Task #8036: Review arvados-dev branch 8014-rails-postinst-scripts-wiphttps://dev.arvados.org/issues/8036?journal_id=336222015-12-16T20:40:31ZBrett Smithbrett.smith@curii.com
<ul><li><strong>Assigned To</strong> changed from <i>Ward Vandewege</i> to <i>Brett Smith</i></li></ul> Arvados - Task #8036: Review arvados-dev branch 8014-rails-postinst-scripts-wiphttps://dev.arvados.org/issues/8036?journal_id=338092016-01-02T16:24:36ZBrett Smithbrett.smith@curii.com
<ul><li><strong>Subject</strong> changed from <i>review</i> to <i>Review arvados-dev branch 8014-rails-postinst-scripts-wip</i></li><li><strong>Assigned To</strong> deleted (<del><i>Brett Smith</i></del>)</li></ul> Arvados - Task #8036: Review arvados-dev branch 8014-rails-postinst-scripts-wiphttps://dev.arvados.org/issues/8036?journal_id=338262016-01-04T17:01:34ZBrett Smithbrett.smith@curii.com
<ul><li><strong>Assigned To</strong> set to <i>Nico César</i></li></ul> Arvados - Task #8036: Review arvados-dev branch 8014-rails-postinst-scripts-wiphttps://dev.arvados.org/issues/8036?journal_id=338362016-01-04T19:25:12ZNico César
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li><li><strong>Start date</strong> set to <i>01/04/2016</i></li></ul> Arvados - Task #8036: Review arvados-dev branch 8014-rails-postinst-scripts-wiphttps://dev.arvados.org/issues/8036?journal_id=338452016-01-04T20:31:51ZNico César
<ul></ul><pre>
workbench.c97qk:/home/nico# dpkg -i arvados-workbench_0.1.20160104175817.7fa91fc-3_amd64.deb
(Reading database ... 64673 files and directories currently installed.)
Preparing to unpack arvados-workbench_0.1.20160104175817.7fa91fc-3_amd64.deb ...
Unpacking arvados-workbench (0.1.20160104175817.7fa91fc-3) over (0.1.20151218204040.2b699de-1) ...
dpkg: warning: unable to delete old directory '/var/www/arvados-workbench/current/tmp/cache': Directory not empty
dpkg: warning: unable to delete old directory '/var/www/arvados-workbench/current/tmp': Directory not empty
Setting up arvados-workbench (0.1.20160104175817.7fa91fc-3) ...
Assumption: nginx is configured to serve Rails from
/var/www/arvados-workbench/current
Assumption: nginx and passenger run as www-data:www-data
Creating symlinks to configuration in /etc/arvados/workbench ...... done.
Running bundle install... done.
Ensuring directory and file permissions ...... done.
Checking application.yml for completeness...action_controller.perform_caching true
activation_contact_link mailto:beta@curoverse.com
/.../
shell_in_a_box_url https://webshell.c97qk.arvadosapi.com/%{hostname}
show_user_agreement_inline false
site_name Curoverse
source_version 2b699de-1
support_email_address support@curoverse.com
user_profile_form_fields [{"key"=>"organization", "type"=>"text", "form_field_title"=>"Organization", "form_field_description"=>"Your company or institution", "required"=>true}, {"key"=>"organization_email", "type"=>"text", "form_field_title"=>"E-mail at Organization", "form_field_description"=>"Your corporate or institutional e-mail address", "required"=>true}, {"key"=>"lab", "type"=>"text", "form_field_title"=>"Department or Lab", "form_field_description"=>"Your lab or organizational unit"}, {"key"=>"website_url", "type"=>"text", "form_field_title"=>"Website", "form_field_description"=>"Your website url"}, {"key"=>"role", "type"=>"select", "form_field_title"=>"Role", "form_field_description"=>"Choose the category that best describes your role in your organization.", "options"=>["Bio-informatician", "Data Scientist", "Analyst", "Researcher", "Software Developer", "System Administrator", "Other"]}]
user_profile_form_message Welcome to Curoverse. All <span style="color:red">required fields</span> must be completed before you can proceed.
done.
Precompiling assets... done.
* Restarting nginx nginx
...done.
</pre>
<p>but something is broken after that .</p>
<p>investigating<br /></pre></p> Arvados - Task #8036: Review arvados-dev branch 8014-rails-postinst-scripts-wiphttps://dev.arvados.org/issues/8036?journal_id=338462016-01-04T20:41:24ZNico César
<ul></ul><p>this is odd! I get the following</p>
<pre>
Refusing to start in production mode with missing configuration.
The following configuration settings must be specified in
config/application.yml:
* arvados_login_base
* arvados_v1_base
* arvados_insecure_https
* secret_token
(RuntimeError)
/var/www/arvados-workbench/current/config/load_config.rb:46:in `block in <top (required)>'
/var/www/arvados-workbench/shared/vendor_bundle/ruby/2.1.0/gems/railties-4.1.12/lib/rails/railtie.rb:210:in `instance_eval'
/var/www/arvados-workbench/shared/vendor_bundle/ruby/2.1.0/gems/railties-4.1.12/lib/rails/railtie.rb:210:in `configure'
/var/www/arvados-workbench/shared/vendor_bundle/ruby/2.1.0/gems/railties-4.1.12/lib/rails/railtie.rb:182:in `configure'
/var/www/arvados-workbench/current/config/load_config.rb:16:in `<top (required)>'
/var/www/arvados-workbench/shared/vendor_bundle/ruby/2.1.0/gems/activesupport-4.1.12/lib/active_support/dependencies.rb:247:in `require'
/var/www/arvados-workbench/shared/vendor_bundle/ruby/2.1.0/gems/activesupport-4.1.12/lib/active_support/dependencies.rb:247:in `block in require'
/var/www/arvados-workbench/shared/vendor_bundle/ruby/2.1.0/gems/activesupport-4.1.12/lib/active_support/dependencies.rb:232:in `load_dependency'
/var/www/arvados-workbench/shared/vendor_bundle/ruby/2.1.0/gems/activesupport-4.1.12/lib/active_support/dependencies.rb:247:in `require'
/var/www/arvados-workbench/current/config/application.rb:54:in `<top (required)>'
/var/www/arvados-workbench/current/config/environment.rb:2:in `require'
/var/www/arvados-workbench/current/config/environment.rb:2:in `<top (required)>'
/var/www/arvados-workbench/current/config.ru:3:in `require'
/var/www/arvados-workbench/current/config.ru:3:in `block in <main>'
/var/www/arvados-workbench/shared/vendor_bundle/ruby/2.1.0/gems/rack-1.5.5/lib/rack/builder.rb:55:in `instance_eval'
/var/www/arvados-workbench/shared/vendor_bundle/ruby/2.1.0/gems/rack-1.5.5/lib/rack/builder.rb:55:in `initialize'
/var/www/arvados-workbench/current/config.ru:1:in `new'
/var/www/arvados-workbench/current/config.ru:1:in `<main>'
/usr/share/passenger/helper-scripts/rack-preloader.rb:107:in `eval'
/usr/share/passenger/helper-scripts/rack-preloader.rb:107:in `preload_app'
/usr/share/passenger/helper-scripts/rack-preloader.rb:153:in `<module:App>'
/usr/share/passenger/helper-scripts/rack-preloader.rb:29:in `<module:PhusionPassenger>'
/usr/share/passenger/helper-scripts/rack-preloader.rb:28:in `<main>'
</pre>
<pre>
workbench.c97qk:/home/nico# ls -l /var/www/arvados-workbench/current/config/application.yml
lrwxrwxrwx 1 root root 38 Jan 4 20:27 /var/www/arvados-workbench/current/config/application.yml -> /etc/arvados/workbench/application.yml
workbench.c97qk:/home/nico# ls -l /etc/arvados/workbench/application.yml
-rw-r--r-- 1 root root 3340 Nov 11 19:46 /etc/arvados/workbench/application.yml
workbench.c97qk:/home/nico# grep arvados_login_base /etc/arvados/workbench/application.yml
arvados_login_base: https://c97qk.arvadosapi.com/login
workbench.c97qk:/home/nico# find / -name application.yml
/var/www/arvados-workbench/current/config/application.yml
/etc/arvados/workbench/application.yml
</pre> Arvados - Task #8036: Review arvados-dev branch 8014-rails-postinst-scripts-wiphttps://dev.arvados.org/issues/8036?journal_id=338472016-01-04T21:13:55ZNico César
<ul></ul><p>ok ... the bug(?) is the following</p>
<p>we currently have a <strong>COPY</strong> of application.yml in /etc/arvados/package and the new package installs a symlink but our current instalations have a restricted permissions there for root only</p>
<p>I fixed this by doing:</p>
<p><code>chown -R www-data.www-data /etc/arvados</code></p>
<p>which in my opinion should be reflected the package.</p> Arvados - Task #8036: Review arvados-dev branch 8014-rails-postinst-scripts-wiphttps://dev.arvados.org/issues/8036?journal_id=338502016-01-04T21:25:04ZNico César
<ul></ul><p>brett please review puppet branch 8014-rails-postinst-scripts-wip</p>
<p>otherwise puppet will undo any changes we propose</p> Arvados - Task #8036: Review arvados-dev branch 8014-rails-postinst-scripts-wiphttps://dev.arvados.org/issues/8036?journal_id=338562016-01-04T23:04:07ZBrett Smithbrett.smith@curii.com
<ul></ul><p>Nico Cesar wrote:</p>
<blockquote>
<p>ok ... the bug(?) is the following</p>
<p>we currently have a <strong>COPY</strong> of application.yml in /etc/arvados/package and the new package installs a symlink but our current instalations have a restricted permissions there for root only</p>
<p>I fixed this by doing:</p>
<p><code>chown -R www-data.www-data /etc/arvados</code></p>
<p>which in my opinion should be reflected the package.</p>
</blockquote>
<p>It would be semi-evil to overwrite the access bits of stuff in /etc willy-nilly. I think that could potentially surprise a lot of users. In commit:15d90bd I have updated the scripts to set better defaults, including in the situation where we're migrating from a previous configuration (e.g., an old package using arvados-*-upgrade.sh). You won't see the changes take effect on c97qk since that migration has already happened, but you should be able to see it on other test clusters.</p> Arvados - Task #8036: Review arvados-dev branch 8014-rails-postinst-scripts-wiphttps://dev.arvados.org/issues/8036?journal_id=338582016-01-04T23:09:17ZBrett Smithbrett.smith@curii.com
<ul></ul><p>Nico Cesar wrote:</p>
<blockquote>
<p>brett please review puppet branch 8014-rails-postinst-scripts-wip</p>
<p>otherwise puppet will undo any changes we propose</p>
</blockquote>
<p>In the last change to the Workbench module, the last switch to www-data isn't quoted. Would that be a syntax issue?</p>
<p>Besides that, this is fine to merge. As discussed, what would be even better is to have this whole tree owned by root:www-data, with 0750 permissions for directories and 0640 permissions for files.</p> Arvados - Task #8036: Review arvados-dev branch 8014-rails-postinst-scripts-wiphttps://dev.arvados.org/issues/8036?journal_id=338732016-01-05T15:00:32ZNico César
<ul></ul><p>merged 8014-rails-postinst-scripts-wip on puppet ...</p>
<p>now I'm building new packages to review 15d90bd57ef3f2e284579bafd8815ceaf33484ed to see how it behaves in c97qk</p> Arvados - Task #8036: Review arvados-dev branch 8014-rails-postinst-scripts-wiphttps://dev.arvados.org/issues/8036?journal_id=338922016-01-05T18:30:28ZNico César
<ul></ul><p>Nico Cesar wrote:</p>
<blockquote>
<p>merged 8014-rails-postinst-scripts-wip on puppet ...</p>
<p>now I'm building new packages to review 15d90bd57ef3f2e284579bafd8815ceaf33484ed to see how it behaves in c97qk</p>
</blockquote>
<p>I found this after installing:</p>
<pre>
c97qk:~# ls -l /etc/arvados/api/ -d
drwxr-x--- 2 root root 4096 Jan 4 20:22 /etc/arvados/api/
c97qk:~# ls -l /etc/arvados/ -d
drwxr-x--- 3 root root 4096 Oct 16 15:13 /etc/arvados/
</pre>
<p>Which as far as I can tell was how it was supposed to work... since puppet cant run on those servers to repair it (because now is a DOWNGRADED status and puppet cant see #6623 ) I did it manually</p>
<p>But for the record this merge LGTM ... after merging we need to enable <a class="external" href="https://ci.curoverse.com/view/Arvados%20build%20pipeline/job/deploy-to-c97qk/">https://ci.curoverse.com/view/Arvados%20build%20pipeline/job/deploy-to-c97qk/</a> again.</p> Arvados - Task #8036: Review arvados-dev branch 8014-rails-postinst-scripts-wiphttps://dev.arvados.org/issues/8036?journal_id=338932016-01-05T18:36:53ZNico César
<ul><li><strong>Assigned To</strong> changed from <i>Nico César</i> to <i>Brett Smith</i></li></ul> Arvados - Task #8036: Review arvados-dev branch 8014-rails-postinst-scripts-wiphttps://dev.arvados.org/issues/8036?journal_id=341862016-01-11T22:20:11ZBrett Smithbrett.smith@curii.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li><li><strong>% Done</strong> changed from <i>0</i> to <i>100</i></li><li><strong>Remaining (hours)</strong> set to <i>0.0</i></li></ul><p>Applied in changeset arvados-dev|commit:1e48d4f97d643b3a36f7856284e3a95430bc8f92.</p>