Arvados

Bug #21031

Updated by Brett Smith 9 months ago

Sometime in Since the last week, first #18874 merge, most of our test-provision jobs are failing like this: 

 <pre>    Name: curl -s -L http://get.rvm.io | bash -s stable - Function: cmd.run - Result: Changed Started: - 05:41:59.444421 Duration: 3346.004 ms 
   Name: ruby-2.7.2 - Function: rvm.installed - Result: Changed Started: - 05:42:02.794050 Duration: 19877.371 ms 
   Name: arvados-api-package-install-gems-deps-pkg-installed - Function: pkg.installed - Result: Changed Started: - 05:42:22.671973 Duration: 7715.731 ms 
   Name: arvados-cli - Function: gem.installed - Result: Changed Started: - 05:42:30.393352 Duration: 176696.635 ms 
   Name: arvados-api-server - Function: pkg.installed - Result: Changed Started: - 05:45:27.102923 Duration: 57970.474 ms 
   Name: nginx - Function: service.running - Result: Changed Started: - 05:46:25.110546 Duration: 1626.836 ms 
   Name: arvados-controller-package-install-gems-deps-pkg-installed - Function: pkg.installed - Result: Clean Started: - 05:46:26.740569 Duration: 349.975 ms 
   Name: arvados-cli - Function: gem.installed - Result: Clean Started: - 05:46:27.093146 Duration: 656.533 ms 
   Name: arvados-controller - Function: pkg.installed - Result: Changed Started: - 05:46:27.751995 Duration: 4402.48 ms 
   Name: arvados-controller - Function: service.running - Result: Changed Started: - 05:46:32.205163 Duration: 941.021 ms 
 ---------- 
           ID: arvados-controller-service-running-service-ready-cmd-run 
     Function: cmd.run 
         Name: while ! (curl -k -s https://dbn10.local:8800 | \ 
          grep -qE "req-[a-z0-9]{20}.{5}error_token") do 
   echo 'waiting for API to be ready...' 
   sleep 1 
 done 

       Result: False 
      Comment: Command "while ! (curl -k -s https://dbn10.local:8800 | \ 
                        grep -qE "req-[a-z0-9]{20}.{5}error_token") do 
                 echo 'waiting for API to be ready...' 
                 sleep 1 
               done 
               " run 
      Started: 05:46:33.150493 
     Duration: 121883.032 ms 
      Changes:    
               ---------- 
               pid: 
                   3898 
               retcode: 
                   1 
               stderr: 
               stdout: 
                   while ! (curl -k -s https://dbn10.local:8800 | \ 
                            grep -qE "req-[a-z0-9]{20}.{5}error_token") do 
                     echo 'waiting for API to be ready...' 
                     sleep 1 
                   done 
                    : Timed out after 120 seconds 
   Name: nginx - Function: service.mod_watch - Result: Changed Started: - 05:48:35.038389 Duration: 47.401 ms 

 Summary for local 
 -------------- 
 Succeeded: 150 (changed=116) 
 Failed:        1 
 -------------- 
 Total states run:       151 
 Total run time:     533.364 s 
 Build step 'Execute shell' marked build as failure 
 </pre> 

 This includes the jobs for debian10, ubuntu1804, and ubuntu2004. Note debian11 is working fine.

Back