Project

General

Profile

Actions

Bug #2739

closed

Crunch script queues only 101 tasks out of 888

Added by Abram Connelly over 10 years ago. Updated over 10 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Story points:
0.5

Description

I am using the crunch script example 'grep' (https://github.com/curoverse/arvados/blob/master/crunch_scripts/grep) on the collection 'bb0c7327a6f35f5c7ed57dd9daf57704+95209'. There should be 888 files in that collection, but when I try to run the crunch script, it looks like only 101 tasks get queued.

Here is a copy of my pipeline template that I use

{
"name": "stamina frazzling Vernon",
"components": {
"sureties": {
"script_parameters": {
"input": "bb0c7327a6f35f5c7ed57dd9daf57704+95209",
"pattern" : "cagtgagttaacatatttgaagtgcttaaaaATGAGGCT"
},
"script_version": "master",
"repository": "abram",
"script": "test/para/grep"
}
}
}

I use the pipeline instance: qr1hi-d1hrv-ivuscfii9d0zcsq .

On lightning-dev2.shell.arvados, I run the following:

arv pipeline run --no-reuse --run-here --template qr1hi-d1hrv-ivuscfii9d0zcsq

From the output of the above command, I see 101 jobs total that are done, running or todo (none fail). From the output screen from the workbench, I see 100-101 files. Also from the workbench, I see the logs indicate that there are only 100 child tasks.


Related issues 1 (0 open1 closed)

Related to Arvados - Support #2772: Recurring: Support beta usersResolvedBrett SmithActions
Actions #1

Updated by Tom Clegg over 10 years ago

  • Target version set to 2014-05-28 Pipeline Factory
Actions #2

Updated by Tom Clegg over 10 years ago

  • Story points set to 0.5
Actions #3

Updated by Brett Smith over 10 years ago

  • Assigned To set to Brett Smith
Actions #4

Updated by Brett Smith over 10 years ago

  • Status changed from New to Resolved
  • % Done changed from 0 to 100

Applied in changeset arvados|commit:16af0b22def5b80a1861788907a2fc45b14e3273.

Actions

Also available in: Atom PDF