Project

General

Profile

Actions

Bug #2739

closed

Crunch script queues only 101 tasks out of 888

Added by Abram Connelly almost 10 years ago. Updated almost 10 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Story points:
0.5

Description

I am using the crunch script example 'grep' (https://github.com/curoverse/arvados/blob/master/crunch_scripts/grep) on the collection 'bb0c7327a6f35f5c7ed57dd9daf57704+95209'. There should be 888 files in that collection, but when I try to run the crunch script, it looks like only 101 tasks get queued.

Here is a copy of my pipeline template that I use

{
"name": "stamina frazzling Vernon",
"components": {
"sureties": {
"script_parameters": {
"input": "bb0c7327a6f35f5c7ed57dd9daf57704+95209",
"pattern" : "cagtgagttaacatatttgaagtgcttaaaaATGAGGCT"
},
"script_version": "master",
"repository": "abram",
"script": "test/para/grep"
}
}
}

I use the pipeline instance: qr1hi-d1hrv-ivuscfii9d0zcsq .

On lightning-dev2.shell.arvados, I run the following:

arv pipeline run --no-reuse --run-here --template qr1hi-d1hrv-ivuscfii9d0zcsq

From the output of the above command, I see 101 jobs total that are done, running or todo (none fail). From the output screen from the workbench, I see 100-101 files. Also from the workbench, I see the logs indicate that there are only 100 child tasks.


Related issues

Related to Arvados - Support #2772: Recurring: Support beta usersResolvedBrett SmithActions
Actions

Also available in: Atom PDF