Project

General

Profile

Bug #9702 ยป conformance-test-failures-in-crunch2.txt

Radhika Chippada, 08/03/2016 04:14 PM

 
1
(venv)radhika@shell.9tee4:~/cwl/common-workflow-language$ cat arv-run.sh 
2
#!/bin/sh
3
exec arvados-cwl-runner --compute-checksum --api containers "$@"
4

    
5
(venv)radhika@shell.9tee4:~/cwl/common-workflow-language$ ./run_test.sh RUNNER=./arv-run.sh
6
--- Running conformance test v1.0 on /home/radhika/cwl/common-workflow-language/arv-run.sh ---
7
/home/radhika/venv/bin/arvados-cwl-runner 1.0.20160728182727, arvados-python-client 0.1.20160721023501, cwltool 1.0.20160726135535
8
Test [6/73] Workflow or tool uses unsupported feature:
9
Generate files not supported
10
Test [10/73] Workflow or tool uses unsupported feature:
11
Stderr redirection currently not suppported
12
Test [11/73] Workflow or tool uses unsupported feature:
13
Stderr redirection currently not suppported
14
Test [12/73] Workflow or tool uses unsupported feature:
15
Stderr redirection currently not suppported
16
Test [13/73] Workflow or tool uses unsupported feature:
17
Stdin redirection currently not suppported
18
Test [18/73] Workflow or tool uses unsupported feature:
19
Stdin redirection currently not suppported
20
Test [21/73] 2016-08-03 14:30:39 arvados.cwl-runner[8889] ERROR: While getting final output object: No JSON object could be decoded
21
2016-08-03 14:30:39 arvados.cwl-runner[8889] WARNING: Overall process status is UnsupportedRequirement
22
Workflow or tool uses unsupported feature:
23
Check log for details.
24
Test [35/73] 2016-08-03 14:54:15 arvados.cwl-runner[11710] ERROR: While getting final output object: No JSON object could be decoded
25
2016-08-03 14:54:15 arvados.cwl-runner[11710] WARNING: Overall process status is UnsupportedRequirement
26
Workflow or tool uses unsupported feature:
27
Check log for details.
28
Test [36/73] Test failed: /home/radhika/cwl/common-workflow-language/arv-run.sh --outdir=/tmp/tmpc3berE --quiet v1.0/env-wf1.cwl v1.0/env-job.json
29
Test requirement priority
30
expected output object {
31
    "out": {
32
        "checksum": "sha1$b3ec4ed1749c207e52b3a6d08c59f31d83bff519",
33
        "class": "File",
34
        "location": "out",
35
        "size": 15
36
    }
37
}
38
 got {
39
    "out": {
40
        "basename": "out",
41
        "class": "File",
42
        "location": "keep:e44c7b6c572a790cda32c3b8ff288222+47/out",
43
        "size": 15
44
    }
45
}
46
Compare failure expected {
47
    "checksum": "sha1$b3ec4ed1749c207e52b3a6d08c59f31d83bff519",
48
    "class": "File",
49
    "size": 15
50
}
51
got {
52
    "class": "File",
53
    "size": 15
54
}
55
Test [37/73] Test failed: /home/radhika/cwl/common-workflow-language/arv-run.sh --outdir=/tmp/tmp7Rbd_j --quiet v1.0/env-wf2.cwl v1.0/env-job.json
56
Test requirements override hints
57
expected output object {
58
    "out": {
59
        "checksum": "sha1$cdc1e84968261d6a7575b5305945471f8be199b6",
60
        "class": "File",
61
        "location": "out",
62
        "size": 9
63
    }
64
}
65
 got {
66
    "out": {
67
        "basename": "out",
68
        "class": "File",
69
        "location": "keep:6b537bf2bb97bd4f5b14686b2f5457cd+45/out",
70
        "size": 9
71
    }
72
}
73
Compare failure expected {
74
    "checksum": "sha1$cdc1e84968261d6a7575b5305945471f8be199b6",
75
    "class": "File",
76
    "size": 9
77
}
78
got {
79
    "class": "File",
80
    "size": 9
81
}
82
Test [38/73] 2016-08-03 14:59:04 arvados.cwl-runner[12192] ERROR: While getting final output object: No JSON object could be decoded
83
2016-08-03 14:59:04 arvados.cwl-runner[12192] WARNING: Overall process status is UnsupportedRequirement
84
Workflow or tool uses unsupported feature:
85
Check log for details.
86
Test [39/73] Test failed: /home/radhika/cwl/common-workflow-language/arv-run.sh --outdir=/tmp/tmpzrhPwi --quiet v1.0/revsort.cwl v1.0/revsort-job.json
87
Test sample workflows from the specification
88
expected output object {
89
    "output": {
90
        "checksum": "sha1$b9214658cc453331b62c2282b772a5c063dbd284",
91
        "class": "File",
92
        "location": "output.txt",
93
        "size": 1111
94
    }
95
}
96
 got {
97
    "output": {
98
        "basename": "output.txt",
99
        "class": "File",
100
        "location": "keep:ed7aa65105811db1a01b2c5b3c001de9+58/output.txt",
101
        "size": 1111
102
    }
103
}
104
Compare failure expected {
105
    "checksum": "sha1$b9214658cc453331b62c2282b772a5c063dbd284",
106
    "class": "File",
107
    "size": 1111
108
}
109
got {
110
    "class": "File",
111
    "size": 1111
112
}
113
Test [40/73]
114

    
115

    
116
Test [41/73] 2016-08-03 15:03:38 arvados.cwl-runner[12891] ERROR: While getting final output object: No JSON object could be decoded
117
2016-08-03 15:03:38 arvados.cwl-runner[12891] WARNING: Overall process status is UnsupportedRequirement
118
Workflow or tool uses unsupported feature:
119
Check log for details.
120
Test [42/73] Workflow or tool uses unsupported feature:
121
Generate files not supported
122
Test [45/73] Test failed: /home/radhika/cwl/common-workflow-language/arv-run.sh --outdir=/tmp/tmptdNybC --quiet v1.0/schemadef-wf.cwl v1.0/schemadef-job.json
123
Test SchemaDefRequirement definition used in workflow parameter
124

    
125
expected output object {
126
    "output": {
127
        "checksum": "sha1$f12e6cfe70f3253f70b0dbde17c692e7fb0f1e5e",
128
        "class": "File",
129
        "location": "output.txt",
130
        "size": 12
131
    }
132
}
133
 got {
134
    "output": {
135
        "basename": "output.txt",
136
        "class": "File",
137
        "location": "keep:0615107d3b762bf17891133ceac58423+54/output.txt",
138
        "size": 12
139
    }
140
}
141
Compare failure expected {
142
    "checksum": "sha1$f12e6cfe70f3253f70b0dbde17c692e7fb0f1e5e",
143
    "class": "File",
144
    "size": 12
145
}
146
got {
147
    "class": "File",
148
    "size": 12
149
}
150
Test [46/73]
151

    
152
Test [50/73]
153

    
154
Test [53/73] 2016-08-03 15:19:07 arvados.cwl-runner[23331] ERROR: While getting final output object: No JSON object could be decoded                                                                                                                                                                                                                                                         2016-08-03 15:19:07 arvados.cwl-runner[23331] WARNING: Overall process status is UnsupportedRequirement
155
Workflow or tool uses unsupported feature:
156
Check log for details.
157
Test [64/73] Test failed: /home/radhika/cwl/common-workflow-language/arv-run.sh --outdir=/tmp/tmp9HP57r --quiet 'v1.0/conflict-wf.cwl#collision' v1.0/conflict-job.json
158
Test workflow two input files with same name.
159
expected output object {
160
    "fileout": {
161
        "checksum": "sha1$a2d8d6e7b28295dc9977dc3bdb652ddd480995f0",
162
        "class": "File",
163
        "location": "out.txt",
164
        "size": 25
165
    }
166
}
167
 got {
168
    "fileout": {
169
        "basename": "out.txt",
170
        "class": "File",
171
        "location": "keep:0e8e4042f19c03f0da52b90c2466e56c+51/out.txt",
172
        "size": 25
173
    }
174
}
175
Compare failure expected {
176
    "checksum": "sha1$a2d8d6e7b28295dc9977dc3bdb652ddd480995f0",
177
    "class": "File",
178
    "size": 25
179
}
180
got {
181
    "class": "File",
182
    "size": 25
183
}
184
Test [69/73] Workflow or tool uses unsupported feature:
185
Generate files not supported
186
Test [70/73] Workflow or tool uses unsupported feature:
187
Generate files not supported
188
Test [72/73] Workflow or tool uses unsupported feature:
189
Generate files not supported
190
Test [73/73] 5 failures, 15 unsupported features
191

    
192
1 tool tests failed
193

    
    (1-1/1)