Bug #4943

[Workbench] [Performance] Combining big collections should start returning a response faster (currently you can get a 502 proxy error even if the collection still combines)

Added by Bryan Cosca over 4 years ago. Updated about 4 years ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
Workbench
Target version:
Start date:
01/08/2015
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

i.e. I combined qr1hi-4zz18-ms5x87xf1389ldv + qr1hi-4zz18-0q225z4ktr432mg + qr1hi-4zz18-i5o4ba4mmxub69b and encountered a bad gateway error but then i found qr1hi-4zz18-7c0e8fyo871279e in my project.

I thought this was interesting because if I encountered any error while doing this, I thought the whole process would stop... but it didn't.

Proposed resolution

Once #5781 closes, Workbench should use those new API methods instead of [using the Ruby SDK] to manipulate the manifest itself.


Related issues

Related to Arvados - Bug #4953: [Workbench] [dup] Time out error for renaming a collection with a lot (300+?) filesResolved01/09/2015

Related to Arvados - Bug #5096: [Workbench] Avoid passing manifest_text around the network too much when updating and merging large collections.Resolved02/14/2015

Related to Arvados - Feature #5104: [SDKs] Add Ruby SDK methods for manipulating collection contents (rename, delete, copy file from another collection)Resolved03/08/2015

Related to Arvados - Bug #5614: [Workbench] 504 error returned when trying to create a large new collectionNew03/31/2015

Blocked by Arvados - Story #5781: [API] [DRAFT] Provide API methods for manipulating and combining collectionsIn Progress04/21/2015

Associated revisions

Revision 43aa02f5
Added by Brett Smith about 4 years ago

Merge branch '5614-workbench-optimize-combine-collections-wip'

Refs #5614, #4943. Closes #5686.

History

#1 Updated by Bryan Cosca over 4 years ago

  • Description updated (diff)

#2 Updated by Tom Clegg over 4 years ago

  • Subject changed from Combining big collections results in a 502 error but the collection still combines to [Workbench] Combining big collections should be faster (currently you can get a 502 proxy error even if the collection still combines)

#3 Updated by Brett Smith over 4 years ago

  • Subject changed from [Workbench] Combining big collections should be faster (currently you can get a 502 proxy error even if the collection still combines) to [Workbench] Combining big collections should start returning a response faster (currently you can get a 502 proxy error even if the collection still combines)
  • Category set to Workbench
  • Target version set to Bug Triage

#4 Updated by Brett Smith over 4 years ago

  • Target version deleted (Bug Triage)

#5 Updated by Tom Clegg over 4 years ago

  • Tracker changed from Story to Bug

#6 Updated by Tom Clegg about 4 years ago

  • Target version set to Arvados Future Sprints

#7 Updated by Tom Clegg about 4 years ago

  • Description updated (diff)

#8 Updated by Radhika Chippada about 4 years ago

  • Subject changed from [Workbench] Combining big collections should start returning a response faster (currently you can get a 502 proxy error even if the collection still combines) to [Workbench] [Performance] Combining big collections should start returning a response faster (currently you can get a 502 proxy error even if the collection still combines)

Also available in: Atom PDF