Bug #7156

[SDK] arvados.arvfile.readall_decompressed() does not return all blocks on a file

Added by Sarah Guthrie almost 4 years ago. Updated over 3 years ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Start date:
08/28/2015
Due date:
% Done:

100%

Estimated time:
Story points:
-

Description

Raises StopIteration at the end of some blocks before the file ends.
Example file (on su92l): "0f187862ceac3dbedc339b2f16aa33cd+4629117/hu011C57.fj/011.fj.gz"

This file downloads correctly.

The following code returned an iterator that behaved correctly:

gzip.GzipFile(fileobj=cr.open('hu011C57.fj/011.fj.gz', 'r'))

Associated revisions

Revision 0c7f9737 (diff)
Added by Brett Smith over 3 years ago

7156/7852: Bugfix _filepos tracking in PySDK readline method.

Make sure self._filepos is always in the right position to return
uncached data before another read method could be called, to avoid
inconsistent results when interleaving those calls with readline
calls.

Closes #7156, #7852.

History

#1 Updated by Brett Smith over 3 years ago

  • Target version set to Arvados Future Sprints

#2 Updated by Brett Smith over 3 years ago

  • Status changed from New to Resolved
  • % Done changed from 0 to 100

Applied in changeset arvados|commit:0c7f9737786fd64177f8210585ec620402d0d9b6.

#3 Updated by Brett Smith over 3 years ago

  • Status changed from Resolved to New

The commit that closed this was a premature development commit. This is still open. Sorry.

Also available in: Atom PDF