Bug #12416

keepstore does not work with s3_volume on Ceph RadosGW

Added by Joshua Randall 11 days ago. Updated 7 days ago.

Status:FeedbackStart date:10/08/2017
Priority:NormalDue date:
Assignee:Tom Clegg% Done:

0%

Category:Keep
Target version:-
Story points-
Velocity based estimate-

Description

keepstore does not include a `Content-Length: 0` header when attempting to create empty objects using the S3 API.

This is because an io.Reader is being created and passed (via goamz) to net.http even when the data is nil.

According to the net.http.Request.ContentLength documentation:

        // For client requests, a value of 0 with a non-nil Body is
        // also treated as unknown.

This means that if a non-nil io.Reader is given, a `ContentLength` of 0 will result in omitting the `Content-Length` header from the request, which results in requests to put empty objects to S3-like services such as Ceph RadosGW to fail (with HTTP status 411).

A PR that addresses this issue will be forthcoming.

Associated revisions

Revision 10487342
Added by Tom Clegg 7 days ago

Merge branch '12416-s3-empty-object'

refs #12416

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <>

History

#2 Updated by Tom Clegg 7 days ago

  • Status changed from New to Feedback
  • Assignee set to Tom Clegg

Also available in: Atom PDF