Project

General

Profile

Feature #11015

Updated by Tom Morris about 7 years ago

To improve throughput of crunch-run job output uploading, add support for multi-threaded asynchronous transfers to hide the latency inherent in cloud environments. 

 Implementation detail: 
 - Move WriteTree() from crunch-run to the Go SDK so that this feature can be reused in other programs and add pipelined writes to increase throughput.

Back