Feature #11015

Updated by Tom Morris over 2 years ago

To improve throughput of crunch-run job output uploading, add support for multi-threaded asynchronous transfers to hide the latency inherent in cloud environments.

Implementation detail:
-
Move WriteTree() from crunch-run to the Go SDK so that this feature can be reused in other programs and add pipelined writes to increase throughput.

Back