Actions
Bug #12947
closed
Intelligently merge SGLF files
Story points:
-
Description
The current SGLF merge tool loads both the source and the SGLF to be merged fully into memory and then merges. This method runs into memory exhaustion issues when dealing with large SGLF files.
A better method is to only load a tile positions worth of SGLF from each (assuming each stream is sorted) and then emit the merged result. This should mitigate many of the memory issues.
Updated by Abram Connelly about 6 years ago
- Status changed from New to Resolved
This has been created with the new merge-sglf.cpp code.
Actions