0.19.1 Changelogο
0.19.1ο
Released: March 22, 2021postprocessingο
Use a map of dask delayed function to combine parquets instead of a giant dask df to avoid memory issues. Default to 85GB memory nodes in eagle with single process and single thread in each node to avoid memory issues.
References: pull request 212