Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Minimize get_partial and set_partial calls. #52

Merged
merged 2 commits into from
Aug 22, 2024
Merged

Minimize get_partial and set_partial calls. #52

merged 2 commits into from
Aug 22, 2024

Commits on Aug 22, 2024

  1. Minimize get_partial & set_partial calls.

    calling these for every requested inner chunk of a shard is
    expensive can can lead to a `Unix.EMFILE` error. This commit
    attempts to minimize the number of calls by making sure these are
    called once on all requested inner chunks of a shard. This should
    lead to a significant decrease in the number of open files open
    for read/write at the same time when using a Zarr_lwt `FilesystemStore`.
    zoj613 committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    1b46a21 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    10b81e5 View commit details
    Browse the repository at this point in the history