Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make sharded arrays written by other implementations readable. #46

Merged
merged 3 commits into from
Jul 25, 2024

Conversation

zoj613
Copy link
Owner

@zoj613 zoj613 commented Jul 24, 2024

closes #45

Since bigarrays are limited to signed 64bit, sharding indexed could not correctly read arrays using $2^{64} -1$ index values to represent empty inner chunks. this commit fixes that issue.

@zoj613 zoj613 added bug Something isn't working codecs relating to codecs refactoring labels Jul 24, 2024
Copy link

codecov bot commented Jul 24, 2024

Codecov Report

Attention: Patch coverage is 98.91304% with 1 line in your changes missing coverage. Please review.

Project coverage is 97.62%. Comparing base (1566937) to head (9ec68ba).

Files Patch % Lines
lib/codecs/codecs.ml 85.71% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main      #46      +/-   ##
==========================================
+ Coverage   97.56%   97.62%   +0.05%     
==========================================
  Files          13       13              
  Lines        1150     1177      +27     
==========================================
+ Hits         1122     1149      +27     
  Misses         28       28              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Since bigarrays are limited to signed 64bit, sharding indexed could
not correctly read arrays using $2^{64} -1$ index values to represent
empty inner chunks. this commit fixes that issue.
This is to help the type checker rule out ShardingIndexed codec
when pattern matching on array->bytes codecs used for the index_codec
chain.
@zoj613 zoj613 merged commit 56a7174 into main Jul 25, 2024
4 checks passed
@zoj613 zoj613 deleted the shardindex branch July 25, 2024 19:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working codecs relating to codecs refactoring
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Shard index maximum value is currently limited to 2^63 - 1
1 participant