-
Notifications
You must be signed in to change notification settings - Fork 23
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Binder #6
Conversation
echunk = _encode_chunk( | ||
data_chunk.tobytes(), filters=arr_meta["filters"], compressor=arr_meta["compressor"], | ||
) | ||
return Response(echunk, media_type="application/octet-stream") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@andersy005 - I didn't mean to commit these changes here but I'll show them off anyways. This doesn't seem to work on its own but I think its a reasonable start toward making the chunk retrieval async friendly. Thoughts?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This doesn't seem to work on its own
What are the missing pieces?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just that we aren't managing to retrieve keys asynchronously. If you watch the task stream, we never use two workers at the same time on the server side.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
see #7
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is looking great! In the future, it would be nice to have a short screencast, gif, video that showcase this in action
echunk = _encode_chunk( | ||
data_chunk.tobytes(), filters=arr_meta["filters"], compressor=arr_meta["compressor"], | ||
) | ||
return Response(echunk, media_type="application/octet-stream") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This doesn't seem to work on its own
What are the missing pieces?
Add's binder configs.
A simple app is deployed on launch (available at 0.0.0.0:9000).
I've updated the demo notebook to point at this app.