First Preview of Kluster - DASK Clusters in Arkitekt #6
jhnnsrs
announced in
Announcements
Replies: 1 comment 1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Introducing Kluster
As stated in the Documentation Arkitekt aims not to be a replacement for existing highly parlellized computing platforms like the amazing Dask, but wants to provide more usable interfaces to interact with them.
With Kluster we provide a first way to interface with more dedicated high performance computing platforms. Building on the amazing Dask Gateway, Kluster is a WIP of the integration of Dask Clusters into Arkitekt.
Features
Completely Integrated Cluster Management with JWT Authentication
Manage Dask Clusters on a per User/App basis
Connect to SLURM and PBS (and potentially Kubernetes) (highly experimental)
Use the familiar Args, Kwargs Syntax to allow apps to accept a Dask Cluster
"Zero" Configuration and integratable into standard Arkiekt Deployment
Video
Here's a very early version of it in action.
cluster_yes.webm
Roadmap
Beta Was this translation helpful? Give feedback.
All reactions