Skip to content

Commit

Permalink
Update docs/howto/features/dask.md
Browse files Browse the repository at this point in the history
Co-authored-by: Erik Sundell <erik.i.sundell@gmail.com>
  • Loading branch information
GeorgianaElena and consideRatio authored Apr 3, 2024
1 parent 42a6413 commit e084db4
Showing 1 changed file with 13 additions and 8 deletions.
21 changes: 13 additions & 8 deletions docs/howto/features/dask.md
Original file line number Diff line number Diff line change
Expand Up @@ -42,14 +42,19 @@ AWS, and we can configure a node group there for the dask pods to run onto.

```
dask_nodes = {
# A not yet fully established policy is being developed about using a single
# node pool, see https://github.com/2i2c-org/infrastructure/issues/2687.
"n2-highmem-16" : {
min : 0,
max : 200,
machine_type : "n2-highmem-16",
},
}
local daskNodes = [
// Node definitions for dask worker nodes. Config here is merged
// with our dask worker node definition, which uses spot instances.
// A `node.kubernetes.io/instance-type label is set to the name of the
// *first* item in instanceDistribution.instanceTypes, to match
// what we do with notebook nodes. Pods can request a particular
// kind of node with a nodeSelector
//
// A not yet fully established policy is being developed about using a single
// node pool, see https://github.com/2i2c-org/infrastructure/issues/2687.
//
{ instancesDistribution+: { instanceTypes: ["r5.4xlarge"] }},
];
```

2. Render the `.jsonnet` file into a `.yaml` file that `eksctl` can use
Expand Down

0 comments on commit e084db4

Please sign in to comment.