diff --git a/docs/install.md b/docs/install.md new file mode 100644 index 0000000..465948b --- /dev/null +++ b/docs/install.md @@ -0,0 +1,14 @@ +# Install +# Unsloth.ai +On GPSC7 + +* Set proxies(http and https) and correct `tmp` directories in `.profile` +* `nrc_profile.sh -c` : To update the profile +* Created user directory and set symlinks for `.cache` and `.conda` +* `conda create --name unsloth_env python=3.10` +* `source activate unsloth_env` : I didn't load moniconda module because that was introducing python 3.9 in the system path and I was not able to remove it. +* `conda install pytorch-cuda=12.1 pytorch cudatoolkit xformers -c pytorch -c nvidia -c xformers` +* `pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"` +* `pip install --no-deps trl peft accelerate bitsandbytes` +* I still got torch not found error, even though Step 7 was successful, so I just reinstalled it and then it worked. +* Launch jupyter in a job with `partition=gpu_a100`, `account=nrc_ict__gpu_a100` and `qos=low` diff --git a/mkdocs.yml b/mkdocs.yml index a7026fc..9253f42 100644 --- a/mkdocs.yml +++ b/mkdocs.yml @@ -36,10 +36,10 @@ theme: - rust - yaml shortcuts: - help: 191 # ? - next: 78 # n + help: 191 # ? + next: 78 # n previous: 80 # p - search: 83 # s + search: 83 # s plugins: - search - macros @@ -50,8 +50,8 @@ extra: default: stable markdown_extensions: - admonition -# - pymdownx.details -# - pymdownx.superfences + # - pymdownx.details + # - pymdownx.superfences - toc: permalink: true nav: @@ -60,6 +60,7 @@ nav: - Configuration File Explained: config_files.md - fzf: fzf.md - git: git.md + - install: install.md - json: json.md - Miller: milller.md - Miscellaneous: doc.md