Skip to content

Commit

Permalink
doc: install unsloth.ai on GPSC7
Browse files Browse the repository at this point in the history
  • Loading branch information
SamuelLarkin committed Jun 14, 2024
1 parent 6410050 commit 674c644
Show file tree
Hide file tree
Showing 2 changed files with 20 additions and 5 deletions.
14 changes: 14 additions & 0 deletions docs/install.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
# Install
# Unsloth.ai
On GPSC7

* Set proxies(http and https) and correct `tmp` directories in `.profile`
* `nrc_profile.sh -c` : To update the profile
* Created user directory and set symlinks for `.cache` and `.conda`
* `conda create --name unsloth_env python=3.10`
* `source activate unsloth_env` : I didn't load moniconda module because that was introducing python 3.9 in the system path and I was not able to remove it.
* `conda install pytorch-cuda=12.1 pytorch cudatoolkit xformers -c pytorch -c nvidia -c xformers`
* `pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"`
* `pip install --no-deps trl peft accelerate bitsandbytes`
* I still got torch not found error, even though Step 7 was successful, so I just reinstalled it and then it worked.
* Launch jupyter in a job with `partition=gpu_a100`, `account=nrc_ict__gpu_a100` and `qos=low`
11 changes: 6 additions & 5 deletions mkdocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -36,10 +36,10 @@ theme:
- rust
- yaml
shortcuts:
help: 191 # ?
next: 78 # n
help: 191 # ?
next: 78 # n
previous: 80 # p
search: 83 # s
search: 83 # s
plugins:
- search
- macros
Expand All @@ -50,8 +50,8 @@ extra:
default: stable
markdown_extensions:
- admonition
# - pymdownx.details
# - pymdownx.superfences
# - pymdownx.details
# - pymdownx.superfences
- toc:
permalink: true
nav:
Expand All @@ -60,6 +60,7 @@ nav:
- Configuration File Explained: config_files.md
- fzf: fzf.md
- git: git.md
- install: install.md
- json: json.md
- Miller: milller.md
- Miscellaneous: doc.md
Expand Down

0 comments on commit 674c644

Please sign in to comment.