llm

CUDA installation

• First check which version of CUDA toolkit is available for the version of pytorch you are going to use here https://pytorch.org/get-started/locally/

• We are using the stable version of pytorch (2.4.0) which is compatible in Windows with CUDA 12.4 pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124

https://docs.nvidia.com/cuda/cuda-quick-start-guide/index.html