From b2231df8fd4ca5fce8e7689f49a3496e4cc150be Mon Sep 17 00:00:00 2001 From: chris Date: Sat, 21 Sep 2024 10:56:21 +0200 Subject: [PATCH] =?UTF-8?q?docker/unsloth/README.md=20hinzugef=C3=BCgt?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- docker/unsloth/README.md | 30 ++++++++++++++++++++++++++++++ 1 file changed, 30 insertions(+) create mode 100644 docker/unsloth/README.md diff --git a/docker/unsloth/README.md b/docker/unsloth/README.md new file mode 100644 index 0000000..2ffbb55 --- /dev/null +++ b/docker/unsloth/README.md @@ -0,0 +1,30 @@ +# Unsloth in a docker container + +❗ Very important ❗ + +The complete docker image is designed for CUDA 12.1! +On the Host there has to be CUDA 12.1 and docker installed. + +Run `nvidia-smi` on the Host to see if you are using the right Conda version. + +![nvidia-smi](./assets/nvidiasmi.png) + +Build the container with: +```shell +docker build -t cuda-unsloth-jupyter . +``` + +And mount your directory to the ```/app``` path when starting. + +```shell +docker run --rm --gpus=all -v path_to_files:/app -d cuda-unsloth-jupyter +``` + +```--rm```: This flag automatically deletes the container after it exits, freeing up disk space and keeping the environment clean. Add the `-it` flag to run the container in interactive mode, giving you direct access to its shell. Use `-d` to detach the container and run it in the background. Combining `-itd` allows you to interact with the container initially, then detach, leaving it running in the background. + + +Currently tested with: + +| GPU Model | Memory (GB) | +|-------------|-------------| +| RTX 3090 Ti | 24 |