Skip to content
Snippets Groups Projects
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
  • 86251885 · Fix ARG to ENV in Dockerfile
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
  • b2f79e4b · Remove dialog script, update Dockerfiles
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
  • 78bed79d · Also mention the shared memory in the README file
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
  • e1cffcea · Fix shared memory error in Docker
Alexandru-Mihai GHERGHESCU's avatar
closed issue #1 "Out-of-Memory from context length caused by the KV cache?" at NetSys / LLaMA Docker images
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
  • b50cf31e · Fix bug where LLama 13B wasn't able to properly run
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
  • f8eee05d · Decrease context size to 2048, as otherwise the GPU goes OOM
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
  • 9c9a84fc · Nevermind, that don't work :/
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
  • bb3c6528 · Update old information, increase context length to 4096
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
  • 3eaa8cb4 · Update old information, increase context length to 4096
Alexandru-Mihai GHERGHESCU's avatar
commented on issue #1 "Out-of-Memory from context length caused by the KV cache?" at NetSys / LLaMA Docker images

Related article.

Vlad-Andrei BĂDOIU (78692)'s avatar
opened issue #1 "Out-of-Memory from context length caused by the KV cache?" at NetSys / LLaMA Docker images
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
  • fde316cc · Mention Nvidia driver being installed on cluster
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
  • 9cf520f3 · [fix] Add the tokenizer inside the Dockerfile recipe
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
  • fc41c4d2 · Remove pip cache after installing packages in the image
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
  • 0640ba48 · Fix README typos (again.. oops)
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images
  • fadb8a9c · Update README and Dockerfile to include everything in the image
Alexandru-Mihai GHERGHESCU's avatar
pushed to branch main at NetSys / LLaMA Docker images