Skip to content
Snippets Groups Projects

Compute/memory requirements scripts

Open Alexandru-Mihai GHERGHESCU requested to merge feature/scripts into main
+ 6
2
@@ -24,8 +24,12 @@ information for both newcomers as well as any other interesting new research:
models.
- [Datasets for training](doc/datasets.md): Available online datasets used to
train (open-source and other) language models
- [Scripts](scripts/): All sorts of useful scripts, such as estimations for
memory and compute requirements for training language models.
There are also a number of scripts to calculate various things, or otherwise
interact in some way with the knowledge described in the docs:
- [Memory and compute estimations](scripts/memory_compute_estimations/):
Estimates and requirements for memory and compute for training large language
models, given a number of tunable hyperparameters
## The rest of the repositories
Loading