-
- Downloads
Adapt optimus to Distributon
This commit adapts the existing code to use the distributed library via a config option. To achieve this we switch to using Pytorch's dataloader.
parent
6d3a3004
No related branches found
No related tags found
Showing
- optimus/dataloader.py 0 additions, 185 deletionsoptimus/dataloader.py
- optimus/datasets/prepare_dataset.py 0 additions, 0 deletionsoptimus/datasets/prepare_dataset.py
- optimus/datasets/tinystories.py 22 additions, 8 deletionsoptimus/datasets/tinystories.py
- optimus/trainer.py 41 additions, 20 deletionsoptimus/trainer.py
- training.py 32 additions, 10 deletionstraining.py
Loading
Please register or sign in to comment