Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

O

Optimus Prime
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Iterations
- Wiki
- Requirements
- Environments
- Terraform modules
- Incidents

Snippets Groups Projects

2e627e6b

Commit 2e627e6b authored 1 year ago by Vlad-Andrei BĂDOIU (78692)

Downloads
- Patches
- Plain Diff

Switch to PyTorch Dataloader

parent 0faac554

No related branches found

No related tags found

Loading

Checking pipeline status

Changes 7
Pipelines 1

Hide whitespace changes

Inline Side-by-side

Showing

optimus/dataloader.py 115 additions, 155 deletions

optimus/dataloader.py
optimus/datasets/__init__.py 0 additions, 2 deletions

optimus/datasets/__init__.py
optimus/datasets/dataset_utils.py 0 additions, 62 deletions

optimus/datasets/dataset_utils.py
optimus/datasets/tinystories.py 0 additions, 130 deletions

optimus/datasets/tinystories.py
optimus/datasets/wikitext103.py 0 additions, 120 deletions

optimus/datasets/wikitext103.py
optimus/trainer.py 19 additions, 17 deletions

optimus/trainer.py
training.py 25 additions, 14 deletions

training.py

with 159 additions and 500 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment