Restructure project
Reorganize the folder structure to make the project look like an actual library. Move training example outside of framework code.
parent
83f7b518
No related branches found
No related tags found
Showing
- llama32K.model 0 additions, 0 deletionsllama32K.model
- optimus/dataloader.py 3 additions, 3 deletionsoptimus/dataloader.py
- optimus/datasets/__init__.py 2 additions, 0 deletionsoptimus/datasets/__init__.py
- optimus/datasets/tinystories.py 1 addition, 1 deletionoptimus/datasets/tinystories.py
- optimus/datasets/wikitext103.py 1 addition, 1 deletionoptimus/datasets/wikitext103.py
- optimus/models/__init__.py 1 addition, 0 deletionsoptimus/models/__init__.py
- optimus/models/optimus.py 1 addition, 1 deletionoptimus/models/optimus.py
- optimus/tokenizers/__init__.py 1 addition, 0 deletionsoptimus/tokenizers/__init__.py
- optimus/tokenizers/sentencepiece.py 3 additions, 3 deletionsoptimus/tokenizers/sentencepiece.py
- optimus/trainer.py 2 additions, 1 deletionoptimus/trainer.py
- optimus16K-wikitext103.model 0 additions, 0 deletionsoptimus16K-wikitext103.model
- optimus60K-wikitext103.model 0 additions, 0 deletionsoptimus60K-wikitext103.model
- training.py 12 additions, 12 deletionstraining.py
Loading
Please register or sign in to comment