Merge branch 'feature/folder_structure' into 'main'
Restructure project See merge request !13
No related branches found
No related tags found
Showing
- LICENSE 176 additions, 0 deletionsLICENSE
- README.md 35 additions, 18 deletionsREADME.md
- llama32K.model 0 additions, 0 deletionsllama32K.model
- optimus/dataloader.py 3 additions, 3 deletionsoptimus/dataloader.py
- optimus/datasets/__init__.py 2 additions, 0 deletionsoptimus/datasets/__init__.py
- optimus/datasets/tinystories.py 1 addition, 1 deletionoptimus/datasets/tinystories.py
- optimus/datasets/wikitext103.py 1 addition, 1 deletionoptimus/datasets/wikitext103.py
- optimus/models/__init__.py 1 addition, 0 deletionsoptimus/models/__init__.py
- optimus/models/optimus.py 1 addition, 1 deletionoptimus/models/optimus.py
- optimus/tokenizers/__init__.py 1 addition, 0 deletionsoptimus/tokenizers/__init__.py
- optimus/tokenizers/sentencepiece.py 3 additions, 3 deletionsoptimus/tokenizers/sentencepiece.py
- optimus/trainer.py 2 additions, 1 deletionoptimus/trainer.py
- optimus16K-wikitext103.model 0 additions, 0 deletionsoptimus16K-wikitext103.model
- optimus60K-wikitext103.model 0 additions, 0 deletionsoptimus60K-wikitext103.model
- training.py 12 additions, 12 deletionstraining.py
Loading
Please register or sign in to comment