Skip to content
Snippets Groups Projects
Commit 3e73ef2f authored by Vlad-Andrei BĂDOIU (78692)'s avatar Vlad-Andrei BĂDOIU (78692)
Browse files

Add distributed training lab

parent 1c10fdde
No related branches found
No related tags found
No related merge requests found
Pipeline #91074 passed
......@@ -18,7 +18,7 @@
- [2. The Transformer](lab2_transformer/lab2_transformer.md)
- [Distributed Training]()
- [3. Distributed Training](lab_training.md)
----
- [Datacenter Networking]()
......
This diff is collapsed.
# 2. The Transformer
Today's lab is about seeing distributed training in action, moving from the previous lab.
We'll run it on a GPU and train a model to tell [tiny
stories](https://arxiv.org/abs/2305.07759). Please follow the [jupyer lab](https://gitlab.cs.pub.ro/dcc1/dcc1.pages.upb.ro/-/blob/main/src/lab_training/Lab5-Distributed-training.ipynb)
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment