Skip to content

Enhancement: Progress bar for tokenization, dataset download

Currently, tokenization and dataset downloads don't have progress bars, though they are time-consuming operations, and it would be nice to see how much they last.

Training uses fast.ai's progressbar display, though a simpler / faster / more versatile / better suited solution would be nicer (e.g. tqdm).