Skip to content
Snippets Groups Projects
Unverified Commit cbf807dd authored by Alexandru-Mihai GHERGHESCU's avatar Alexandru-Mihai GHERGHESCU
Browse files

Add tokens per second information 

Output model tokens per second at the end of inference.
parent 0ee3b108
1 merge request!15Add inference code
Hide whitespace changes
Inline Side-by-side
Showing
with 7 additions and 1 deletion
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment