S

sched-sim

Project information

vLLM scheduler simulator. Simulates batched inputs and runtime performance, without running any model, based on observed runtime performance of real runs.

21 Commits
1 Branch
0 Tags

README

Created on

February 20, 2025

Loading