diff --git a/README.md b/README.md index d426eed8da1f7987403f508faace51e76d863046..72f6441766a3c11ef32757db0326b8052b7b8d37 100644 --- a/README.md +++ b/README.md @@ -12,8 +12,8 @@ to adapt as needed. Also see [Custom training](#custom-training). ### Inference After training a model (or getting hold of one from other sources), there's an -example on how to run inference can be found in `inference.py`. Feel free to -adapt as needed. +example on how to run inference in `inference.py`. It uses nucleus sampling, +with adjustable top-p threshold and temperature values. ## Basic building blocks