From 3ab5c4fda0b94869e359433ebe377ee20d8bce6a Mon Sep 17 00:00:00 2001 From: Alexandru Gherghescu <gherghescu_alex1@yahoo.ro> Date: Thu, 25 Jan 2024 23:27:43 +0200 Subject: [PATCH] Add inference docs to README.md --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index d426eed..72f6441 100644 --- a/README.md +++ b/README.md @@ -12,8 +12,8 @@ to adapt as needed. Also see [Custom training](#custom-training). ### Inference After training a model (or getting hold of one from other sources), there's an -example on how to run inference can be found in `inference.py`. Feel free to -adapt as needed. +example on how to run inference in `inference.py`. It uses nucleus sampling, +with adjustable top-p threshold and temperature values. ## Basic building blocks -- GitLab