Add inference code

Pull Request Title

Description

Wants to merge: vladb/inferencev2 into main

Type of change

• Bug fix
• New feature
• Enhancement
• Documentation update
• Other (specify right below)

Merge request commits

• Add inference code

Signed-off-by: Vlad-Andrei Badoiu vlad_andrei.badoiu@upb.ro

Related Issues

Screenshots or GIFs

Checklist

• I have tested the code with the changes manually.
• My code follows the project's style guidelines.
• I have documented my code for others to understand.
• I have updated documentation as needed (including README.md, code comments and doc strings).

Reviewer Guidelines

Additional Notes

@mentions