[Feature]: validation endpoint

[fedor-konovalenko]

🚀 The feature, motivation and pitch

We propose moving inference validation from the Gonka repository to this repository. This will simplify the project structure and allow validation to be performed on a separate, unified vllm endpoint. An example of the endpoint implementation is provided in our fork , an example of using - is available here - it is necessary to set THRESHOLD in CLI args. And the test script is available here.

Alternatives

No response

Additional context

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[Malder-coder]

Hi! I would like to work on this issue. I will implement the unified vllm validation endpoint as requested. ETA: 5-7 days. Please assign it to me if possible.