In addition to having a timeout value in minutes, it'd be great to stop evals if they exceed a certain number of turns/steps in the conversation.
In addition to having a timeout value in minutes, it'd be great to stop evals if they exceed a certain number of turns/steps in the conversation.