Skip to content

Commit 99c9985

Browse files
committed
making the tokens per minute computation less sensitive
1 parent a36a1e5 commit 99c9985

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

‎include/hllm/roles/requestManager.hpp‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -198,7 +198,7 @@ class RequestManager final : public hLLM::Role
198198
const double avg_res_per_minute = resp_diff/time_diff_sec * 60.0;
199199

200200
// Update the prev_time if it was longer than a second
201-
if(time_diff_sec > 1.0)
201+
if(time_diff_sec > 10.0)
202202
{
203203
prev_time = now_time;
204204
prev_num_responses = num_responses;

0 commit comments

Comments
 (0)