Feature request: parameter max_output_tokens #1228

Activity

1. AyusKumarPathak commented on Jan 4, 2026

   

   AyusKumarPathak

   on Jan 4, 2026

   More actions

   @MatejRojec @joshdevins @nomagick @hanxiao @crazyurus
   Hello maintainers 👋

   I want to implement support for the max_output_tokens parameter.
   Solution plan:

   1. Add the new parameter in the API schema.
   2. Pass it downstream to the LLM inference call.
   3. Update tests to verify output truncation behavior.
   4. Update README/examples with usage.

   Please assign this to me if that’s okay.

   — AyusKumarPathak
2. nomagick commented on May 11, 2026

   

   nomagick

   on May 11, 2026

   Member

   More actions

   Solved. Now you can pass x-max-tokens: n where n needs to be > 500.
   

   reader/src/dto/crawler-options.ts

   Lines 254 to 257 in 6d96149

   	'X-Max-Tokens': {
   	description: 'Trim the response content at a maximum number of tokens.',
   	in: 'header',
   	schema: { type: 'string' }
3. nomagick

   closed this as completedon May 11, 2026