-
Notifications
You must be signed in to change notification settings - Fork 29
Open
Description
Take the given test:
$usage = memory()[1];
$provider = new \Yethee\Tiktoken\EncoderProvider;
$provider->setVocabCache(storage_path('app'));
$encoder = $provider->getForModel('gpt-4o-mini');
dd(memory()[1]-$usage); // 26mb! 26mb seems a bit much no? Especially considering the cached vocab is only 3.6mb.
Metadata
Metadata
Assignees
Labels
No labels