Skip to content

Added whisper.cpp model size selection#204

Open
ericmason wants to merge 1 commit intoSuperCmdLabs:mainfrom
ericmason:feat/whispercpp-model-sizes
Open

Added whisper.cpp model size selection#204
ericmason wants to merge 1 commit intoSuperCmdLabs:mainfrom
ericmason:feat/whispercpp-model-sizes

Conversation

@ericmason
Copy link
Copy Markdown
Contributor

Summary

  • Adds a Model Size dropdown in Settings > AI > Whisper for whisper.cpp: tiny (~39MB), base (~140MB), small (~466MB), medium (~1.5GB), large (~2.9GB)
  • Red validation border + warning message when the selected model hasn't been downloaded yet
  • Model size is cached in memory to avoid repeated disk reads on every transcription call
  • Cache is invalidated when the setting changes

Changes

  • settings-store.ts — added whisperCppModelSize to AISettings interface and defaults
  • main.ts — replaced hardcoded WHISPERCPP_MODEL_NAME with cached getWhisperCppModelSize(), captured size once in download function to prevent mid-download inconsistency
  • electron.d.ts — added whisperCppModelSize to renderer-side type
  • AITab.tsx — model size dropdown with red border validation for undownloaded models
  • en.json — i18n strings with model descriptions and file sizes

Test plan

  • Select each model size — verify the download card reflects the correct model
  • Select a model that isn't downloaded — red border and warning appear
  • Download a non-default model — verify it downloads the correct size
  • Dictate with different model sizes — verify transcription works
  • Restart app — verify the model size selection persists

🤖 Generated with Claude Code

Users can now choose their whisper.cpp model size in Settings > AI >
Whisper. Larger models are more accurate but use more RAM and
transcribe slower. The dropdown shows a red validation warning when
the selected model hasn't been downloaded yet.

- Replaced hardcoded 'base' model with dynamic size from settings
- Cached model size to avoid repeated disk reads on every transcription
- Cache invalidated when setting changes
- Added model size dropdown with file sizes and descriptions

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@shobhit99
Copy link
Copy Markdown
Contributor

Hi @ericmason tested this out. the model selection works. there's one issue tho. downloading large model returns 404

Also can you add an option to delete the model as well. people might try out the 4gb version if it's too slow they might want to free up the space

image

@shobhit99
Copy link
Copy Markdown
Contributor

@ericmason can you fix the conflict and the 404 issue, also another user had made a change for checking the sha hash for the downloaded model with the static hash we have in code. can you also add that for all of these models

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants