Skip to content

docs(tokenizers): retain byte alphabet for byte-level BPE round trips… - #1367

Open
Rifa-111 wants to merge 1 commit into
huggingface:mainfrom
Rifa-111:fix/byte-level-bpe-alphabet-775
Open

Rifa-111 wants to merge 1 commit into
huggingface:mainfrom
Rifa-111:fix/byte-level-bpe-alphabet-775

Conversation

@Rifa-111

@Rifa-111 Rifa-111 commented Nov 7, 2026

Copy link
Copy Markdown

… (refs #775)

@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants