Interactive Tokenizer Demo
Try wordchipper's BPE tokenizer directly in the browser via WebAssembly. Select a model, type some text, and click Encode & Decode to see the token IDs, roundtrip verification, and timing.
Loading WASM...
Try wordchipper's BPE tokenizer directly in the browser via WebAssembly. Select a model, type some text, and click Encode & Decode to see the token IDs, roundtrip verification, and timing.