Hacker News

Favorites Setup
☰
Comment by mrkn1 | original | Retrofitting language models to operate over bytes
[−]mrkn1 · 2026-10-11 Sun 09:34 UTC · link
subword tokenizers were never causal in the first place, so BPE was peeking at future bytes all along! TIL