Skip to content
arXiv cs.CL · Papers

Token-Native Storage: Read and Write in your Agent's Language

arXiv:2608.02376v2 Announce Type: replace-cross Abstract: Search and database engines still store text as UTF-8, a format built for humans. But the systems that increasingly read and write that text (embedders, rerankers, and language-model agents) work with token IDs, not characters, so every access pays to translate