arXiv cs.CL July 9, 2026 · Papers

Riemannian Geometry for Pre-trained Language Model Embeddings

arXiv:2607.07047v1 Announce Type: new Abstract: Understanding the geometric structure of pre-trained language model embeddings matters for interpretability and safety. We ask whether sentence-level classification signal lives in the Riemannian geometry of contextual token embeddings, and probe it by extracting per-toke