Follow up: GPT-2's vocabulary as a hyperbolic tree — 32,070 tokens in a Poincaré ball you can fly through [P]

Short summary

An interactive visualization maps all 32,070 tokens of GPT-2-small's vocabulary into a Poincaré ball, exploiting the fact that token similarity forms a forest structure that embeds naturally in hyperbolic space. The tool runs entirely client-side in a single HTML file with no training or optimization — the layout is constructed exactly from raw token embeddings. Users can rotate, zoom, and tap tokens to navigate via Möbius translations, revealing clusters like days of the week or the isolated dense inner shell of generic tokens.

• •Interactive 3D visualization of GPT-2's 32,070 tokens embedded in a Poincaré ball
• •Uses raw token embeddings laid out exactly in hyperbolic space — no training involved
• •Runs client-side in a single HTML file; supports touch navigation via Möbius translations

Generated with AI, which can make mistakes.