Transformer Dimensions as Direct Semantic Registers: Training-Free Interpretability via Sign Patterns19. June 20264. July 2026AI ModelsSigns of individual dimensions in transformers carry semantic information and enable feature detection without training or rotation, opening a new path to mechanistic interpretability. Share on:
