Whole experts, layer 0 at top

Expert 0127

Attention heads

Head 031

Up close

The cat persona, exploredThe user persona, exploredLayer 26 key/value group 0: I am a userLayer 15 whole attention: a group or team