This is cool but I think a more fundamental primitive is the probability distribution over next tokens and how that changes depending on each layers computation.