Components of a Transformer Architecture in LLMs
a concept first tour of how transformers work – Transformer Architecture I’ve always been curious about what’s actually happening inside a transformer, not the API call, not the chat interface, but the actual mechanics underneath. How does attention “know” which words matter? What does a weight matrix encode meaning at all? This post is me … Read more →