Transformer

The mathematical architecture underlying nearly all modern large language models. Introduced in 2017, it processes entire text sequences simultaneously (rather than word by word) and uses an attention mechanism to capture relationships between words across long distances. Every major LLM today — GPT, the AI, Gemini, Llama — is built on the transformer.