Compiling programs into transformers instead of training them
Sean Moran’s work wires transformer weights analytically instead of training them: the residual stream becomes working memory and attention becomes a lookup. What that means when you need an exact computation instead of a probable answer.