Personal Thoughts on AI

Residual Stream

In transformers, the residual stream carries everything forward — each layer reads from it and writes back to it, accumulating meaning. These are mine: unfiltered thoughts on AI, what I'm reading, what surprises me, and what I think is actually going on.