This t-shirt shows "Grokking Loops" from the Welch Labs Grokking video!

These patterns emerge in the activations of transformers learning modular arithmetic as a result of model's internal fourier space solution to the problem. The patterns are from the real model we trained for the video on modulus 113 addition.

AS Colour blank with screen-printed Welch Labs art in Winston-Salem, NC

Custom Welch Labs woven label, sewn in

Care instructions: Wash inside out with cold water and mild detergent, Tumble dry low or line dry, and do not iron the screen print.