SumGPT applies the same decoder-only architecture to three-digit addition. Reversing the output digits aligns carries with autoregressive generation, while masking the operands keeps the loss focused on the arithmetic result.
SumGPT
Compact GPT trained for three-digit addition, reaching about 99% accuracy across 1,000 random tests.