SumGPT applies the same decoder-only architecture to three-digit addition. Reversing the output digits aligns carries with autoregressive generation, while masking the operands keeps the loss focused on the arithmetic result.
·Python, PyTorch, Transformers
SumGPT
Compact GPT trained for three-digit addition, reaching about 99% accuracy across 1,000 random tests.