BookGPT is a character-level language model trained on a corpus of native Italian literature. I used it to compare model capacity, context length, corpus quality, and the computational limits of training a decoder-only transformer on consumer hardware.
·Python, PyTorch, Transformers +1
BookGPT
Character-level GPT trained on native Italian literature, with experiments on data quality, model capacity, and context length.