microgpt is a single-file Python implementation that enables training and inference of GPT-type language models using only the standard library, without relying on external libraries like PyTorch. The ...

I'm a software engineer passionate about everything shaping our future.

💪 FP8 compatibility ! 🚀 Speed Up all Process 🚀 less VRAM consumption (Stay high, batch_size=1 for RTX4090 max, I'm trying to fix that) 🛠️ Better benchmark coming soon ...

💪 FP8 compatibility ! 🚀 Speed Up all Process 🚀 less VRAM consumption (Stay high, batch_size=1 for RTX4090 max, I'm trying to fix that) 🛠️ Better benchmark coming soon ...