Training a GPT from scratch in C on a RISC-V MCU with no FPU, in 37KB of code(rvembedded.com)
4 pointsby armstrongsubero2 hours ago1 comment
  • airhangerf152 hours ago
    Pretty ambitious project. I'm assuming the author really did write a lot of this himself without LLMs? Maybe that is how academia needs to start training students? Understand the complexity of building that tool that builds your other tools. The book he wrote looks pretty detailed too.

    I want to dig through all of this. Pretty interesting.

    • armstrongsubero2 hours ago
      Thank you! Yes I used tools for grammar and spell check, but the point of the project was to understand myself so using LLMs would kind of defeat the purpose. My hope is that students use this, I've had a few students reach out to me telling me it's really helpful to them, but I agree we should learn from first principles than just pulling in some libraries... So I made it free to read so anyone can learn..