Hello! This is a neural network framework, from scratch, in C++. Some of the code has been generated with the assistance of ChatGPT. This was an educational quest I took on this August, to try to implement an LLM, from scratch, in C++. The project has now been abandoned for others, but it was still a very fun experience! First time working with C++, linear algebra, and calculus. I would highly recommend Paul’s Online Math Notes for learning about the basics of differentiation and chain rule, and the paper The Matrix Calculus You Need For Deep Learning for deriving the rules behind automatic differentiation. I have two completed articles about this project, about building lists and building vectors. I will probably not finish the rest of the series, but never say never!
- Amitav