-
Notifications
You must be signed in to change notification settings - Fork 224
Open
Description
Objective: Improve clarity of miniGPT through comments or code modifications that do not alter functionality.
- We can check http://nlp.seas.harvard.edu/annotated-transformer/ for inspiration
- maybe causal attention is the place to focus on @grigvardanyan ? https://github.com/karpathy/minGPT/blob/37baab71b9abea1b76ab957409a1cc2fbfba8a26/mingpt/model.py#L52
- consider also some of the clarifications can be good for the guide, instead of the code Transformer Day Chapter lxmls-guide#145
Branch: https://github.com/LxMLS/lxmls-toolkit/tree/transformer-day
Expected Finishing date: Ideally before June 12 meeting. If not during that week.
Metadata
Metadata
Assignees
Labels
No labels