Skip to content

Commit 43e5ae3

Browse files
Complete PyTorch course: Add comprehensive recommended reads sections to all 20 chapters
1 parent 22db1a4 commit 43e5ae3

8 files changed

Lines changed: 224 additions & 36 deletions

docs/courses/pytorch/13-rnns.md

Lines changed: 29 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -640,8 +640,33 @@ Continue to [Chapter 14: Transfer Learning](14-transfer-learning.md) for:
640640
- ✅ Attention mechanism improves long sequences
641641
- ✅ Teacher forcing speeds up training
642642

643-
---
643+
## Recommended Reads
644+
645+
???+ "📚 Official Documentation"
646+
1. [RNN](https://pytorch.org/docs/stable/generated/torch.nn.RNN.html) - RNN layer documentation
647+
2. [LSTM](https://pytorch.org/docs/stable/generated/torch.nn.LSTM.html) - LSTM layer documentation
648+
3. [GRU](https://pytorch.org/docs/stable/generated/torch.nn.GRU.html) - GRU layer documentation
649+
4. [Packed Sequences](https://pytorch.org/docs/stable/generated/torch.nn.utils.rnn.pack_padded_sequence.html) - Handling variable-length sequences
650+
651+
???+ "📖 Essential Articles"
652+
1. [RNN Tutorial](https://pytorch.org/tutorials/intermediate/char_rnn_classification_tutorial.html) - Building RNNs
653+
2. [LSTM for Time Series](https://pytorch.org/tutorials/beginner/nlp/sequence_models_tutorial.html) - Time series forecasting
654+
3. [Sequence-to-Sequence Models](https://pytorch.org/tutorials/intermediate/seq2seq_translation_tutorial.html) - Seq2Seq tutorial
655+
4. [Attention Mechanisms](https://pytorch.org/tutorials/intermediate/seq2seq_translation_tutorial.html) - Attention in RNNs
656+
657+
???+ "🎓 Learning Resources"
658+
1. [NLP with PyTorch](https://pytorch.org/tutorials/beginner/nlp/deep_learning_tutorial.html) - NLP tutorial
659+
2. [RNN Best Practices](https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html) - Training tips
660+
3. [Gradient Clipping](https://pytorch.org/docs/stable/generated/torch.nn.utils.clip_grad_norm_.html) - Preventing gradient explosion
661+
662+
???+ "💡 Best Practices"
663+
1. [Handling Variable-Length Sequences](https://pytorch.org/docs/stable/generated/torch.nn.utils.rnn.pack_padded_sequence.html) - Packed sequences
664+
2. [Teacher Forcing](https://pytorch.org/tutorials/intermediate/seq2seq_translation_tutorial.html) - Training strategies
665+
3. [Bidirectional RNNs](https://pytorch.org/docs/stable/generated/torch.nn.RNN.html) - Bidirectional processing
666+
667+
???+ "🔬 Research Papers"
668+
1. [Long Short-Term Memory](https://www.bioinf.jku.at/publications/older/2604.pdf) - LSTM paper
669+
2. [Learning Phrase Representations using RNN Encoder-Decoder](https://arxiv.org/abs/1406.1078) - GRU paper
670+
3. [Attention Is All You Need](https://arxiv.org/abs/1706.03762) - Transformer architecture
644671

645-
**Reference:**
646-
- [RNN Documentation](https://pytorch.org/docs/stable/generated/torch.nn.RNN.html)
647-
- [LSTM Documentation](https://pytorch.org/docs/stable/generated/torch.nn.LSTM.html)
672+
---

docs/courses/pytorch/14-transfer-learning.md

Lines changed: 29 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -558,8 +558,33 @@ Continue to [Chapter 15: Model Saving & Loading](15-model-saving.md) to learn ab
558558
- ✅ Use different learning rates for different parts
559559
- ✅ Always normalize inputs correctly for pre-trained models
560560

561-
---
561+
## Recommended Reads
562+
563+
???+ "📚 Official Documentation"
564+
1. [Transfer Learning Tutorial](https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html) - Complete transfer learning guide
565+
2. [torchvision.models](https://pytorch.org/vision/stable/models.html) - Pre-trained models
566+
3. [Model Zoo](https://pytorch.org/vision/stable/models.html) - Available models
567+
4. [Fine-Tuning Guide](https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html) - Fine-tuning strategies
568+
569+
???+ "📖 Essential Articles"
570+
1. [Transfer Learning Explained](https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html) - Transfer learning concepts
571+
2. [Feature Extraction vs Fine-Tuning](https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html) - When to use each
572+
3. [Progressive Unfreezing](https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html) - Advanced techniques
573+
4. [Domain Adaptation](https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html) - Adapting to new domains
574+
575+
???+ "🎓 Learning Resources"
576+
1. [Computer Vision Transfer Learning](https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html) - CV examples
577+
2. [NLP Transfer Learning](https://huggingface.co/transformers/) - Hugging Face transformers
578+
3. [Transfer Learning Best Practices](https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html) - Optimization tips
579+
580+
???+ "💡 Best Practices"
581+
1. [Learning Rate Selection](https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html) - Choosing LRs for fine-tuning
582+
2. [Freezing Layers](https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html) - When to freeze
583+
3. [Data Augmentation](https://pytorch.org/vision/stable/transforms.html) - Augmentation for transfer learning
584+
585+
???+ "🔬 Research Papers"
586+
1. [How transferable are features in deep neural networks?](https://arxiv.org/abs/1411.1792) - Transfer learning analysis
587+
2. [Rethinking ImageNet Pre-training](https://arxiv.org/abs/1811.08883) - Pre-training effectiveness
588+
3. [BERT: Pre-training of Deep Bidirectional Transformers](https://arxiv.org/abs/1810.04805) - NLP transfer learning
562589

563-
**Reference:**
564-
- [Transfer Learning Tutorial](https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html)
565-
- [torchvision.models](https://pytorch.org/vision/stable/models.html)
590+
---

docs/courses/pytorch/15-model-saving.md

Lines changed: 28 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -638,8 +638,32 @@ Continue to [Chapter 20: Best Practices](20-best-practices.md) for:
638638
- ✅ Implement checkpoint management early
639639
- ✅ Save best model separately from checkpoints
640640

641-
---
641+
## Recommended Reads
642+
643+
???+ "📚 Official Documentation"
644+
1. [Saving and Loading Models](https://pytorch.org/tutorials/beginner/saving_loading_models.html) - Model persistence guide
645+
2. [TorchScript](https://pytorch.org/docs/stable/jit.html) - TorchScript documentation
646+
3. [ONNX Export](https://pytorch.org/docs/stable/onnx.html) - ONNX model export
647+
4. [Checkpointing](https://pytorch.org/tutorials/recipes/recipes/saving_and_loading_models_for_inference.html) - Checkpoint management
648+
649+
???+ "📖 Essential Articles"
650+
1. [Model Serialization](https://pytorch.org/tutorials/beginner/saving_loading_models.html) - Saving models tutorial
651+
2. [TorchScript Tutorial](https://pytorch.org/tutorials/beginner/Intro_to_TorchScript_tutorial.html) - TorchScript introduction
652+
3. [ONNX Tutorial](https://pytorch.org/tutorials/advanced/super_resolution_with_onnxruntime.html) - ONNX export and inference
653+
4. [Model Versioning](https://pytorch.org/tutorials/recipes/recipes/saving_and_loading_models_for_inference.html) - Best practices
654+
655+
???+ "🎓 Learning Resources"
656+
1. [Production Deployment](https://pytorch.org/tutorials/intermediate/flask_rest_api_tutorial.html) - Deploying models
657+
2. [Model Optimization](https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html) - Optimizing for production
658+
3. [Model Quantization](https://pytorch.org/docs/stable/quantization.html) - Quantization techniques
659+
660+
???+ "💡 Best Practices"
661+
1. [Save vs Load Patterns](https://pytorch.org/tutorials/beginner/saving_loading_models.html) - When to save what
662+
2. [State Dict vs Full Model](https://pytorch.org/tutorials/beginner/saving_loading_models.html) - Choosing save format
663+
3. [Cross-Platform Compatibility](https://pytorch.org/docs/stable/jit.html) - Ensuring compatibility
664+
665+
???+ "🔬 Research Papers"
666+
1. [ONNX: Open Neural Network Exchange](https://onnx.ai/) - ONNX format specification
667+
2. [Model Compression](https://arxiv.org/abs/1710.09282) - Compression techniques
642668

643-
**Reference:**
644-
- [Saving and Loading Models](https://pytorch.org/tutorials/beginner/saving_loading_models.html)
645-
- [TorchScript Documentation](https://pytorch.org/docs/stable/jit.html)
669+
---

docs/courses/pytorch/16-gpu-acceleration.md

Lines changed: 28 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -607,9 +607,32 @@ Continue to [Chapter 17: Mixed Precision & Optimization](17-mixed-precision.md)
607607
- ✅ Gradient accumulation simulates larger batches
608608
- ✅ Always clear GPU cache between experiments
609609

610-
---
610+
## Recommended Reads
611+
612+
???+ "📚 Official Documentation"
613+
1. [CUDA Semantics](https://pytorch.org/docs/stable/notes/cuda.html) - CUDA operations and memory
614+
2. [Distributed Training](https://pytorch.org/tutorials/intermediate/ddp_tutorial.html) - DDP tutorial
615+
3. [Automatic Mixed Precision](https://pytorch.org/docs/stable/amp.html) - AMP documentation
616+
4. [Multi-GPU Training](https://pytorch.org/tutorials/beginner/dist_overview.html) - Multi-GPU strategies
617+
618+
???+ "📖 Essential Articles"
619+
1. [GPU Acceleration Tutorial](https://pytorch.org/tutorials/beginner/blitz/cifar10_tutorial.html) - GPU basics
620+
2. [Distributed Data Parallel](https://pytorch.org/tutorials/intermediate/ddp_tutorial.html) - DDP guide
621+
3. [Mixed Precision Training](https://pytorch.org/docs/stable/amp.html) - AMP tutorial
622+
4. [GPU Memory Management](https://pytorch.org/docs/stable/notes/cuda.html#memory-management) - Memory optimization
623+
624+
???+ "🎓 Learning Resources"
625+
1. [Performance Optimization](https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html) - Optimization guide
626+
2. [Profiling PyTorch](https://pytorch.org/tutorials/recipes/recipes/profiler_recipe.html) - Performance profiling
627+
3. [Gradient Accumulation](https://pytorch.org/docs/stable/notes/autograd.html#gradient-accumulation) - Large batch training
628+
629+
???+ "💡 Best Practices"
630+
1. [GPU Best Practices](https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html) - Optimization tips
631+
2. [Memory Efficient Training](https://pytorch.org/docs/stable/notes/cuda.html#memory-management) - Reducing memory usage
632+
3. [Multi-GPU Setup](https://pytorch.org/tutorials/beginner/dist_overview.html) - Setting up multi-GPU
633+
634+
???+ "🔬 Research Papers"
635+
1. [Mixed Precision Training](https://arxiv.org/abs/1710.03740) - FP16 training paper
636+
2. [Distributed Training](https://arxiv.org/abs/2006.15704) - Large-scale training
611637

612-
**Reference:**
613-
- [CUDA Semantics](https://pytorch.org/docs/stable/notes/cuda.html)
614-
- [Distributed Training](https://pytorch.org/tutorials/intermediate/ddp_tutorial.html)
615-
- [AMP Documentation](https://pytorch.org/docs/stable/amp.html)
638+
---

docs/courses/pytorch/17-deployment.md

Lines changed: 28 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -772,9 +772,32 @@ You've completed the PyTorch deployment guide! Practice by:
772772
- ✅ Version control your models
773773
- ✅ Test thoroughly before deploying
774774

775-
---
775+
## Recommended Reads
776+
777+
???+ "📚 Official Documentation"
778+
1. [TorchScript](https://pytorch.org/docs/stable/jit.html) - TorchScript documentation
779+
2. [ONNX Export](https://pytorch.org/docs/stable/onnx.html) - ONNX model export
780+
3. [TorchServe](https://pytorch.org/serve/) - Model serving framework
781+
4. [Model Optimization](https://pytorch.org/docs/stable/quantization.html) - Quantization and optimization
782+
783+
???+ "📖 Essential Articles"
784+
1. [TorchScript Tutorial](https://pytorch.org/tutorials/beginner/Intro_to_TorchScript_tutorial.html) - TorchScript guide
785+
2. [ONNX Tutorial](https://pytorch.org/tutorials/advanced/super_resolution_with_onnxruntime.html) - ONNX export
786+
3. [Model Deployment](https://pytorch.org/tutorials/intermediate/flask_rest_api_tutorial.html) - REST API deployment
787+
4. [Production Best Practices](https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html) - Production tips
788+
789+
???+ "🎓 Learning Resources"
790+
1. [Deployment Tutorials](https://pytorch.org/tutorials/intermediate/flask_rest_api_tutorial.html) - Deployment examples
791+
2. [Model Serving](https://pytorch.org/serve/) - Serving models at scale
792+
3. [Edge Deployment](https://pytorch.org/mobile/home/) - Mobile and edge deployment
793+
794+
???+ "💡 Best Practices"
795+
1. [Model Optimization](https://pytorch.org/docs/stable/quantization.html) - Quantization strategies
796+
2. [Performance Monitoring](https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html) - Monitoring deployed models
797+
3. [Version Control](https://pytorch.org/tutorials/recipes/recipes/saving_and_loading_models_for_inference.html) - Model versioning
798+
799+
???+ "🔬 Research Papers"
800+
1. [ONNX: Open Neural Network Exchange](https://onnx.ai/) - ONNX specification
801+
2. [Model Compression](https://arxiv.org/abs/1710.09282) - Compression techniques
776802

777-
**Reference:**
778-
- [TorchScript Documentation](https://pytorch.org/docs/stable/jit.html)
779-
- [ONNX Documentation](https://onnx.ai/)
780-
- [TorchServe](https://pytorch.org/serve/)
803+
---

docs/courses/pytorch/18-debugging-visualization.md

Lines changed: 24 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -649,8 +649,28 @@ Continue to [Chapter 19: Advanced Topics](19-advanced-topics.md) for:
649649
- ✅ Monitor gradient norms
650650
- ✅ Profile code to find bottlenecks
651651

652-
---
652+
## Recommended Reads
653+
654+
???+ "📚 Official Documentation"
655+
1. [PyTorch Debugging](https://pytorch.org/tutorials/recipes/recipes/debugging_recipe.html) - Debugging guide
656+
2. [TensorBoard](https://pytorch.org/tutorials/intermediate/tensorboard_tutorial.html) - TensorBoard tutorial
657+
3. [Profiler](https://pytorch.org/docs/stable/profiler.html) - Performance profiler
658+
4. [Visualization Tools](https://pytorch.org/tutorials/intermediate/tensorboard_tutorial.html) - Visualization utilities
659+
660+
???+ "📖 Essential Articles"
661+
1. [Debugging Techniques](https://pytorch.org/tutorials/recipes/recipes/debugging_recipe.html) - Common debugging strategies
662+
2. [TensorBoard Integration](https://pytorch.org/tutorials/intermediate/tensorboard_tutorial.html) - Using TensorBoard
663+
3. [Gradient Checking](https://pytorch.org/tutorials/beginner/examples_autograd/two_layer_net_custom_function.html) - Verifying gradients
664+
4. [Model Inspection](https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html) - Inspecting models
665+
666+
???+ "🎓 Learning Resources"
667+
1. [Visualization Best Practices](https://pytorch.org/tutorials/intermediate/tensorboard_tutorial.html) - Visualization tips
668+
2. [Performance Profiling](https://pytorch.org/tutorials/recipes/recipes/profiler_recipe.html) - Profiling guide
669+
3. [Debugging Workflows](https://pytorch.org/tutorials/recipes/recipes/debugging_recipe.html) - Debugging workflows
670+
671+
???+ "💡 Best Practices"
672+
1. [Common Debugging Issues](https://pytorch.org/tutorials/recipes/recipes/debugging_recipe.html) - Troubleshooting
673+
2. [Monitoring Training](https://pytorch.org/tutorials/intermediate/tensorboard_tutorial.html) - Training monitoring
674+
3. [Visualization Tools](https://pytorch.org/tutorials/intermediate/tensorboard_tutorial.html) - Tool selection
653675

654-
**Reference:**
655-
- [PyTorch Debugging](https://pytorch.org/tutorials/recipes/recipes/debugging_recipe.html)
656-
- [TensorBoard Tutorial](https://pytorch.org/tutorials/intermediate/tensorboard_tutorial.html)
676+
---

docs/courses/pytorch/19-advanced-topics.md

Lines changed: 29 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -594,9 +594,33 @@ You've completed the advanced topics! Keep learning:
594594
- ✅ Interpretability tools explain model decisions
595595
- ✅ Stay updated with latest research
596596

597-
---
597+
## Recommended Reads
598+
599+
???+ "📚 Official Documentation"
600+
1. [PyTorch Lightning](https://www.pytorchlightning.ai/) - High-level training framework
601+
2. [Weights & Biases](https://wandb.ai/) - Experiment tracking
602+
3. [Ray Tune](https://docs.ray.io/en/latest/tune/index.html) - Hyperparameter tuning
603+
4. [Hugging Face Transformers](https://huggingface.co/transformers/) - Pre-trained transformers
604+
605+
???+ "📖 Essential Articles"
606+
1. [PyTorch Lightning Tutorial](https://pytorch-lightning.readthedocs.io/) - Lightning guide
607+
2. [Experiment Tracking](https://wandb.ai/site) - W&B tutorial
608+
3. [Hyperparameter Tuning](https://docs.ray.io/en/latest/tune/index.html) - Tuning strategies
609+
4. [Advanced Architectures](https://pytorch.org/tutorials/beginner/introyt/introyt1_tutorial.html) - Modern architectures
610+
611+
???+ "🎓 Learning Resources"
612+
1. [Vision Transformers](https://pytorch.org/vision/stable/models.html) - ViT tutorial
613+
2. [Model Interpretability](https://pytorch.org/tutorials/beginner/introyt/introyt1_tutorial.html) - Explainability
614+
3. [Advanced Training Techniques](https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html) - Advanced methods
615+
616+
???+ "💡 Best Practices"
617+
1. [Framework Selection](https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html) - Choosing frameworks
618+
2. [Experiment Management](https://wandb.ai/site) - Managing experiments
619+
3. [Staying Updated](https://pytorch.org/blog/) - Following latest research
620+
621+
???+ "🔬 Research Papers"
622+
1. [An Image is Worth 16x16 Words](https://arxiv.org/abs/2010.11929) - Vision Transformer
623+
2. [BERT: Pre-training of Deep Bidirectional Transformers](https://arxiv.org/abs/1810.04805) - BERT paper
624+
3. [Attention Is All You Need](https://arxiv.org/abs/1706.03762) - Transformer architecture
598625

599-
**Reference:**
600-
- [PyTorch Lightning](https://www.pytorchlightning.ai/)
601-
- [Weights & Biases](https://wandb.ai/)
602-
- [Ray Tune](https://docs.ray.io/en/latest/tune/index.html)
626+
---

docs/courses/pytorch/20-best-practices.md

Lines changed: 29 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -914,8 +914,32 @@ You've completed the PyTorch cheatsheet! Now you can:
914914

915915
**Congratulations!** You now have a comprehensive understanding of PyTorch. Keep building and learning! 🚀
916916

917-
**Helpful Resources:**
918-
- [PyTorch Documentation](https://pytorch.org/docs/)
919-
- [PyTorch Tutorials](https://pytorch.org/tutorials/)
920-
- [PyTorch Forums](https://discuss.pytorch.org/)
921-
- [Papers with Code](https://paperswithcode.com/)
917+
## Recommended Reads
918+
919+
???+ "📚 Official Documentation"
920+
1. [PyTorch Documentation](https://pytorch.org/docs/) - Complete API reference
921+
2. [PyTorch Tutorials](https://pytorch.org/tutorials/) - Official tutorials
922+
3. [Best Practices Guide](https://pytorch.org/tutorials/recipes/recipes_index.html) - PyTorch recipes
923+
4. [Performance Tuning](https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html) - Optimization guide
924+
925+
???+ "📖 Essential Articles"
926+
1. [PyTorch Best Practices](https://pytorch.org/tutorials/recipes/recipes_index.html) - Official best practices
927+
2. [Common Mistakes](https://github.com/Kaixhin/grokking-pytorch) - Common pitfalls
928+
3. [Production Deployment](https://pytorch.org/tutorials/intermediate/flask_rest_api_tutorial.html) - Deployment guide
929+
4. [Code Organization](https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html) - Project structure
930+
931+
???+ "🎓 Learning Resources"
932+
1. [PyTorch Forums](https://discuss.pytorch.org/) - Community discussions
933+
2. [Papers with Code](https://paperswithcode.com/) - Research implementations
934+
3. [PyTorch Blog](https://pytorch.org/blog/) - Latest updates and tutorials
935+
936+
???+ "💡 Best Practices"
937+
1. [Reproducibility](https://pytorch.org/docs/stable/notes/randomness.html) - Ensuring reproducibility
938+
2. [Code Quality](https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html) - Writing clean code
939+
3. [Testing Strategies](https://pytorch.org/tutorials/recipes/recipes/tuning_guide.html) - Testing models
940+
941+
???+ "🔬 Research Papers"
942+
1. [PyTorch: An Imperative Style Deep Learning Library](https://papers.nips.cc/paper/9015-pytorch-an-imperative-style-high-performance-deep-learning-library) - PyTorch paper
943+
2. [Deep Learning Best Practices](https://arxiv.org/abs/1706.02677) - Training deep networks
944+
945+
---

0 commit comments

Comments
 (0)