Skip to content

Commit 3428b1a

Browse files
shivam2003-devshivam2003-dev
committed
Fix numbered list formatting in topic guides
- Fix indentation for sub-items in numbered lists - Ensure proper spacing between list items - Use consistent bold formatting for labels - Fix markdown rendering issues with numbered lists
1 parent f99918d commit 3428b1a

3 files changed

Lines changed: 351 additions & 349 deletions

File tree

‎docs/courses/ai-ml-research-guide/topic-01-transfer-learning.md‎

Lines changed: 116 additions & 114 deletions
Original file line numberDiff line numberDiff line change
@@ -27,127 +27,129 @@
2727
## 📖 Survey Papers (Start Here!)
2828

2929
???+ "📋 Essential Survey Papers"
30+
3031
1. **"A Survey on Transfer Learning" (2009)**
31-
- Authors: Pan, Yang
32-
- Link: https://ieeexplore.ieee.org/document/5288526
33-
- Why: Classic survey, foundational concepts
34-
- Difficulty: Beginner-friendly
32+
- **Authors**: Pan, Yang
33+
- **Link**: https://ieeexplore.ieee.org/document/5288526
34+
- **Why**: Classic survey, foundational concepts
35+
- **Difficulty**: Beginner-friendly
3536

3637
2. **"Transfer Learning for Computer Vision Tasks: A Survey" (2022)**
37-
- Authors: Zhuang, Zhai, Yamins
38-
- Link: https://arxiv.org/abs/2201.04844
39-
- Why: Comprehensive modern survey
40-
- Difficulty: Intermediate
38+
- **Authors**: Zhuang, Zhai, Yamins
39+
- **Link**: https://arxiv.org/abs/2201.04844
40+
- **Why**: Comprehensive modern survey
41+
- **Difficulty**: Intermediate
4142

4243
3. **"A Comprehensive Survey on Transfer Learning" (2020)**
43-
- Authors: Zhuang, Qi, Duan, et al.
44-
- Link: https://arxiv.org/abs/1911.02685
45-
- Why: Very comprehensive, covers all aspects
46-
- Difficulty: Intermediate
44+
- **Authors**: Zhuang, Qi, Duan, et al.
45+
- **Link**: https://arxiv.org/abs/1911.02685
46+
- **Why**: Very comprehensive, covers all aspects
47+
- **Difficulty**: Intermediate
4748

4849
!!! success "Start with Surveys"
4950
Always start with survey papers to get overview of the field before diving into specific papers.
5051

5152
## 🏛️ Classic Papers (Must Read)
5253

5354
???+ "⭐ Foundational Papers"
55+
5456
1. **"ImageNet Classification with Deep Convolutional Neural Networks" (2012)**
55-
- Authors: Krizhevsky, Sutskever, Hinton
56-
- Link: https://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks
57-
- Code: https://github.com/pytorch/vision/tree/main/torchvision/models
58-
- Impact: Started transfer learning revolution
59-
- Difficulty: Beginner-friendly
57+
- **Authors**: Krizhevsky, Sutskever, Hinton
58+
- **Link**: https://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks
59+
- **Code**: https://github.com/pytorch/vision/tree/main/torchvision/models
60+
- **Impact**: Started transfer learning revolution
61+
- **Difficulty**: Beginner-friendly
6062

6163
2. **"How transferable are features in deep neural networks?" (2014)**
62-
- Authors: Yosinski, Clune, Bengio, Lipson
63-
- Link: https://arxiv.org/abs/1411.1792
64-
- Code: https://github.com/yosinski/transfer-learning-survey
65-
- Impact: Explained what transfers and why
66-
- Difficulty: Beginner-friendly
64+
- **Authors**: Yosinski, Clune, Bengio, Lipson
65+
- **Link**: https://arxiv.org/abs/1411.1792
66+
- **Code**: https://github.com/yosinski/transfer-learning-survey
67+
- **Impact**: Explained what transfers and why
68+
- **Difficulty**: Beginner-friendly
6769

6870
3. **"Deep Residual Learning for Image Recognition" (2015)**
69-
- Authors: He, Zhang, Ren, Sun
70-
- Link: https://arxiv.org/abs/1512.03385
71-
- Code: https://github.com/pytorch/vision/tree/main/torchvision/models
72-
- Impact: ResNet became standard backbone
73-
- Difficulty: Intermediate
71+
- **Authors**: He, Zhang, Ren, Sun
72+
- **Link**: https://arxiv.org/abs/1512.03385
73+
- **Code**: https://github.com/pytorch/vision/tree/main/torchvision/models
74+
- **Impact**: ResNet became standard backbone
75+
- **Difficulty**: Intermediate
7476

7577
## 🚀 Modern Papers (Recent & Important)
7678

7779
???+ "🔥 Recent Important Papers"
7880
1. **"BERT: Pre-training of Deep Bidirectional Transformers" (2018)**
79-
- Authors: Devlin, Chang, Lee, Toutanova
80-
- Link: https://arxiv.org/abs/1810.04805
81-
- Code: https://github.com/google-research/bert
82-
- Venue: NAACL 2019
83-
- Difficulty: Intermediate
81+
- **Authors**: Devlin, Chang, Lee, Toutanova
82+
- **Link**: https://arxiv.org/abs/1810.04805
83+
- **Code**: https://github.com/google-research/bert
84+
- **Venue**: NAACL 2019
85+
- **Difficulty**: Intermediate
8486

8587
2. **"An Image is Worth 16x16 Words: Transformers for Image Recognition" (2020)**
86-
- Authors: Dosovitskiy, Beyer, Kolesnikov, et al.
87-
- Link: https://arxiv.org/abs/2010.11929
88-
- Code: https://github.com/google-research/vision_transformer
89-
- Venue: ICLR 2021
90-
- Difficulty: Intermediate
88+
- **Authors**: Dosovitskiy, Beyer, Kolesnikov, et al.
89+
- **Link**: https://arxiv.org/abs/2010.11929
90+
- **Code**: https://github.com/google-research/vision_transformer
91+
- **Venue**: ICLR 2021
92+
- **Difficulty**: Intermediate
9193

9294
3. **"LoRA: Low-Rank Adaptation of Large Language Models" (2021)**
93-
- Authors: Hu, Shen, Wallis, et al.
94-
- Link: https://arxiv.org/abs/2106.09685
95-
- Code: https://github.com/microsoft/LoRA
96-
- Venue: ICLR 2022
97-
- Difficulty: Intermediate
95+
- **Authors**: Hu, Shen, Wallis, et al.
96+
- **Link**: https://arxiv.org/abs/2106.09685
97+
- **Code**: https://github.com/microsoft/LoRA
98+
- **Venue**: ICLR 2022
99+
- **Difficulty**: Intermediate
98100

99101
4. **"EfficientNet: Rethinking Model Scaling" (2019)**
100-
- Authors: Tan, Le
101-
- Link: https://arxiv.org/abs/1905.11946
102-
- Code: https://github.com/tensorflow/tpu/tree/master/models/official/efficientnet
103-
- Venue: ICML 2019
104-
- Difficulty: Intermediate
102+
- **Authors**: Tan, Le
103+
- **Link**: https://arxiv.org/abs/1905.11946
104+
- **Code**: https://github.com/tensorflow/tpu/tree/master/models/official/efficientnet
105+
- **Venue**: ICML 2019
106+
- **Difficulty**: Intermediate
105107

106108
## 📝 Tutorial Papers (Beginner-Friendly)
107109

108110
???+ "🎓 Tutorial & Educational Papers"
109111
1. **"Transfer Learning Tutorial" (2018)**
110-
- Link: https://github.com/jindongwang/transferlearning-tutorial
111-
- Why: Comprehensive tutorial with code
112-
- Difficulty: Beginner
112+
- **Link**: https://github.com/jindongwang/transferlearning-tutorial
113+
- **Why**: Comprehensive tutorial with code
114+
- **Difficulty**: Beginner
113115

114116
2. **"Fine-tuning Deep Networks" - Fast.ai Course**
115-
- Link: https://course.fast.ai/
116-
- Why: Practical tutorial with code
117-
- Difficulty: Beginner
117+
- **Link**: https://course.fast.ai/
118+
- **Why**: Practical tutorial with code
119+
- **Difficulty**: Beginner
118120

119121
3. **"Transfer Learning in Computer Vision" - PyTorch Tutorial**
120-
- Link: https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html
121-
- Why: Step-by-step implementation
122-
- Difficulty: Beginner
122+
- **Link**: https://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html
123+
- **Why**: Step-by-step implementation
124+
- **Difficulty**: Beginner
123125

124126
## 💻 Code Implementation Papers
125127

126128
???+ "🔧 Papers with Excellent Code"
127129
1. **"Vision Transformer (ViT)"**
128-
- Code: https://github.com/google-research/vision_transformer
129-
- Framework: JAX/Flax
130-
- Quality: Official, well-documented
130+
- **Code**: https://github.com/google-research/vision_transformer
131+
- **Framework**: JAX/Flax
132+
- **Quality**: Official, well-documented
131133

132134
2. **"BERT"**
133-
- Code: https://github.com/google-research/bert
134-
- Framework: TensorFlow
135-
- Quality: Official implementation
135+
- **Code**: https://github.com/google-research/bert
136+
- **Framework**: TensorFlow
137+
- **Quality**: Official implementation
136138

137139
3. **"LoRA"**
138-
- Code: https://github.com/microsoft/LoRA
139-
- Framework: PyTorch
140-
- Quality: Official, easy to use
140+
- **Code**: https://github.com/microsoft/LoRA
141+
- **Framework**: PyTorch
142+
- **Quality**: Official, easy to use
141143

142144
4. **"EfficientNet"**
143-
- Code: https://github.com/tensorflow/tpu/tree/master/models/official/efficientnet
144-
- Framework: TensorFlow
145-
- Quality: Official
145+
- **Code**: https://github.com/tensorflow/tpu/tree/master/models/official/efficientnet
146+
- **Framework**: TensorFlow
147+
- **Quality**: Official
146148

147149
5. **"Hugging Face Transformers"**
148-
- Code: https://github.com/huggingface/transformers
149-
- Framework: PyTorch/TensorFlow
150-
- Quality: Industry standard, many models
150+
- **Code**: https://github.com/huggingface/transformers
151+
- **Framework**: PyTorch/TensorFlow
152+
- **Quality**: Industry standard, many models
151153

152154
!!! tip "Code First Approach"
153155
For beginners, start with code implementations to understand concepts, then read papers.
@@ -158,29 +160,29 @@
158160

159161
???+ "🔍 Paper Discovery"
160162
1. **Papers With Code - Transfer Learning**
161-
- URL: https://paperswithcode.com/task/transfer-learning
162-
- Features: Papers with code, leaderboards, SOTA tracking
163-
- Best for: Finding implementations
163+
- **URL**: https://paperswithcode.com/task/transfer-learning
164+
- **Features**: Papers with code, leaderboards, SOTA tracking
165+
- **Best for**: Finding implementations
164166

165167
2. **arXiv - Machine Learning**
166-
- URL: https://arxiv.org/list/cs.LG/recent
167-
- Features: Latest preprints, daily updates
168-
- Best for: Latest papers
168+
- **URL**: https://arxiv.org/list/cs.LG/recent
169+
- **Features**: Latest preprints, daily updates
170+
- **Best for**: Latest papers
169171

170172
3. **Google Scholar**
171-
- URL: https://scholar.google.com/
172-
- Search: "transfer learning" OR "fine-tuning" OR "domain adaptation"
173-
- Best for: Comprehensive search
173+
- **URL**: https://scholar.google.com/
174+
- **Search**: "transfer learning" OR "fine-tuning" OR "domain adaptation"
175+
- **Best for**: Comprehensive search
174176

175177
4. **Semantic Scholar**
176-
- URL: https://www.semanticscholar.org/
177-
- Features: AI-powered recommendations
178-
- Best for: Finding related papers
178+
- **URL**: https://www.semanticscholar.org/
179+
- **Features**: AI-powered recommendations
180+
- **Best for**: Finding related papers
179181

180182
5. **Connected Papers**
181-
- URL: https://www.connectedpapers.com/
182-
- Features: Visual paper graphs
183-
- Best for: Exploring research area
183+
- **URL**: https://www.connectedpapers.com/
184+
- **Features**: Visual paper graphs
185+
- **Best for**: Exploring research area
184186

185187
### Conference Proceedings
186188

@@ -243,40 +245,40 @@
243245

244246
???+ "🎓 Courses"
245247
1. **Fast.ai - Practical Deep Learning**
246-
- URL: https://course.fast.ai/
247-
- Focus: Transfer learning practical
248-
- Level: Beginner-friendly
248+
- **URL**: https://course.fast.ai/
249+
- **Focus**: Transfer learning practical
250+
- **Level**: Beginner-friendly
249251

250252
2. **CS231n - Stanford**
251-
- URL: https://cs231n.stanford.edu/
252-
- Focus: Computer vision, transfer learning
253-
- Level: Intermediate
253+
- **URL**: https://cs231n.stanford.edu/
254+
- **Focus**: Computer vision, transfer learning
255+
- **Level**: Intermediate
254256

255257
3. **Hugging Face Course**
256-
- URL: https://huggingface.co/course
257-
- Focus: Transformers, fine-tuning
258-
- Level: Beginner to Intermediate
258+
- **URL**: https://huggingface.co/course
259+
- **Focus**: Transformers, fine-tuning
260+
- **Level**: Beginner to Intermediate
259261

260262
### Books
261263

262264
???+ "📖 Books"
263265
1. **"Deep Learning" by Goodfellow, Bengio, Courville**
264-
- Free: https://www.deeplearningbook.org/
265-
- Chapter: Transfer learning concepts
266+
- **Free**: https://www.deeplearningbook.org/
267+
- **Chapter**: Transfer learning concepts
266268

267269
2. **"Hands-On Machine Learning" by Aurélien Géron**
268-
- Chapter: Transfer learning practical guide
270+
- **Chapter**: Transfer learning practical guide
269271

270272
### Blogs & Articles
271273

272274
???+ "📰 Blogs"
273275
1. **Jay Alammar's Blog**
274-
- URL: http://jalammar.github.io/
275-
- Focus: Transformers, BERT explained
276+
- **URL**: http://jalammar.github.io/
277+
- **Focus**: Transformers, BERT explained
276278

277279
2. **Lil'Log by Lilian Weng**
278-
- URL: https://lilianweng.github.io/
279-
- Focus: Research summaries, transfer learning
280+
- **URL**: https://lilianweng.github.io/
281+
- **Focus**: Research summaries, transfer learning
280282

281283
## 🎯 Reading Strategy
282284

@@ -309,31 +311,31 @@
309311

310312
???+ "📡 Alerts"
311313
1. **arXiv RSS Feed**
312-
- URL: https://arxiv.org/list/cs.LG/recent?show=100
313-
- Subscribe: RSS reader (Feedly, etc.)
314-
- Check: Daily
314+
- **URL**: https://arxiv.org/list/cs.LG/recent?show=100
315+
- **Subscribe**: RSS reader (Feedly, etc.)
316+
- **Check**: Daily
315317

316318
2. **Google Scholar Alerts**
317-
- Setup: Alert for "transfer learning"
318-
- Frequency: Weekly digest
319+
- **Setup**: Alert for "transfer learning"
320+
- **Frequency**: Weekly digest
319321

320322
3. **Papers With Code Newsletter**
321-
- URL: https://paperswithcode.com/newsletter
322-
- Frequency: Weekly
323+
- **URL**: https://paperswithcode.com/newsletter
324+
- **Frequency**: Weekly
323325

324326
### Social Media
325327

326328
???+ "📱 Social Tracking"
327329
1. **Twitter/X**
328-
- Follow: @paperswithcode, researchers
329-
- Hashtag: #TransferLearning, #FineTuning
330+
- **Follow**: @paperswithcode, researchers
331+
- **Hashtag**: #TransferLearning, #FineTuning
330332

331333
2. **Reddit**
332-
- r/MachineLearning
333-
- r/learnmachinelearning
334+
- r/MachineLearning
335+
- r/learnmachinelearning
334336

335337
3. **LinkedIn**
336-
- Follow: Research groups, companies
338+
- **Follow**: Research groups, companies
337339

338340
## 📋 To-Do Checklist
339341

0 commit comments

Comments
 (0)