AI-From-Scratch

• K Nearest Neighbours (KNN)
• Linear Regression
• Logistic Regression
• Decision Trees
• Random Forest
• Naive Bayes
• Principal Component Analysis (PCA)
• Perceptron
• Multi-Layer Perceptron (MLP)
• Autoencoders
• Support Vector Machines (SVMs)

Deep Learning Architectures

• Feedforward Neural Networks (FNNs)

• Convolutional Neural Networks (CNNs)

  • LeNet-5
  • AlexNet
  • VGG
  • GoogLeNet (Inception)
  • ResNet

• Natural Language Processing (NLP)

  • Recurrent Neural Networks (RNNs)
  • Long Short-Term Memory (LSTMs)
  • Gated Recurrent Units (GRUs)
  • Transformers (e.g., BERT, GPT)
  • Word Embeddings (Word2Vec, GloVe, FastText)
  • Attention Mechanisms

• Unsupervised Learning

  • Generative Adversarial Networks (GANs)
  • Variational Autoencoders (VAEs)

Optimization Techniques

• Gradient Descent
• Stochastic Gradient Descent (SGD)
• Adam Optimizer
• AdaGrad
• RMSProp
• Momentum-Based Optimization

Reinforcement Learning

• Q-Learning
• Deep Q Networks (DQN)
• Policy Gradient Methods
• Actor-Critic Models

---

Note:

All the above topics are currently in progress.