HOME - Machine Learning

Machine Learning

Basics

• Gradient Descent
• Regularization
• Cross-Validation
• Hyperparameter Tuning
• Principal Components Analysis

Models

• Linear Regression
• Generalized Linear Models
• Logistic Regression
• Naive Bayes
• Support Vector Machines
• Decision Trees
• Random Forest
• K-Means Clustering
  • Hierarchical Clustering
  • Density Clustering
• Gaussian Mixture Model

Deep Learning Models

• Multilayer Perceptrons (Feedforward Linear Neural Networks)
• Convolutional Neural Networks
  • R-CNN
  • UNet
  • ResNet
• Sequence Models
  • Recurrent Neural Networks
    • LSTM
    • GRU
    • Seq2Seq
  • Transformers
    • Vision Transformers
    • Decoder-Only Transformers
• Foundation Models (Mostly LLMs)
  • Foundations
    • Tokenization
    • Positional Encoding
    • LLM Architecture and Training Design Choices
    • Mixture-of-Experts
  • Finetuning
    • Instruct Fine-Tuning
    • LoRA
    • RLHF
  • Applications
    • Retrieval-Augmented Generation
    • “Agents”
    • Model Context Protocol (MCP)
  • Optimizations
    • Flash Attention
    • Sliding Window Attention
    • Ring Attention
    • Structured State Space Models / Mamba
  • Systems
    • Distributed Training
• Generative Modeling
  • Variational Autoencoders
  • GANs
    • Conditional GANs
  • Diffusion Models
• Graph Neural Networks

Applications

Computer Vision

• NeRF
• Gaussian Splatting