Notes¶
관심 분야 정리¶
최근 / 거쳐 간 관심 분야를 넓게 정리한 글
- Score-based Generative Models · PPT: Generative Modeling by Estimating Gradients of the Data Distribution · PDF: NCSN 4.3 inference algorithm 분석 · Denoising Score Matching tech report
- Flow Matching
- Generative AI
- Virtual Try-On (VITON)
- Voice Conversion
Generative Model Theory¶
완벽한 DDPM 수식 분해는 papers/diffusion/ddpm 의 PDF 참고
- Energy-based Model: Normalizing Constant
- MCMC: Markov Chain Monte Carlo
- SDE: Stochastic Differential Equation
- Multivariate Gaussian Distribution in Generative Models · PPT: pixel-wise independent learning
- Total Variation Loss in Generative Models
- DDPM Denoising Process 분석
PDF - DDPM 분석 2: Forward에서의 분산
PDF - DDPM 분석 3: Loss 일부 분석 (L_{t-1} proof)
PDF - Latent Diffusion Model Overview
PDF
Deep Learning Basics¶
- 1x1 kernel 의미
PDF - Backpropagation
PDF - CNN
PDF - Confusion Matrix
PDF - Convolutional filter about RGB
PDF - Feature Normalization
PDF - Gradient Descent
PDF - Information Theory
PDF - Layer와 node의 독립성
PDF - Loss function이 구불구불해지는 이유
PDF - Logistic regression + Softmax
PDF - Normalization
PDF - Regularization
PDF - Reparameterization trick
PDF - Residual learning, skip connection
PDF· Skip Connection PPT - Training, validation, test
PDF - Truncation trick
PDF - U-Net
PDF - XOR problem
PDF - Weight Initialization
PDF - RNN
PDF - 인공지능의 이해 (혁펜하임)
PDF
Machine Learning¶
- 머신러닝 군집 & 분류 & 회귀 알고리즘
PDF - CNN
PDF - Embedding
PDF - NLP
PDF - AutoEncoder
PDF - GAN
PDF - 알고있으면 쓸모있는 AI 관련 지식
PDF - Support Vector Machine (SVM)
PDF
Math & Probability¶
- Bayes's Theorem: MLE & MAP
- Probability: 조건부 확률, 결합 확률
- Joint / Marginal / Conditional Probability
PDF - Gaussian Distribution
- Taylor Series
- 편미분, 전미분, 델타
- Expectation Property
PDF - Jacobian Matrix
PDF - 라그랑주 승수법
PDF - 미분 공식
PDF - 분포 간 거리
PDF· KL-Divergence PPT - 스칼라를 벡터로 미분, 편미분
PDF - 중심 극한 정리
PDF - 평균, 분산
PDF - 확률 분포
PDF - Vector Norm
PDF - Entropy with Information Theory
PDF - 기초 수학 (산업 수학, 공학선형대수학, 신호와 시스템)
PDF - Word Embedding using SVD (blog)
Reinforcement Learning¶
Code Practice OpenAI GYM == 0.22.0 근처 버전 권장 (버전마다 state 반환 형식이 다름)
- David Silver 1~5강 정리
PDF - David Silver 6~7강 정리
PDF - 강화학습 종류
PDF - Off-policy 분석
PDF - RNN with 똥 피하기 game
PDF