Units
navigate_next
Sequence Models and Language
search
Quick search
code
Show Source
Textbook
Video
Forum
Github
STAT 157, Spring 19
Table Of Contents
Syllabus
Assignments
Projects
1. Ensuring Quality Conversations in Online Forums
2. Image attribute classification using disentangled embeddings on multimodal data
3. Deep Learning with NLP (Tacotron)
4. Image captioning
5. Explainable Electrocardiogram Classifications using Neural Networks
7. Deep fitting room
8. Bot controlled accounts
9. Predicting Next Day Stock Returns After Earnings Reports Using Deep Learning in Sentiment Analysis
10. Predict the presence of oil palm plantation in satellite imagery
11. Audio Recovery
12. Visual Speech recognition
14. Examination of Associative Vocabulary in Internet Language through Word Embedding
15. What Are You Thinking: Image Generation By Deconvolution Network
16. Predicting Length of Stay at Hospitals
17. Handwriting to Latex
18. ACID: Analyzing Census and Imaging Data
19. Parameterizable Single GAN Multi-Style
20. Measuring Amazon Product Reviews Helpfulness
Units
Introduction to Deep Learning
Introduction to Deep Learning
Installation
Linear Algebra
Using Jupyter Notebook
Using AWS to Run Code
Probability and Statistics
Probability and Statistics
Naive Bayes
Gradients, Chain Rule, Automatic Differentiation
Autograd
Linear Regression, Basic Optimization
Linear Regression
Linear Regression Implementation from Scratch
Concise Implementation of Linear Regression
Likelihood, Loss Functions, Logisitic Regression, Information Theory
Softmax Regression
Fashion MNIST
Softmax Regression from scratch
Softmax Regression - concise version
Multilayer Perceptron
Multilayer Perceptron
Multilayer Perceptron Implementation
Multilayer Perceptron in Gluon
Model Selection, Weight Decay, Dropout
Model Selection
Weight Decay
Dropout
Numerical Stability, Hardware
Numerical Stability and Initialization
Predicting House Prices on Kaggle
GPU Purchase Guide
Machine Learning Problems and Statistical Environment
Statistical Environment
Layers, Parameters, GPUs
Blocks and Layers
Parameter Management
Deferred Initialization
Custom Layers
File I/O
GPUs
Convolutional Networks
Convolutional Neural Networks
Convolutions
Padding and Strides
Channels
Pooling
Basic Convolutional Networks
LeNet
AlexNet
VGG
NiN
Residual Networks and Advanced Architectures
Network with Parallel Concatenations
Residual Networks
Densely Connected Networks
Computation Performance, Multi-GPU and Multi-Machine Training
Hybridization
Asynchrony
Automatic Parallelization
Multiple GPUs
Multiple GPUs in Gluon
Image Augmentation, Fine Turning, Neural Style
Image Augmentation
Fine Tuning
Neural Style
Object Detection
Object Detection and Bounding Boxes
Anchor Boxes
Multiscale Object Detection
Object Detection Data Set (Pikachu)
Single Shot Multibox Detection (SSD)
Region-based CNNs (R-CNNs)¶
Sequence Models and Language
Sequence Models
Language Models
Recurrent Neural Networks
Text Preprocessing
Recurrent Neural Networks
Building an RNN
Building an RNN in Gluon
Backpropagation through Time
Sequence Models with Memory and Gating
Truncated Backpropagation
Gated Recurrent Unit
Long Short Term Memory
Advanced Sequence Models
Deep Recurrent Neural Networks
Bidirectional RNNs
Beam Search
Optimization Basics
Introduction to Optimization
Stochastic Gradient Descent for Deep Learning
Stochastic Gradient Descent
Batching
Momentum
Advanced Optimization Algorithms
Adagrad
Adam
Peak Performance on ImageNet
Gluon CV Toolkit
FAQ
STAT 157, Spring 19
Table Of Contents
Syllabus
Assignments
Projects
1. Ensuring Quality Conversations in Online Forums
2. Image attribute classification using disentangled embeddings on multimodal data
3. Deep Learning with NLP (Tacotron)
4. Image captioning
5. Explainable Electrocardiogram Classifications using Neural Networks
7. Deep fitting room
8. Bot controlled accounts
9. Predicting Next Day Stock Returns After Earnings Reports Using Deep Learning in Sentiment Analysis
10. Predict the presence of oil palm plantation in satellite imagery
11. Audio Recovery
12. Visual Speech recognition
14. Examination of Associative Vocabulary in Internet Language through Word Embedding
15. What Are You Thinking: Image Generation By Deconvolution Network
16. Predicting Length of Stay at Hospitals
17. Handwriting to Latex
18. ACID: Analyzing Census and Imaging Data
19. Parameterizable Single GAN Multi-Style
20. Measuring Amazon Product Reviews Helpfulness
Units
Introduction to Deep Learning
Introduction to Deep Learning
Installation
Linear Algebra
Using Jupyter Notebook
Using AWS to Run Code
Probability and Statistics
Probability and Statistics
Naive Bayes
Gradients, Chain Rule, Automatic Differentiation
Autograd
Linear Regression, Basic Optimization
Linear Regression
Linear Regression Implementation from Scratch
Concise Implementation of Linear Regression
Likelihood, Loss Functions, Logisitic Regression, Information Theory
Softmax Regression
Fashion MNIST
Softmax Regression from scratch
Softmax Regression - concise version
Multilayer Perceptron
Multilayer Perceptron
Multilayer Perceptron Implementation
Multilayer Perceptron in Gluon
Model Selection, Weight Decay, Dropout
Model Selection
Weight Decay
Dropout
Numerical Stability, Hardware
Numerical Stability and Initialization
Predicting House Prices on Kaggle
GPU Purchase Guide
Machine Learning Problems and Statistical Environment
Statistical Environment
Layers, Parameters, GPUs
Blocks and Layers
Parameter Management
Deferred Initialization
Custom Layers
File I/O
GPUs
Convolutional Networks
Convolutional Neural Networks
Convolutions
Padding and Strides
Channels
Pooling
Basic Convolutional Networks
LeNet
AlexNet
VGG
NiN
Residual Networks and Advanced Architectures
Network with Parallel Concatenations
Residual Networks
Densely Connected Networks
Computation Performance, Multi-GPU and Multi-Machine Training
Hybridization
Asynchrony
Automatic Parallelization
Multiple GPUs
Multiple GPUs in Gluon
Image Augmentation, Fine Turning, Neural Style
Image Augmentation
Fine Tuning
Neural Style
Object Detection
Object Detection and Bounding Boxes
Anchor Boxes
Multiscale Object Detection
Object Detection Data Set (Pikachu)
Single Shot Multibox Detection (SSD)
Region-based CNNs (R-CNNs)¶
Sequence Models and Language
Sequence Models
Language Models
Recurrent Neural Networks
Text Preprocessing
Recurrent Neural Networks
Building an RNN
Building an RNN in Gluon
Backpropagation through Time
Sequence Models with Memory and Gating
Truncated Backpropagation
Gated Recurrent Unit
Long Short Term Memory
Advanced Sequence Models
Deep Recurrent Neural Networks
Bidirectional RNNs
Beam Search
Optimization Basics
Introduction to Optimization
Stochastic Gradient Descent for Deep Learning
Stochastic Gradient Descent
Batching
Momentum
Advanced Optimization Algorithms
Adagrad
Adam
Peak Performance on ImageNet
Gluon CV Toolkit
FAQ
Sequence Models and Language
¶
Slides
¶
Language Models and Sequences
Keynote
PDF
Notebooks
Language Model Datasets
Jupyter
,
PDF
Language Model
Jupyter
,
PDF
Sequence Model
Jupyter
,
PDF
Recurrent Neural Network
Jupyter
,
PDF
Content
¶
Sequence Models
Language Models
Recurrent Neural Networks
Text Preprocessing
Videos
¶
Table Of Contents
Sequence Models and Language
Slides
Content
Videos
Previous
Object Detection
Next
Recurrent Neural Networks