Approach

This would be a two-day instructor-led hands-on bootcamp to learn and implement an end-to-end deep learning model for computer vision (image recognition and generation) and natural language processing (text classfication and generation)

• Day 1 will cover introduction to deep learning and applications to computer vision
• Day 2 will cover applications to natural language processing

There will be eight sessions of two hours each over two days.

Session 1: Deep Learning (DL) Theory

1. What is deep learning?
2. Use cases in computer vision and natural language processing.
3. Overview of the building blocks
   • Neurons
   • Activation functions
   • Back propagation algorithm
   • Stochastic gradient descent
   • Adaptive learning
   • Momentum

Session 2: DL for Computer Vision

1. Introduction to problem and data-set
2. Working on the cloud, including keras and tensorflow
3. Build your first DL Model - Multi-layer Perceptron (MLP)

Session 3: Convolutional Neural Networks (CNN)

1. Concept of Convolution, Max-pooling and Dropouts
2. Build your second DL Model - CNN
3. Tricks to improve your model
   • Augment your training data
   • Batch normalization

Session 4: Transfer Learning

1. Concept of Transfer Learning
2. Build your third DL Model - Leverage pre-trained models
3. Deploying your DL model on the cloud

Session 5: DL for Natural Language Processing (NLP)

1. Challenges with traditional NLP techniques
2. Concept of Word Embedding - word2vec
3. Build your fourth DL Model - MLP using word2vec

Session 6: Recurrent Neural Networks (RNN)

1. Concept of RNNs
2. Concept of Long Short-Term Memory (LSTM)
3. Build your fifth DL Model - LSTM

Session 7: Build your DL Applications

1. Concept of Sequence-to-Sequence Learning
2. Build your sixth DL Model - Text Generation
3. Deploy it as a bot (e.g. TweetBot / ChatBot)

Session 8: Advanced Topics in DL (Theory)

1. Challenges in building DL apps
2. Concept of Generative Adversarial Network
3. Moving beyond Classification e.g. Object Detection
4. Concept of DL for Unsupervised Learning
5. Concept of Reinforcement Learning
6. Where to go from here

“All knowledge is connected to all other knowledge. The fun is in making the connections.” — Arthur Aufderheide

Deep Learning Bootcamp

The objective for the Deep Learning bootcamp is to ensure that the participants have enough theory and practical concepts of building a deep learning solution in the space of computer vision and natural language processing. Post the bootcamp, all the participants would be familiar with the following key concepts and would be able to apply them to a problem.

Key Deep Learning Concept

• Theory: DL Motivation, Back-propagation, Activation
• Paradigms: Supervised, Unsupervised
• Models: Architecture, Pre-trained Models (Transfer Learning)
• Methods: Perceptron, Convolution, Pooling, Dropouts, Recurrent, LSTM
• Process: Setup, Encoding, Training, Serving
• Tools: python-data-stack, keras, tensorflow

Resources

The material for the bootcamp is hosted on github:

• For Image: https://github.com/rouseguy/DeepLearning-Image
• For NLP: https://github.com/rouseguy/DeepLearning-NLP

This is from the popular bootcamp series by the speakers on deep learning. Additional materials relevant to learning Deep Learning would be shared prior to the bootcamp.

Target Audience

• A machine learning practitioner
• A programmer interested in building data science products
• Anyone (researcher, student, professional) learning machine learning
• Corporates and Start-ups looking to add DL to their product or service offerings

Pre-requisites

• This is a hands-on course and hence, participants should be comfortable with programming. Familiarity with python data stack is ideal.
• Prior knowledge of machine learning will be helpful. Participants should have some practice with basic machine learning problems e.g. regression, classification.
• While the DL concepts will be taught in an intuitive way, some prior knowledge of linear algebra and calculus would be helpful.

Software Requirements

We will be using Python data stack for the bootcamp with keras and tensorflow for the deep learning component. Please install Ananconda for Python 3 for the bootcamp. Additional requirement will be communicated to participants.