SlideShare a Scribd company logo
Dr. Miguel Fierro
Data Scientist at Microsoft
@miguelgfierro
https://miguelgfierro.com
Intelligent Cloud GBB Ready | Lisbon Sept 2017
Deep learning solutions Deep learning tecniques
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: wikipedia
“Our strategy is to
build best-in-class
platforms and services
for an intelligent cloud
and an intelligent
edge infused with
artificial intelligence”
source: annual report 2017
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: PwC AI analysis 2017
BIGGEST
OPPORTUNITY$15.7Trillion by 2030 ~ 14% GPD
Productivity gains ($6.6T)
Automation
Increased demand ($9.1T)
Augmentation Higher quality products
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: PwC AI analysis 2017
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
DNNs (learn complex patterns
on HUGE amounts of data)
Intelligent applications … such as….
Cloud (flexibility, scalability, efficiency)
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Speech
recognition
Natural Language
Processing
Computer
Vision
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
“The more data,
The better it works*”
* always read the small print
source: https://xkcd.com/1838/
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Best bet to solve intelligence
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
wait, wait, wait…
What makes deep learning deep?
input hidden output
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
input hidden hidden hidden hidden output
…
…
…
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: http://www.iro.umontreal.ca/~bengioy/yoshua_en/
“Learning multiple levels of
representation to help a learner
accomplish a task of interest,
with higher levels capturing
more abstract concepts
through a deeper composition
of computations”
Yoshua Bengio
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
low level features high level featuresmedium level features
Interesting paper about representations: https://arxiv.org/abs/1411.1792
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Convolutional Neural Networks
(CNN)
Recurrent Neural Networks
(RNN)
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
MNIST with CNNs
(source here)
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: https://www.cs.toronto.edu/~kriz/cifar.html
CIFAR with ResNet CNN
(source here)
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Object detection with FasterRCNN
(source here)
dog
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Transfer Learning with CNNs
(source here)
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Video classification with 3D CNNs
(source here)
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Text classification with
CNNs (source here)
Input text: “It was a breeze to configure and worked straight away”
Books Electronics
Home &
Kitchen
Clothing Movies Health Sports
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Speech recognition
with LSTMs
(source here)
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Time series forecasting
with LSTMs (source here)
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Autoencoders (source here)
Original Learned
Encoder Decoder
Low dimensional
representation
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Reinforcement Learning
tutorial (basic & advanced)
source: wikipedia
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Generative Adversarial Networks (GANs)
tutorial (source here)
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Diagnosis augmentation for lung cancer detection
3D CNN for nodule segmentation +
CNN for nodule classification (info1, info2)
CT scan: horizontal section of lung
Patient health monitoring with sensors (IoT):
Autoencoder on normal class +
reconstruction error abnormal class (info)
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Predictive maintenance with sensors:
LSTM for classification
Visual fault detection in components:
Transfer learning with CNNs
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Generative
Asset wealth management and prediction:
Reinforcement Learning for optimal action
policy
Bots for insurance policy management:
LSTM&CNN for speech recognition+
CNN for recommendation system
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Route optimization:
Reinforcement Learning
Inventory optimization:
LSTM
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Content recommendation:
CNNs featurization + clustering
Personalized marketing:
CNN featurization + clustering
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Personalized fashion design and
production:
CNNs for image classification +
GANs for image generation
Customer demand forecasting:
LSTM
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Demand forecasting:
LSTM
Predictive maintenance:
LSTM
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Supply chain defect reduction
based on images:
Transfer learning with CNNs
On-demand production:
LSTM
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: https://github.com/Azure/fast_retraining
Degradation of accuracy
with new data
Airline delay prediction
You need to retrain!!!
Deep learning solutions Deep learning tecniques
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Learning can be viewed as finding
a and b in:
y = a.x + b
y (outputs)
x (inputs)
a,b (parameters)
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
y = a.x + b
1 = a.1 + b
5 = a.5 + b
= a. + b
a=1 b=0
e = ytrue – ypred
ytrue=1
ypred depends on a,b
optimize a,b so e is
minimum
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: R. Rojas: Neural Networks, Springer-Verlag, Berlin, 1996
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Sharpening filter
Laplacian filter
Sobel x-axis filter
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Convolution Pooling PoolingConvolution
Fully
connected
Fully
connected
Input image Output
predictions
"tabby cat"
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Max pooling with 2x2 kernel and stride of 2x2
1 5 3 2
2 6 0 9
1 5 0 1
5 7 2 4
6 9
7 4
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
input hidden output
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
SoftmaxReLUtanh
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: Introduction to Natural Language Processing with FastText
Mappings of discrete objects to a high
dimensional space
bird: (1.072, 4.245, …)
dove: (1.134, 4.079, …)
woman: (-1.385, -2.104, …)
man: (-2.207, 2.118, …)
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
input
hidden
output
hidden
hidden
ti ti+1 ti+2 ti+3
…
…
…
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
number of layers
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
source: https://en.wikipedia.org/wiki/Long_short-term_memory
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
CNTK
TensorFlow
https://github.com/ilkarman/DeepLearningFrameworks: 5 frameworks, same problem
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
GIVE ME DATA!!!!
CONCEPT DRIFT IS YOUR FRIEND
MASTER THE CORE PRINCIPLES
KNOW THE FRAMEWORKS&TOOLS
Dr. Miguel Fierro
Data Scientist at Microsoft
@miguelgfierro
https://miguelgfierro.com
Intelligent Cloud GBB Ready | Lisbon Sept 2017
Intelligent Cloud GBB Ready Lisbon 2017
The code from these slides is published at:
https://github.com/ilkarman/DeepLearningFrameworks
Attribution of some images:
• http://morguefile.com
• https://unsplash.com
• Ana Corrales Photography
• http://wikipedia.org
Dataset citation:
• CIFAR-10. Learning Multiple Layers of Features from Tiny
Images, Alex Krizhevsky, 2009.
https://www.cs.toronto.edu/~kriz/cifar.html
• IMDB. https://s3.amazonaws.com/text-datasets/imdb.npz

More Related Content

PDF
P 03 ml_demystified_2017_05_02_v7
PDF
The Essentials of PowerPoint Color Theme
PDF
P 02 internal_data_first_2017_04_22_v6
PDF
P 02 ta_in_uw_transformation_2017_06_13_v5
PDF
P 01 paw_methods_2017_10_30_v4
PDF
Introduction to Machine Learning for Heathcare, Finance, Energy, and Commerce...
PDF
Tracxn Research — Enterprise Collaboration Landscape, November 2016
PDF
Python for Image Understanding: Deep Learning with Convolutional Neural Nets
P 03 ml_demystified_2017_05_02_v7
The Essentials of PowerPoint Color Theme
P 02 internal_data_first_2017_04_22_v6
P 02 ta_in_uw_transformation_2017_06_13_v5
P 01 paw_methods_2017_10_30_v4
Introduction to Machine Learning for Heathcare, Finance, Energy, and Commerce...
Tracxn Research — Enterprise Collaboration Landscape, November 2016
Python for Image Understanding: Deep Learning with Convolutional Neural Nets

Viewers also liked (8)

PPTX
Artificial Intelligence (AI) for Financial Services
PPTX
14 Startups Leading the Artificial Intelligence (AI) Revolution
PDF
Transform your Business with AI, Deep Learning and Machine Learning
PDF
The Spring of AI : Leveraging Collective Disruptor Insights
PPTX
Deep neural networks
PDF
[DSC 2016] 系列活動:李宏毅 / 一天搞懂深度學習
PDF
Deep Learning - The Past, Present and Future of Artificial Intelligence
PDF
How to Become a Thought Leader in Your Niche
Artificial Intelligence (AI) for Financial Services
14 Startups Leading the Artificial Intelligence (AI) Revolution
Transform your Business with AI, Deep Learning and Machine Learning
The Spring of AI : Leveraging Collective Disruptor Insights
Deep neural networks
[DSC 2016] 系列活動:李宏毅 / 一天搞懂深度學習
Deep Learning - The Past, Present and Future of Artificial Intelligence
How to Become a Thought Leader in Your Niche
Ad

Similar to Deep Learning for Sales Professionals (20)

PDF
Using Eclipse technologies to develop the BRAIN-IoT model-based framework for...
PDF
Bridging the Physical and digital Adances in wearables and consumer IOT; Rani...
PDF
noProj.aa1.ro » M&ES4DE/DD-IT&C+A
PDF
FITCE Congress 2017, Madrid - Raf Meersman (CEO, Comsof)
PDF
OSMC 2018 | Monitoring Distributed Systems by Philip Griesbacher
PPTX
BDE: Concepts, Platform and Pilots
PDF
Challenges in the Future Power Network
PPTX
IoT Architectural Overview - 3 use case studies from InfluxData
PDF
Leveraging Data Driven Research Through Microsoft Azure
PDF
Wolfgang Spiess–Knafl - Blockchain and social impact
PDF
2nd International Conference on Big Data, IOT & NLP (BINLP 2022)
PPTX
Back to the future - Future Proof IT 2017
PPTX
Is AI generation the next platform shift?
PDF
Call for papers..! 5th International Conference on Big Data, IOT & NLP (BINL...
PPTX
The BlueBRIDGE Project - Pasquale Pagano
PDF
Mastering AI Workflows with FME - Peak of Data & AI 2025
PDF
Mastering AI Workflows with FME by Mark Döring
PDF
Keynote - Fujitsu Innovation Gathering,
PDF
Knowledge Graph Recommendation Systems For COVID-19
Using Eclipse technologies to develop the BRAIN-IoT model-based framework for...
Bridging the Physical and digital Adances in wearables and consumer IOT; Rani...
noProj.aa1.ro » M&ES4DE/DD-IT&C+A
FITCE Congress 2017, Madrid - Raf Meersman (CEO, Comsof)
OSMC 2018 | Monitoring Distributed Systems by Philip Griesbacher
BDE: Concepts, Platform and Pilots
Challenges in the Future Power Network
IoT Architectural Overview - 3 use case studies from InfluxData
Leveraging Data Driven Research Through Microsoft Azure
Wolfgang Spiess–Knafl - Blockchain and social impact
2nd International Conference on Big Data, IOT & NLP (BINLP 2022)
Back to the future - Future Proof IT 2017
Is AI generation the next platform shift?
Call for papers..! 5th International Conference on Big Data, IOT & NLP (BINL...
The BlueBRIDGE Project - Pasquale Pagano
Mastering AI Workflows with FME - Peak of Data & AI 2025
Mastering AI Workflows with FME by Mark Döring
Keynote - Fujitsu Innovation Gathering,
Knowledge Graph Recommendation Systems For COVID-19
Ad

More from Miguel González-Fierro (10)

PPTX
Los retos de la inteligencia artificial en la sociedad actual
PDF
Thesis dissertation: Humanoid Robot Control of Complex Postural Tasks based o...
PPTX
Best practices in coding for beginners
PDF
Distributed training of Deep Learning Models
PPTX
Running Intelligent Applications inside a Database: Deep Learning with Python...
PPTX
Deep Learning for Lung Cancer Detection
PPTX
Mastering Computer Vision Problems with State-of-the-art Deep Learning
PPTX
Speeding up machine-learning applications with the LightGBM library
PDF
Empowering every person on the planet to achieve more
PDF
Deep Learning for NLP
Los retos de la inteligencia artificial en la sociedad actual
Thesis dissertation: Humanoid Robot Control of Complex Postural Tasks based o...
Best practices in coding for beginners
Distributed training of Deep Learning Models
Running Intelligent Applications inside a Database: Deep Learning with Python...
Deep Learning for Lung Cancer Detection
Mastering Computer Vision Problems with State-of-the-art Deep Learning
Speeding up machine-learning applications with the LightGBM library
Empowering every person on the planet to achieve more
Deep Learning for NLP

Recently uploaded (20)

PPTX
Acceptance and paychological effects of mandatory extra coach I classes.pptx
PPTX
Database Infoormation System (DBIS).pptx
PPT
ISS -ESG Data flows What is ESG and HowHow
PDF
REAL ILLUMINATI AGENT IN KAMPALA UGANDA CALL ON+256765750853/0705037305
PPTX
STERILIZATION AND DISINFECTION-1.ppthhhbx
PDF
Data Engineering Interview Questions & Answers Cloud Data Stacks (AWS, Azure,...
PPTX
Microsoft-Fabric-Unifying-Analytics-for-the-Modern-Enterprise Solution.pptx
PPTX
modul_python (1).pptx for professional and student
PPTX
climate analysis of Dhaka ,Banglades.pptx
PPTX
SAP 2 completion done . PRESENTATION.pptx
PDF
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
PPTX
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
PPTX
Pilar Kemerdekaan dan Identi Bangsa.pptx
PDF
Galatica Smart Energy Infrastructure Startup Pitch Deck
PDF
Lecture1 pattern recognition............
PDF
Business Analytics and business intelligence.pdf
PDF
Capcut Pro Crack For PC Latest Version {Fully Unlocked 2025}
PPTX
Modelling in Business Intelligence , information system
PDF
[EN] Industrial Machine Downtime Prediction
Acceptance and paychological effects of mandatory extra coach I classes.pptx
Database Infoormation System (DBIS).pptx
ISS -ESG Data flows What is ESG and HowHow
REAL ILLUMINATI AGENT IN KAMPALA UGANDA CALL ON+256765750853/0705037305
STERILIZATION AND DISINFECTION-1.ppthhhbx
Data Engineering Interview Questions & Answers Cloud Data Stacks (AWS, Azure,...
Microsoft-Fabric-Unifying-Analytics-for-the-Modern-Enterprise Solution.pptx
modul_python (1).pptx for professional and student
climate analysis of Dhaka ,Banglades.pptx
SAP 2 completion done . PRESENTATION.pptx
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
Pilar Kemerdekaan dan Identi Bangsa.pptx
Galatica Smart Energy Infrastructure Startup Pitch Deck
Lecture1 pattern recognition............
Business Analytics and business intelligence.pdf
Capcut Pro Crack For PC Latest Version {Fully Unlocked 2025}
Modelling in Business Intelligence , information system
[EN] Industrial Machine Downtime Prediction

Deep Learning for Sales Professionals

  • 1. Dr. Miguel Fierro Data Scientist at Microsoft @miguelgfierro https://miguelgfierro.com Intelligent Cloud GBB Ready | Lisbon Sept 2017
  • 2. Deep learning solutions Deep learning tecniques
  • 3. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: wikipedia “Our strategy is to build best-in-class platforms and services for an intelligent cloud and an intelligent edge infused with artificial intelligence” source: annual report 2017
  • 4. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: PwC AI analysis 2017 BIGGEST OPPORTUNITY$15.7Trillion by 2030 ~ 14% GPD Productivity gains ($6.6T) Automation Increased demand ($9.1T) Augmentation Higher quality products
  • 5. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: PwC AI analysis 2017
  • 6. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro DNNs (learn complex patterns on HUGE amounts of data) Intelligent applications … such as…. Cloud (flexibility, scalability, efficiency)
  • 7. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 8. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Speech recognition Natural Language Processing Computer Vision
  • 9. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro “The more data, The better it works*” * always read the small print source: https://xkcd.com/1838/
  • 10. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Best bet to solve intelligence
  • 11. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro wait, wait, wait… What makes deep learning deep? input hidden output
  • 12. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro input hidden hidden hidden hidden output … … …
  • 13. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: http://www.iro.umontreal.ca/~bengioy/yoshua_en/ “Learning multiple levels of representation to help a learner accomplish a task of interest, with higher levels capturing more abstract concepts through a deeper composition of computations” Yoshua Bengio
  • 14. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro low level features high level featuresmedium level features Interesting paper about representations: https://arxiv.org/abs/1411.1792
  • 15. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Convolutional Neural Networks (CNN) Recurrent Neural Networks (RNN)
  • 16. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro MNIST with CNNs (source here)
  • 17. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: https://www.cs.toronto.edu/~kriz/cifar.html CIFAR with ResNet CNN (source here)
  • 18. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Object detection with FasterRCNN (source here) dog
  • 19. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Transfer Learning with CNNs (source here)
  • 20. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Video classification with 3D CNNs (source here)
  • 21. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Text classification with CNNs (source here) Input text: “It was a breeze to configure and worked straight away” Books Electronics Home & Kitchen Clothing Movies Health Sports
  • 22. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Speech recognition with LSTMs (source here)
  • 23. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Time series forecasting with LSTMs (source here)
  • 24. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Autoencoders (source here) Original Learned Encoder Decoder Low dimensional representation
  • 25. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Reinforcement Learning tutorial (basic & advanced) source: wikipedia
  • 26. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Generative Adversarial Networks (GANs) tutorial (source here)
  • 27. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Diagnosis augmentation for lung cancer detection 3D CNN for nodule segmentation + CNN for nodule classification (info1, info2) CT scan: horizontal section of lung Patient health monitoring with sensors (IoT): Autoencoder on normal class + reconstruction error abnormal class (info)
  • 28. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Predictive maintenance with sensors: LSTM for classification Visual fault detection in components: Transfer learning with CNNs
  • 29. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Generative Asset wealth management and prediction: Reinforcement Learning for optimal action policy Bots for insurance policy management: LSTM&CNN for speech recognition+ CNN for recommendation system
  • 30. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Route optimization: Reinforcement Learning Inventory optimization: LSTM
  • 31. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Content recommendation: CNNs featurization + clustering Personalized marketing: CNN featurization + clustering
  • 32. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Personalized fashion design and production: CNNs for image classification + GANs for image generation Customer demand forecasting: LSTM
  • 33. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Demand forecasting: LSTM Predictive maintenance: LSTM
  • 34. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Supply chain defect reduction based on images: Transfer learning with CNNs On-demand production: LSTM
  • 35. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: https://github.com/Azure/fast_retraining Degradation of accuracy with new data Airline delay prediction You need to retrain!!!
  • 36. Deep learning solutions Deep learning tecniques
  • 37. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Learning can be viewed as finding a and b in: y = a.x + b y (outputs) x (inputs) a,b (parameters)
  • 38. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro y = a.x + b 1 = a.1 + b 5 = a.5 + b = a. + b a=1 b=0 e = ytrue – ypred ytrue=1 ypred depends on a,b optimize a,b so e is minimum
  • 39. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: R. Rojas: Neural Networks, Springer-Verlag, Berlin, 1996
  • 40. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Sharpening filter Laplacian filter Sobel x-axis filter
  • 41. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Convolution Pooling PoolingConvolution Fully connected Fully connected Input image Output predictions "tabby cat"
  • 42. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro Max pooling with 2x2 kernel and stride of 2x2 1 5 3 2 2 6 0 9 1 5 0 1 5 7 2 4 6 9 7 4
  • 43. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro input hidden output
  • 44. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro SoftmaxReLUtanh
  • 45. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: Introduction to Natural Language Processing with FastText Mappings of discrete objects to a high dimensional space bird: (1.072, 4.245, …) dove: (1.134, 4.079, …) woman: (-1.385, -2.104, …) man: (-2.207, 2.118, …)
  • 46. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro input hidden output hidden hidden ti ti+1 ti+2 ti+3 … … …
  • 47. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro number of layers
  • 48. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro source: https://en.wikipedia.org/wiki/Long_short-term_memory
  • 49. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro CNTK TensorFlow https://github.com/ilkarman/DeepLearningFrameworks: 5 frameworks, same problem
  • 50. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 51. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 52. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 53. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 54. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 55. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 56. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 57. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 58. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 59. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 60. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 61. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 62. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 63. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 64. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 65. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 66. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 67. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 68. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 69. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 70. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 71. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 72. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 73. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro
  • 74. Intelligent Cloud GBB Ready Lisbon 2017 - Dr. Miguel Fierro @miguelgfierro GIVE ME DATA!!!! CONCEPT DRIFT IS YOUR FRIEND MASTER THE CORE PRINCIPLES KNOW THE FRAMEWORKS&TOOLS
  • 75. Dr. Miguel Fierro Data Scientist at Microsoft @miguelgfierro https://miguelgfierro.com Intelligent Cloud GBB Ready | Lisbon Sept 2017
  • 76. Intelligent Cloud GBB Ready Lisbon 2017 The code from these slides is published at: https://github.com/ilkarman/DeepLearningFrameworks Attribution of some images: • http://morguefile.com • https://unsplash.com • Ana Corrales Photography • http://wikipedia.org Dataset citation: • CIFAR-10. Learning Multiple Layers of Features from Tiny Images, Alex Krizhevsky, 2009. https://www.cs.toronto.edu/~kriz/cifar.html • IMDB. https://s3.amazonaws.com/text-datasets/imdb.npz