SlideShare a Scribd company logo
利用 Container Instance
部署深度學習應用
Deploy Deep Learning Application with
Azure Container Instance - Mia Chang
利用 Container Instance 部署深度學習應用
Deploy Deep Learning Application with Azure Container Instance
WHY AM I HERE...
Microsoft Data Platform MVP
MY JOB TITLE...
Data Scientist
Computer Vision/Algorithm Research
AS A COMMUNITY Co-Organizer
R-Ladies Taipei, Azure Taiwan,
Tech Podcast Night
Mia
mia5419@gmail.com
pymia @github
WHAT BRINGS YOU HERE? Container Instance
深度學習應用
部署
Developer
Data Scientist
IT Pro
Else
Deep Learning Application
Deploy
利用 Container Instance 部署深度學習應用
那些成為資料科學家秘技之外的事。
Those Behind The Scenes...
https://blog.udacity.com/wp-content/uploads/2014/11/Data-Science-Skills-Udacity-Matrix.png
https://docs.microsoft.com/en-us/azure/machine-learning/team-data-science-process/overview
https://docs.microsoft.com/en-us/azure/machine-learning/team-data-science-process/overview
Data Scientist vs Data Scientist
Tensorflow Update
https://lh3.googleusercontent.com/Ns1ea98duQ9csaHN7EQjl6SbnLMxg_ou9bLhZA8KLqbeSv7gg7XXGX1rqtWXgnjiJjBQpiTZWyxIhtxjnWPKTM27-J9T0QI=s688
Use Scenarios
Tensorflow Update
https://lh3.googleusercontent.com/Ns1ea98duQ9csaHN7EQjl6SbnLMxg_ou9bLhZA8KLqbeSv7gg7XXGX1rqtWXgnjiJjBQpiTZWyxIhtxjnWPKTM27-J9T0QI=s688
Use Scenarios
Tensorflow Update Pip Update Can’t Find Waldo
Use Scenarios
https://lh3.googleusercontent.com/Ns1ea98duQ9csaHN7EQjl6SbnLMxg_ou9bLhZA8KLqbeSv7gg7XXGX1rqtWXgnjiJjBQpiTZWyxIhtxjnWPKTM27-J9T0QI=s688
Deploy Deep Learning Application with Azure Container Instance - Devdays2018
Deploy Deep Learning Application with Azure Container Instance - Devdays2018
Deploy Deep Learning Application with Azure Container Instance - Devdays2018
Deploy Deep Learning Application with Azure Container Instance - Devdays2018
Data Scientist vs Solution Architect
https://docs.microsoft.com/en-us/azure/machine-learning/team-data-science-process/overview
Reproduce it with Docker
•Docker provides you with an easy way to share your
working environments including libraries and drivers. This
enables us to create reproducible data science workflows.
The container advantage
Fast
iteration
Agile
delivery
Immutability Cost
savings
Elastic
bursting
Efficient
deployment
For ITFor developers
Industry analysts agree
“By 2020, more than 50% of enterprises will run
mission-critical, containerized cloud-native applications in
production, up from less than 5% today.”
Deploy Deep Learning Application with Azure Container Instance - Devdays2018
Deploy Deep Learning Application with Azure Container Instance - Devdays2018
If you need more reference …https://www.datadoghq.com/docker-adoption/
Microsoft Confidential
今日頭條
Python开发者最流行的框架、库和工具是什么?
云智时代 2018-04-01 22:05:22
Microsoft Confidential
Jupyter Notebook是与Python一起
使用的最流行的技术。Docker以
29%排名第二。
?
Microsoft Confidential
Microsoft Confidential
Microsoft Confidential
Best Time to Use Docker
# Start a new project, and develop with that env
# Co-work with your team
# When we would like deploy our product
Demo
Local Env
Microsoft Confidentialhttps://github.com/linkernetworks/environments
Demo
Azure Env
Deploy Deep Learning Application with Azure Container Instance - Devdays2018
Deploy Deep Learning Application with Azure Container Instance - Devdays2018
Deploy Deep Learning Application with Azure Container Instance - Devdays2018
Deploy Deep Learning Application with Azure Container Instance - Devdays2018
Deploy Deep Learning Application with Azure Container Instance - Devdays2018
Deploy Deep Learning Application with Azure Container Instance - Devdays2018
Reference:
Tips to build a nice Dockerfile
Microsoft Confidential
FROM jjanzic/docker-python3-opencv:contrib-opencv-3.4.0
WORKDIR /
RUN pip install --upgrade pip 
&& pip install --no-cache-dir -e
'git+https://github.com/ahundt/cocoapi.git#egg=pycocotools
&subdirectory=PythonAPI' 
&& pip install --no-cache-dir requests 
&& pip install --no-cache-dir orderedset 
&& pip install --no-cache-dir pandas 
&& pip install --no-cache-dir tensorflow 
&& pip install --no-cache-dir keras 
&& pip install --no-cache-dir dlib 
&& pip install --no-cache-dir flask_restful 
&& pip install --no-cache-dir psutil 
&& pip install --no-cache-dir pymongo 
&& pip install --no-cache-dir docker
# testing
RUN pip install --no-cache-dir requests-mock 
&& pip install --no-cache-dir nose 
&& pip install --no-cache-dir coverage 
&& pip install --no-cache-dir nosexcover
# darkflow
RUN git clone https://github.com/thtrieu/darkflow.git 
&& pip install --no-cache-dir darkflow/. 
&& rm -rf darkflow
ENV PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION
python
COPY . /inference
RUN pip install --no-cache-dir --timeout 1000 /inference/. 
&& rm -rf ~/.cache/pip
Microsoft Confidential
Tips to build a nice Dockerfile
Microsoft Confidential
Tips to build a nice Dockerfile
Tips to build a nice Dockerfile
https://github.com/bcbcarl/docker-rladies-taipei
Reference:
Practice At Home
https://www.tibame.com/course/350
https://www.meetup.com/Azure-Taiwan/events/249669489/
Deploy Deep Learning Application with Azure Container Instance - Devdays2018
Microsoft Confidentialhttps://github.com/pymia/AKSDeploymentTutorial
Deploy Deep Learning Application with Azure Container Instance - Devdays2018
https://hackmd.io/i_nZbPXQTj6xkMxaOcQF5Q?view
Thank you
Mia
mia5419@gmail.com
pymia @github
https://www.linkedin.com/in/mia-chang
/

More Related Content

What's hot (20)

PDF
React NativeアプリをRspecでテストしてみた話
KyokoMitsuoka
 
PDF
Metasepi team meeting #8': Haskell apps on Android NDK
Kiwamu Okabe
 
PDF
Distributed tracing for Node.js
Nikolay Stoitsev
 
ODP
Migrating to Git: Rethinking the Commit
Kim Moir
 
PDF
Observability
Diego Pacheco
 
PPTX
利用.NET Core 與 Azure Kubernetes Service (AKS) 建立高彈性 Microservices (Azure TechDay)
Will Huang
 
PDF
Ať se z kódu nepráší! 2013
Juraj Michálek
 
PDF
Docker to the Rescue of an Ops Team
Rachid Zarouali
 
PDF
Managing your Docker image continuously with Concourse CI
Toshiaki Maki
 
PPTX
The Jenkins Plugin for OpenStack
Maish Saidel-Keesing
 
PDF
Concourse x Spinnaker #concourse_tokyo
Toshiaki Maki
 
PDF
Remote monitoring widget setup and customization
Caesar Chi
 
PDF
Netflix Nebula - Gradle Summit 2014
Justin Ryan
 
PDF
MenloHacks Workshop 2019
Bruce Lin
 
ODP
Broadcast presentation
Panoptic Development, Inc.
 
PDF
SF Gradle Meetup - Netflix OSS
Justin Ryan
 
PDF
Deploy your Python code on Azure Functions
Dhilipsiva DS
 
PDF
やっとでた! OpenStack Manila
Takeshi Kuramochi
 
PPTX
Memaksimalkan Non-Blocking IO pada Node.js
CodePolitan
 
PDF
Firebaseの運用に役立つTips5
ME iBotch
 
React NativeアプリをRspecでテストしてみた話
KyokoMitsuoka
 
Metasepi team meeting #8': Haskell apps on Android NDK
Kiwamu Okabe
 
Distributed tracing for Node.js
Nikolay Stoitsev
 
Migrating to Git: Rethinking the Commit
Kim Moir
 
Observability
Diego Pacheco
 
利用.NET Core 與 Azure Kubernetes Service (AKS) 建立高彈性 Microservices (Azure TechDay)
Will Huang
 
Ať se z kódu nepráší! 2013
Juraj Michálek
 
Docker to the Rescue of an Ops Team
Rachid Zarouali
 
Managing your Docker image continuously with Concourse CI
Toshiaki Maki
 
The Jenkins Plugin for OpenStack
Maish Saidel-Keesing
 
Concourse x Spinnaker #concourse_tokyo
Toshiaki Maki
 
Remote monitoring widget setup and customization
Caesar Chi
 
Netflix Nebula - Gradle Summit 2014
Justin Ryan
 
MenloHacks Workshop 2019
Bruce Lin
 
Broadcast presentation
Panoptic Development, Inc.
 
SF Gradle Meetup - Netflix OSS
Justin Ryan
 
Deploy your Python code on Azure Functions
Dhilipsiva DS
 
やっとでた! OpenStack Manila
Takeshi Kuramochi
 
Memaksimalkan Non-Blocking IO pada Node.js
CodePolitan
 
Firebaseの運用に役立つTips5
ME iBotch
 

Similar to Deploy Deep Learning Application with Azure Container Instance - Devdays2018 (20)

PDF
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Anthony Dahanne
 
PPTX
No more Dockerfiles? Buildpacks to help you ship your image!
Anthony Dahanne
 
PDF
Week 4 lecture material cc (1)
Ankit Gupta
 
PDF
week 4_watermark.pdfffffffffffffffffffff
anushka2002ece
 
PDF
Continuous Deployment @ AWS Re:Invent
John Schneider
 
PDF
A Love Story with Kubevirt and Backstage from Cloud Native NoVA meetup Feb 2024
Cloud Native NoVA
 
PPTX
CNCF Québec Meetup du 16 Novembre 2023
Anthony Dahanne
 
PDF
Using apache mx net in production deep learning streaming pipelines
Timothy Spann
 
PDF
Docker for data science
Calvin Giles
 
PDF
Virtualization and Cloud Computing with Elastic Server On Demand
Yan Pritzker
 
PDF
OpenStack Murano introduction
Victor Zhang
 
PDF
Building CI pipeline based on TeamCity & Docker in Android Team
Paweł Gajda
 
PPTX
drupal ci cd concept cornel univercity.pptx
rukuntravel
 
PPTX
Azure from scratch part 4
Girish Kalamati
 
PPTX
Serverless survival kit
Steve Houël
 
PDF
Docker včera, dnes a zítra
Ladislav Prskavec
 
PPTX
There and Back Again (My DevOps journey) - DevOps Days Copenhagen 2018
Giulio Vian
 
PDF
TIAD - DYI: A simple orchestrator built step by step
The Incredible Automation Day
 
PDF
'DOCKER' & CLOUD: ENABLERS For DEVOPS
ACA IT-Solutions
 
PDF
Docker and Cloud - Enables for DevOps - by ACA-IT
Stijn Wijndaele
 
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Anthony Dahanne
 
No more Dockerfiles? Buildpacks to help you ship your image!
Anthony Dahanne
 
Week 4 lecture material cc (1)
Ankit Gupta
 
week 4_watermark.pdfffffffffffffffffffff
anushka2002ece
 
Continuous Deployment @ AWS Re:Invent
John Schneider
 
A Love Story with Kubevirt and Backstage from Cloud Native NoVA meetup Feb 2024
Cloud Native NoVA
 
CNCF Québec Meetup du 16 Novembre 2023
Anthony Dahanne
 
Using apache mx net in production deep learning streaming pipelines
Timothy Spann
 
Docker for data science
Calvin Giles
 
Virtualization and Cloud Computing with Elastic Server On Demand
Yan Pritzker
 
OpenStack Murano introduction
Victor Zhang
 
Building CI pipeline based on TeamCity & Docker in Android Team
Paweł Gajda
 
drupal ci cd concept cornel univercity.pptx
rukuntravel
 
Azure from scratch part 4
Girish Kalamati
 
Serverless survival kit
Steve Houël
 
Docker včera, dnes a zítra
Ladislav Prskavec
 
There and Back Again (My DevOps journey) - DevOps Days Copenhagen 2018
Giulio Vian
 
TIAD - DYI: A simple orchestrator built step by step
The Incredible Automation Day
 
'DOCKER' & CLOUD: ENABLERS For DEVOPS
ACA IT-Solutions
 
Docker and Cloud - Enables for DevOps - by ACA-IT
Stijn Wijndaele
 
Ad

More from Mia Chang (11)

PDF
Evaluating Large Language Models for Your Applications and Why It Matters
Mia Chang
 
PDF
Running the first automatic speech recognition (ASR) model with HuggingFace -...
Mia Chang
 
PDF
7 steps to AI production - global azure bootcamp 2020 Koln
Mia Chang
 
PDF
TensorFlow Lite for mobile & IoT
Mia Chang
 
PDF
DPS2019 data scientist in the real estate industry
Mia Chang
 
PDF
Leverage the power of machine learning on windows
Mia Chang
 
PDF
Develop computer vision applications with azure computer vision api
Mia Chang
 
PDF
The Art of Unit Testing Ch5-6
Mia Chang
 
PDF
What's AI, Machine Learning and Deep Learning - Talk @NCCU python 讀書會
Mia Chang
 
PDF
Play Kaggle with R, Facebook V: Predicting Check Ins
Mia Chang
 
PDF
twMVC#29 -Learning Machine Learning with Movie Recommendation
Mia Chang
 
Evaluating Large Language Models for Your Applications and Why It Matters
Mia Chang
 
Running the first automatic speech recognition (ASR) model with HuggingFace -...
Mia Chang
 
7 steps to AI production - global azure bootcamp 2020 Koln
Mia Chang
 
TensorFlow Lite for mobile & IoT
Mia Chang
 
DPS2019 data scientist in the real estate industry
Mia Chang
 
Leverage the power of machine learning on windows
Mia Chang
 
Develop computer vision applications with azure computer vision api
Mia Chang
 
The Art of Unit Testing Ch5-6
Mia Chang
 
What's AI, Machine Learning and Deep Learning - Talk @NCCU python 讀書會
Mia Chang
 
Play Kaggle with R, Facebook V: Predicting Check Ins
Mia Chang
 
twMVC#29 -Learning Machine Learning with Movie Recommendation
Mia Chang
 
Ad

Recently uploaded (20)

PPTX
Project_Update_Summary.for the use from PM
Odysseas Lekatsas
 
PPTX
How to Add Columns and Rows in an R Data Frame
subhashenia
 
PDF
Group 5_RMB Final Project on circular economy
pgban24anmola
 
PDF
SaleServicereport and SaleServicereport
2251330007
 
PPTX
Artificial intelligence Presentation1.pptx
SaritaMahajan5
 
PPTX
Cultural Diversity Presentation.pptx
Shwong11
 
PDF
UNISE-Operation-Procedure-InDHIS2trainng
ahmedabduselam23
 
PPT
Reliability Monitoring of Aircrfat commerce
Rizk2
 
PPTX
Feb 2021 Ransomware Recovery presentation.pptx
enginsayin1
 
PDF
Loading Data into Snowflake (Bulk & Stream)
Accentfuture
 
PPTX
Discrete Logarithm Problem in Cryptography (1).pptx
meshablinx38
 
PPTX
Presentation.pptx hhgihyugyygyijguuffddfffffff
abhiruppal2007
 
PPTX
Data Analytics using sparkabcdefghi.pptx
KarkuzhaliS3
 
PPTX
big data eco system fundamentals of data science
arivukarasi
 
PDF
A Web Repository System for Data Mining in Drug Discovery
IJDKP
 
PDF
Exploiting the Low Volatility Anomaly: A Low Beta Model Portfolio for Risk-Ad...
Bradley Norbom, CFA
 
DOCX
ACCOMPLISHMENT AS OF MAY 15 RCT ACCOMPLISHMENT AS OF MAY 15 RCT ACCOMPLISHMEN...
JoemarAgbayani1
 
PPTX
MENU-DRIVEN PROGRAM ON ARUNACHAL PRADESH.pptx
manvi200807
 
PDF
Informatics Market Insights AI Workforce.pdf
karizaroxx
 
PDF
Unlocking Insights: Introducing i-Metrics Asia-Pacific Corporation and Strate...
Janette Toral
 
Project_Update_Summary.for the use from PM
Odysseas Lekatsas
 
How to Add Columns and Rows in an R Data Frame
subhashenia
 
Group 5_RMB Final Project on circular economy
pgban24anmola
 
SaleServicereport and SaleServicereport
2251330007
 
Artificial intelligence Presentation1.pptx
SaritaMahajan5
 
Cultural Diversity Presentation.pptx
Shwong11
 
UNISE-Operation-Procedure-InDHIS2trainng
ahmedabduselam23
 
Reliability Monitoring of Aircrfat commerce
Rizk2
 
Feb 2021 Ransomware Recovery presentation.pptx
enginsayin1
 
Loading Data into Snowflake (Bulk & Stream)
Accentfuture
 
Discrete Logarithm Problem in Cryptography (1).pptx
meshablinx38
 
Presentation.pptx hhgihyugyygyijguuffddfffffff
abhiruppal2007
 
Data Analytics using sparkabcdefghi.pptx
KarkuzhaliS3
 
big data eco system fundamentals of data science
arivukarasi
 
A Web Repository System for Data Mining in Drug Discovery
IJDKP
 
Exploiting the Low Volatility Anomaly: A Low Beta Model Portfolio for Risk-Ad...
Bradley Norbom, CFA
 
ACCOMPLISHMENT AS OF MAY 15 RCT ACCOMPLISHMENT AS OF MAY 15 RCT ACCOMPLISHMEN...
JoemarAgbayani1
 
MENU-DRIVEN PROGRAM ON ARUNACHAL PRADESH.pptx
manvi200807
 
Informatics Market Insights AI Workforce.pdf
karizaroxx
 
Unlocking Insights: Introducing i-Metrics Asia-Pacific Corporation and Strate...
Janette Toral
 

Deploy Deep Learning Application with Azure Container Instance - Devdays2018