SlideShare a Scribd company logo
Building successful apps using
application telemetry and data driven
decisions
It’s time to t
Rakefet Jackoby Galazan
Senior Product Manager
It’s tough out there…
Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016
Answer questions like …
Telemetry is collected at each
tier: server backend, middleware,
web service & browser
Telemetry arrives to the APM
product where it is processed &
stored
Identify, understand and resolve
issues with powerful out-of-the-
box and custom telemetry
1
Outside-in monitoring
URL pings and web tests from different
global points of presence
Observed user behavior
How is the application being used?2
Observed application behavior
Service dependencies, queries,
response time, exceptions, logs, etc.
3
Developer traces and events
Whatever the developer would like to
send to the APM product
4
Infrastructure performance
System performance counters5
Plan
1 Monitor + Learn
ReleaseDevelop + Test
2
Development Production
4
3
Manage work
Develop + Test 1
Plan
Project starts
PlanTrack progress
Prioritization and validation of
investments not based on real data
Write Code
Unit Testing
2
Build
Version Control
Build Verification
Release
Once the iteration starts, developers
turn great ideas into features…
Develop + Test
Lack of collaboration between
development and operations
Load Testing
Integration testing
environment
Automated functional
testing environment
3
Pre-production
environment
Staging
environment
Monitor + Learn
Release
Inability to quickly detect, diagnose
and triage application issues
4
Monitor
Feedback
Plan the next iteration
Detect
Triage
Diagnose
 Machine learning algorithms for automatic detection
 Find disruptive trends and anomalous segments
 Correlated data for triage and fast diagnostics
 Configuration/customization may or may not be required
Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016
Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

More Related Content

PPTX
Performance Aware Development
PPTX
Key Findings from the 2019 State of DevOps Report
PDF
Take your code and quality to the next level by Serena Software
PDF
Jenkins Test Automation with codeBeamer ALM
PPTX
Dimensions CM Summer VUG Presentation
PPTX
How to Monitor Performance of your Jenkins Deployment
PPTX
Deploy Fast Without Breaking Things Webinar Presentation June 25
PPT
Integration testing overview
Performance Aware Development
Key Findings from the 2019 State of DevOps Report
Take your code and quality to the next level by Serena Software
Jenkins Test Automation with codeBeamer ALM
Dimensions CM Summer VUG Presentation
How to Monitor Performance of your Jenkins Deployment
Deploy Fast Without Breaking Things Webinar Presentation June 25
Integration testing overview

What's hot (20)

PPT
Income Tax Audit
PPTX
Selenium ide 1
PPTX
Performance Bottleneck Identification through Software Diagnostics- Impetus W...
PPTX
Towards continuous delivery by reducing the feature freeze period: a case study
PPTX
Software Engineering Layered Technology Software Process Framework
PDF
Task Management Solution
PDF
Embedded world 2017
PPTX
Inventory and Asset Management
PPT
Lecture 20 software testing (2)
PPTX
Application lifecycle management
PPTX
Security and Risk management in SDLC Software development Life cycle
PDF
[Europe merge world tour] Coverity Development Testing
PPTX
What's New? - February 2017
PPTX
Movie Rating Site [for presentation]
PDF
testCloud & Crittercism: How to Continuously Ensure Mobile App Quality
PPT
Introduction to Software Engineering 1
PPTX
Software maintenance
PPTX
Geekit_Testing_Services-3
Income Tax Audit
Selenium ide 1
Performance Bottleneck Identification through Software Diagnostics- Impetus W...
Towards continuous delivery by reducing the feature freeze period: a case study
Software Engineering Layered Technology Software Process Framework
Task Management Solution
Embedded world 2017
Inventory and Asset Management
Lecture 20 software testing (2)
Application lifecycle management
Security and Risk management in SDLC Software development Life cycle
[Europe merge world tour] Coverity Development Testing
What's New? - February 2017
Movie Rating Site [for presentation]
testCloud & Crittercism: How to Continuously Ensure Mobile App Quality
Introduction to Software Engineering 1
Software maintenance
Geekit_Testing_Services-3
Ad

Similar to Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016 (20)

PDF
Continuous Integration for z using Test Data Management and Application D...
PPTX
Continuous Performance Testing and Monitoring in Agile Development
DOC
Mohini
PDF
DevOps : Integrate, Deliver and Deploy continuously with Visual Studio Team S...
PPTX
Your application ever up-to-date? Go continuous delivery
DOCX
Pravin_CV_4+years
PPTX
Performance Continuous Integration
DOC
Software Lifecycle Management
PDF
Encontrando la Aguja en el Rendimiento de Aplicaciones
PPTX
Software Development Life Cycle-SDLC
PPTX
Software metrics
PDF
Continuous Delivery in the Enterprise
PPTX
IBM i Application Lifecycle Management with Remain Software
PDF
JUG Poznan - 2017.01.31
PPTX
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
DOC
Sanjay Sharma
PPTX
Agile and Continuous Delivery for Audits and Exams - DC Continuous Delivery M...
PPTX
Slide set 1 (Traditional Software Development) (1).pptx
PPTX
SplunkLive! London 2016 Splunk for Devops
Continuous Integration for z using Test Data Management and Application D...
Continuous Performance Testing and Monitoring in Agile Development
Mohini
DevOps : Integrate, Deliver and Deploy continuously with Visual Studio Team S...
Your application ever up-to-date? Go continuous delivery
Pravin_CV_4+years
Performance Continuous Integration
Software Lifecycle Management
Encontrando la Aguja en el Rendimiento de Aplicaciones
Software Development Life Cycle-SDLC
Software metrics
Continuous Delivery in the Enterprise
IBM i Application Lifecycle Management with Remain Software
JUG Poznan - 2017.01.31
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
Sanjay Sharma
Agile and Continuous Delivery for Audits and Exams - DC Continuous Delivery M...
Slide set 1 (Traditional Software Development) (1).pptx
SplunkLive! London 2016 Splunk for Devops
Ad

More from DevOpsDays Tel Aviv (20)

PDF
YOUR OPEN SOURCE PROJECT IS LIKE A STARTUP, TREAT IT LIKE ONE, EYAR ZILBERMAN...
PPTX
GRAPHQL TO THE RES(T)CUE, ELLA SHARAKANSKI, Salto
PPTX
MICROSERVICES ABOVE THE CLOUD - DESIGNING THE INTERNATIONAL SPACE STATION FOR...
PPTX
THE (IR)RATIONAL INCIDENT RESPONSE: HOW PSYCHOLOGICAL BIASES AFFECT INCIDENT ...
PPTX
PRINCIPLES OF OBSERVABILITY // DANIEL MAHER, DataDog
PPTX
NUDGE AND SLUDGE: DRIVING SECURITY WITH DESIGN // J. WOLFGANG GOERLICH, Duo S...
PPTX
(Ignite) TAKE A HIKE: PREVENTING BATTERY CORROSION - LEAH VOGEL, CHEGG
PPTX
BUILDING A DR PLAN FOR YOUR CLOUD INFRASTRUCTURE FROM THE GROUND UP, MOSHE BE...
PPTX
THE THREE DISCIPLINES OF CI/CD SECURITY, DANIEL KRIVELEVICH, Cider Security
PDF
THE PLEASURES OF ON-PREM, TOMER GABEL
PPTX
CONFIGURATION MANAGEMENT IN THE CLOUD NATIVE ERA, SHAHAR MINTZ, EggPack
PPTX
SOLVING THE DEVOPS CRISIS, ONE PERSON AT A TIME, CHRISTINA BABITSKI, Develeap
PPTX
OPTIMIZING PERFORMANCE USING CONTINUOUS PRODUCTION PROFILING ,YONATAN GOLDSCH...
PPTX
HOW TO SCALE YOUR ONCALL OPERATION, AND SURVIVE TO TELL, ANTON DRUKH
PPTX
HOW TO OPTIMIZE NON-CODING TIME, ORI KEREN, LinearB
PPTX
FLYING BLIND - ACCESSIBILITY IN MONITORING, FEU MOUREK, Icinga
PPTX
(Ignite) WHAT'S BURNING THROUGH YOUR CLOUD BILL - GIL BAHAT, CIDER SECURITY
PPTX
SLO DRIVEN DEVELOPMENT, ALON NATIV, Tomorrow.io
PPTX
ONBOARDING IN LOCKDOWN, HILA FOX, Augury
PPTX
DON'T PANIC: GETTING YOUR INFRASTRUCTURE DRIFT UNDER CONTROL, ERAN BIBI, Firefly
YOUR OPEN SOURCE PROJECT IS LIKE A STARTUP, TREAT IT LIKE ONE, EYAR ZILBERMAN...
GRAPHQL TO THE RES(T)CUE, ELLA SHARAKANSKI, Salto
MICROSERVICES ABOVE THE CLOUD - DESIGNING THE INTERNATIONAL SPACE STATION FOR...
THE (IR)RATIONAL INCIDENT RESPONSE: HOW PSYCHOLOGICAL BIASES AFFECT INCIDENT ...
PRINCIPLES OF OBSERVABILITY // DANIEL MAHER, DataDog
NUDGE AND SLUDGE: DRIVING SECURITY WITH DESIGN // J. WOLFGANG GOERLICH, Duo S...
(Ignite) TAKE A HIKE: PREVENTING BATTERY CORROSION - LEAH VOGEL, CHEGG
BUILDING A DR PLAN FOR YOUR CLOUD INFRASTRUCTURE FROM THE GROUND UP, MOSHE BE...
THE THREE DISCIPLINES OF CI/CD SECURITY, DANIEL KRIVELEVICH, Cider Security
THE PLEASURES OF ON-PREM, TOMER GABEL
CONFIGURATION MANAGEMENT IN THE CLOUD NATIVE ERA, SHAHAR MINTZ, EggPack
SOLVING THE DEVOPS CRISIS, ONE PERSON AT A TIME, CHRISTINA BABITSKI, Develeap
OPTIMIZING PERFORMANCE USING CONTINUOUS PRODUCTION PROFILING ,YONATAN GOLDSCH...
HOW TO SCALE YOUR ONCALL OPERATION, AND SURVIVE TO TELL, ANTON DRUKH
HOW TO OPTIMIZE NON-CODING TIME, ORI KEREN, LinearB
FLYING BLIND - ACCESSIBILITY IN MONITORING, FEU MOUREK, Icinga
(Ignite) WHAT'S BURNING THROUGH YOUR CLOUD BILL - GIL BAHAT, CIDER SECURITY
SLO DRIVEN DEVELOPMENT, ALON NATIV, Tomorrow.io
ONBOARDING IN LOCKDOWN, HILA FOX, Augury
DON'T PANIC: GETTING YOUR INFRASTRUCTURE DRIFT UNDER CONTROL, ERAN BIBI, Firefly

Recently uploaded (20)

PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPTX
TLE Review Electricity (Electricity).pptx
PDF
Univ-Connecticut-ChatGPT-Presentaion.pdf
PDF
Heart disease approach using modified random forest and particle swarm optimi...
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
Encapsulation theory and applications.pdf
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PPTX
Spectroscopy.pptx food analysis technology
PDF
Approach and Philosophy of On baking technology
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
August Patch Tuesday
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
A comparative study of natural language inference in Swahili using monolingua...
PPTX
Programs and apps: productivity, graphics, security and other tools
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Diabetes mellitus diagnosis method based random forest with bat algorithm
TLE Review Electricity (Electricity).pptx
Univ-Connecticut-ChatGPT-Presentaion.pdf
Heart disease approach using modified random forest and particle swarm optimi...
Digital-Transformation-Roadmap-for-Companies.pptx
Assigned Numbers - 2025 - Bluetooth® Document
Encapsulation theory and applications.pdf
Spectral efficient network and resource selection model in 5G networks
Per capita expenditure prediction using model stacking based on satellite ima...
Network Security Unit 5.pdf for BCA BBA.
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Spectroscopy.pptx food analysis technology
Approach and Philosophy of On baking technology
MIND Revenue Release Quarter 2 2025 Press Release
August Patch Tuesday
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
A comparative study of natural language inference in Swahili using monolingua...
Programs and apps: productivity, graphics, security and other tools

Building Successful Apps Using Application Telemetry and Data Driven Decisions - Rakefet Jackoby Galazan, Microsoft - DevOpsDays Tel Aviv 2016

  • 1. Building successful apps using application telemetry and data driven decisions It’s time to t Rakefet Jackoby Galazan Senior Product Manager
  • 2. It’s tough out there…
  • 5. Telemetry is collected at each tier: server backend, middleware, web service & browser Telemetry arrives to the APM product where it is processed & stored Identify, understand and resolve issues with powerful out-of-the- box and custom telemetry
  • 6. 1 Outside-in monitoring URL pings and web tests from different global points of presence Observed user behavior How is the application being used?2 Observed application behavior Service dependencies, queries, response time, exceptions, logs, etc. 3 Developer traces and events Whatever the developer would like to send to the APM product 4 Infrastructure performance System performance counters5
  • 7. Plan 1 Monitor + Learn ReleaseDevelop + Test 2 Development Production 4 3
  • 8. Manage work Develop + Test 1 Plan Project starts PlanTrack progress Prioritization and validation of investments not based on real data
  • 9. Write Code Unit Testing 2 Build Version Control Build Verification Release Once the iteration starts, developers turn great ideas into features… Develop + Test Lack of collaboration between development and operations
  • 10. Load Testing Integration testing environment Automated functional testing environment 3 Pre-production environment Staging environment Monitor + Learn Release Inability to quickly detect, diagnose and triage application issues
  • 13.  Machine learning algorithms for automatic detection  Find disruptive trends and anomalous segments  Correlated data for triage and fast diagnostics  Configuration/customization may or may not be required

Editor's Notes

  • #3: Building successful apps is hard! Whether you build a service or an app, there is fierce competition, and success requires data-driven decision making. It requires detecting and resolving issues before your customers do, and knowing how your product is being used to decide where to invest next
  • #4: Modern Apps are constantly evolving , they are becoming more complex – they are built using multiple components, with growing dependency on first/third party integrations Apps are deployed in multiple DCs much faster than before Users are spread all across the globe using different clients and browsers. With Growing adoption of DevOps continuous delivery methodology there is an increasing amount of features that are deployed in very short timeframes. , With pressure to reduce the amount and lengths of slowdowns and outages there is a need to improve visibility and control of performance 
  • #5: And in order to stay on top of things, you need to be able to answer these questions, and many others, at all times, and in real-time.
  • #6: So here is where APM products comes in. These products are all about helping make better apps . Ingestion, processing and visualization : By collecting data from all app tiers : backend , servers , web services & browsers, and providing powerful out of the box telemetry views of correlative data , APM products enable the users to detect triage and diagnose issues quickly , making the app more available and performant, with an acceptable user experience
  • #8: So let’s get more concrete and talk about where in the app lifecycle an APM tool can help
  • #13: As modern app developers, we all know how crucial it is to detect, triage and diagnose problems before they start affecting our customers. With APM you get all the tools to make your diagnostics experience smarter and find and fix problems before your customers know it! Detect: One of the most crucial things is to be able to detect issues as soon as they happen, and be alerted instantaneously. Triage: Once you detect an issue, the next thing is to figure out its impact and whether it is priority enough to solve right now. With APM you can find out the real user impact of any exception and take decisions accordingly. With an Application Map you can automatically detect your application topology across dependencies and client & server side components. You can find the impact assessment and click through to the resources to find the right information. Diagnose: Once you decide to fix an issue, you need all the context to solve it, and with the telemetry collection, you will have all the data you need.
  • #14: But in the complexity of modern app architecture, even an army of analysts sitting in front of a dashboard cannot detect all the different things that can go wrong. That is where the more enhanced capability of proactive diagnostics come into play, which is one of the advanced capabilities that these products offer . Using Machine Learning based technology, you can be alerted on real time service disruptions and anomalous patterns in your app performance and behavior, with thresholds constantly evolving based on your app architecture and performance patterns.