SlideShare a Scribd company logo
April 16, 2015 1© 2015 SOASTA. All rights reserved.
Webinar
April 16, 2015 2© 2015 SOASTA. All rights reserved.
Today’s Presenters
Mark Tomlinson
Independent
Performance Coach
F1000 Companies
Microsoft
HP (former LoadRunner PM)
Brad Johnson
Performance Product
“Lifer”
SOASTA
Borland
Mercury Interactive
Compuware
April 16, 2015 3© 2015 SOASTA. All rights reserved.
April 16, 2015 4© 2015 SOASTA. All rights reserved.
Agenda
Changes are upon us
1. Breaking the Status Quo
2. Apps are Eating the World
3. What about the Center of Excellence?
User ExpectationsUnpredictable Demand
Continuous DeliveryMultiple Devices
P
Performance Is Complicated
Speed
Quality
April 16, 2015 6© 2015 SOASTA. All rights reserved.
Models are inaccurate
April 16, 2015 7© 2015 SOASTA. All rights reserved.
Models are inaccurate
Silos are not agile
April 16, 2015 8© 2015 SOASTA. All rights reserved.
Models are inaccurate
Silos are not agile
Production scale tests are
rare
April 16, 2015 9© 2015 SOASTA. All rights reserved.
RetestTest Development Infra setup RepeatFix
Tes
t
Analyze
TIME
Breaking the Status Quo
The Legacy Approach
April 16, 2015 10© 2015 SOASTA. All rights reserved.
Breaking the Status Quo
Everything has changed…
o Real user data-driven test specifications
o Collaborative teams are displacing specialist teams
o Increased test frequency
April 16, 2015 11© 2015 SOASTA. All rights reserved.
Breaking the Status Quo
Everything has changed…
o Real user data-driven test specifications
o Collaborative teams are displacing specialist teams
April 16, 2015 12© 2015 SOASTA. All rights reserved.
o Real user data-driven test specifications
o Collaborative teams are displacing specialist teams
o Increased test frequency
Breaking the Status Quo
Everything has changed…
April 16, 2015 13© 2015 SOASTA. All rights reserved.
Tips for Breaking the Status Quo
Taking your first steps into a larger world…
o Calculate the ROI of increased feedback on performance
o Calculate the KPI trends on repeated release candidates
o Invade the sprint planning and add performance to the stories
o Replace your test plans with continuous feedback from APM
April 16, 2015 14© 2015 SOASTA. All rights reserved.
Apps are Eating the World
So What?
o Mobile is everywhere (obviously)
April 16, 2015 15© 2015 SOASTA. All rights reserved.
Apps are Eating the World
So What?
o Mobile is everywhere (obviously)
o Digital commerce & User Experience has changed Dev Cycles
o Competing is different
April 16, 2015 16© 2015 SOASTA. All rights reserved.
Apps are Eating the World
So What?
o Mobile is everywhere (obviously)
o Digital commerce & User Experience has changed Dev Cycles
o Competing is different
April 16, 2015 17© 2015 SOASTA. All rights reserved.
Tips for the Explosion of Apps
Less is more…
o Investigate performance sooner & faster, in smaller scope
o Trust external dependencies, until proven otherwise
o Know your competitors’ performance - leverage that knowledge
o Calculate your impact on time-to-market or project schedules
April 16, 2015 18© 2015 SOASTA. All rights reserved.
What About the Center of Excellence?
Agile meets a Silo
April 16, 2015 19© 2015 SOASTA. All rights reserved.
What About the Center of Excellence?
Agile meets a Silo
o Stop being a bottleneck
April 16, 2015 20© 2015 SOASTA. All rights reserved.
What About the Center of Excellence?
Agile meets a Silo
o Stop being a bottleneck
o Integrate to the continuous pace
o Add value with complete, integrated performance tests
April 16, 2015 21© 2015 SOASTA. All rights reserved.
What About the Center of Excellence?
Agile meets a Silo
o Stop being a bottleneck
o Integrate to the continuous pace
o Add value with complete, integrated performance tests
April 16, 2015 22© 2015 SOASTA. All rights reserved.
The Modern Approach
TIME
The Legacy Approach
Run more tests in less time.
Start earlier.
Cover more ground.repeat
/ Test
Analyz
e
Fix
Test Dev
Test Development Infra setup
Tes
t
Analyze Retest RepeatFix
Distributed Performance
April 16, 2015 23© 2015 SOASTA. All rights reserved.
Distributed Perforamance
Component
scalability
Performance
baseline
Integration testing
End to End
w/ Service
Virtualization
Unit scalability
Database testing
3rd party
services
Live E2E
tests
Stress
testing Soak test
(reliability)
Failover
Capacity
Latency
Performance
Regression
(smoke tests)
Network
Testing (staging) Operations (prod)Development (sandbox)
Define Tests with Real User Data
April 16, 2015 24© 2015 SOASTA. All rights reserved.
Tips for Distributed Excellence
Measure yourself by the impact on others…
o Find project champions - create institutionalized excellence there
o Start an inclusive, collaborative working group - not exclusive silo
o Integrate with open-source tools across the lifecycle - enable them
o Abandon the questionnaire - assign full-time facilitators
April 16, 2015 25© 2015 SOASTA. All rights reserved.
• Rapidly collect accurate test specifications
• Collaborate with all teams
• Integrate testing processes
• Try new approaches….
April 16, 2015 26© 2015 SOASTA. All rights reserved.
1. Break the Status Quo
2. Embrace the “App” culture of change
3. Reconsider centalized approches in an agile world
April 16, 2015 27© 2015 SOASTA. All rights reserved.
o Read up on Performance Engineering
o Try a free product
o Get certified for FREE (SOASTA University)
o Test Now and see!
NEW WHITEPAPER!
www.soasta.com
Ad

Recommended

Building a Performance A-Team
Building a Performance A-Team
SOASTA
 
Secrets to Realistic Load Testing
Secrets to Realistic Load Testing
SOASTA
 
The Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest Mentora
SOASTA
 
Soasta | CloudBees webinar 11/12/2015
Soasta | CloudBees webinar 11/12/2015
SOASTA
 
7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing
SOASTA
 
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
SOASTA
 
Continuous Testing
Continuous Testing
SOASTA
 
Webinar: Load Testing for Your Peak Season
Webinar: Load Testing for Your Peak Season
SOASTA
 
5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy
SOASTA
 
Real User Measurement: The Secret Weapon for Quality
Real User Measurement: The Secret Weapon for Quality
SOASTA
 
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
SOASTA
 
Agile Load Testing In The Real World
Agile Load Testing In The Real World
SOASTA
 
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
SOASTA
 
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Jennifer Finney
 
Soasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest Webinar
Jennifer Finney
 
SOASTA mPulse update webinar
SOASTA mPulse update webinar
CloudBees
 
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
Jennifer Finney
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
SOASTA
 
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
SOASTA
 
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
SOASTA
 
Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?
Jennifer Finney
 
Final tips holiday readiness 2015 for slide share
Final tips holiday readiness 2015 for slide share
SOASTA
 
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA
 
New Features in CloudTest & TouchTest
New Features in CloudTest & TouchTest
Jennifer Finney
 
Testing In Production (TiP) Advances with Big Data & the Cloud
Testing In Production (TiP) Advances with Big Data & the Cloud
SOASTA
 
Performance Warrior Tales: Cloud Load Testing the Retail Giants
Performance Warrior Tales: Cloud Load Testing the Retail Giants
SOASTA
 
Webinar - Success Factors Behind Successful Flash Sales
Webinar - Success Factors Behind Successful Flash Sales
SOASTA
 
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
SOASTA
 
DPM Overview Soasta Partners.pptx
DPM Overview Soasta Partners.pptx
Jennifer Finney
 
Reinventing Application Performance Testing with Service Virtualization
Reinventing Application Performance Testing with Service Virtualization
CA Technologies
 

More Related Content

What's hot (20)

5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy
SOASTA
 
Real User Measurement: The Secret Weapon for Quality
Real User Measurement: The Secret Weapon for Quality
SOASTA
 
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
SOASTA
 
Agile Load Testing In The Real World
Agile Load Testing In The Real World
SOASTA
 
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
SOASTA
 
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Jennifer Finney
 
Soasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest Webinar
Jennifer Finney
 
SOASTA mPulse update webinar
SOASTA mPulse update webinar
CloudBees
 
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
Jennifer Finney
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
SOASTA
 
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
SOASTA
 
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
SOASTA
 
Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?
Jennifer Finney
 
Final tips holiday readiness 2015 for slide share
Final tips holiday readiness 2015 for slide share
SOASTA
 
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA
 
New Features in CloudTest & TouchTest
New Features in CloudTest & TouchTest
Jennifer Finney
 
Testing In Production (TiP) Advances with Big Data & the Cloud
Testing In Production (TiP) Advances with Big Data & the Cloud
SOASTA
 
Performance Warrior Tales: Cloud Load Testing the Retail Giants
Performance Warrior Tales: Cloud Load Testing the Retail Giants
SOASTA
 
Webinar - Success Factors Behind Successful Flash Sales
Webinar - Success Factors Behind Successful Flash Sales
SOASTA
 
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
SOASTA
 
5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy
SOASTA
 
Real User Measurement: The Secret Weapon for Quality
Real User Measurement: The Secret Weapon for Quality
SOASTA
 
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
SOASTA
 
Agile Load Testing In The Real World
Agile Load Testing In The Real World
SOASTA
 
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
SOASTA
 
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Jennifer Finney
 
Soasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest Webinar
Jennifer Finney
 
SOASTA mPulse update webinar
SOASTA mPulse update webinar
CloudBees
 
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
Jennifer Finney
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
SOASTA
 
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
SOASTA
 
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
SOASTA
 
Webinar: Are you ready for your peak season?
Webinar: Are you ready for your peak season?
Jennifer Finney
 
Final tips holiday readiness 2015 for slide share
Final tips holiday readiness 2015 for slide share
SOASTA
 
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA
 
New Features in CloudTest & TouchTest
New Features in CloudTest & TouchTest
Jennifer Finney
 
Testing In Production (TiP) Advances with Big Data & the Cloud
Testing In Production (TiP) Advances with Big Data & the Cloud
SOASTA
 
Performance Warrior Tales: Cloud Load Testing the Retail Giants
Performance Warrior Tales: Cloud Load Testing the Retail Giants
SOASTA
 
Webinar - Success Factors Behind Successful Flash Sales
Webinar - Success Factors Behind Successful Flash Sales
SOASTA
 
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
SOASTA
 

Viewers also liked (7)

DPM Overview Soasta Partners.pptx
DPM Overview Soasta Partners.pptx
Jennifer Finney
 
Reinventing Application Performance Testing with Service Virtualization
Reinventing Application Performance Testing with Service Virtualization
CA Technologies
 
Pitfalls in Performance Testing AxxesCC 06/2015
Pitfalls in Performance Testing AxxesCC 06/2015
Axxes IT Consultancy
 
Keys To World-Class Retail Web Performance - Expert tips for holiday web read...
Keys To World-Class Retail Web Performance - Expert tips for holiday web read...
SOASTA
 
The benefits of using an APM solution while performance testing
The benefits of using an APM solution while performance testing
DevOpsGroup
 
Strategies For Software Test Documentation
Strategies For Software Test Documentation
Vishwak Solution
 
A Modern Approach to Performance Monitoring
A Modern Approach to Performance Monitoring
Cliff Crocker
 
DPM Overview Soasta Partners.pptx
DPM Overview Soasta Partners.pptx
Jennifer Finney
 
Reinventing Application Performance Testing with Service Virtualization
Reinventing Application Performance Testing with Service Virtualization
CA Technologies
 
Pitfalls in Performance Testing AxxesCC 06/2015
Pitfalls in Performance Testing AxxesCC 06/2015
Axxes IT Consultancy
 
Keys To World-Class Retail Web Performance - Expert tips for holiday web read...
Keys To World-Class Retail Web Performance - Expert tips for holiday web read...
SOASTA
 
The benefits of using an APM solution while performance testing
The benefits of using an APM solution while performance testing
DevOpsGroup
 
Strategies For Software Test Documentation
Strategies For Software Test Documentation
Vishwak Solution
 
A Modern Approach to Performance Monitoring
A Modern Approach to Performance Monitoring
Cliff Crocker
 
Ad

Similar to Get Ready for Changes To Load Testing (20)

ConFoo: Moving web performance testing to the left
ConFoo: Moving web performance testing to the left
Tom Chavez
 
Sd times-june-24-2015
Sd times-june-24-2015
Dan Boutin
 
STPCon fall 2012: The Testing Renaissance Has Arrived
STPCon fall 2012: The Testing Renaissance Has Arrived
SOASTA
 
Atagg2015 Where testing is moving in agile cloud world!
Atagg2015 Where testing is moving in agile cloud world!
Agile Testing Alliance
 
Building a Performance A Team
Building a Performance A Team
SOASTA
 
Accelerating Your Digital Agenda with Continuous Testing ft. Forrester
Accelerating Your Digital Agenda with Continuous Testing ft. Forrester
Sauce Labs
 
Techniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App Testing
SOASTA
 
Agile-plus-DevOps Testing for Packaged Applications
Agile-plus-DevOps Testing for Packaged Applications
Worksoft
 
App Dyanmics & SOASTA Testing & Monitoring Coverage, March 2012
App Dyanmics & SOASTA Testing & Monitoring Coverage, March 2012
SOASTA
 
DevOps evolution architecting the modern software factory - cloud expo east 2017
DevOps evolution architecting the modern software factory - cloud expo east 2017
Anand Akela
 
Testing In Production (TiP) Advances with Big Data and the Cloud
Testing In Production (TiP) Advances with Big Data and the Cloud
SOASTA
 
They don't call it Continuous Integration for nothing!
They don't call it Continuous Integration for nothing!
Dan Boutin
 
Testing Tools Landscape
Testing Tools Landscape
Compuware APM
 
Top ten secret weapons for performance testing in an agile environment
Top ten secret weapons for performance testing in an agile environment
alistairjones
 
Serena Webcast: Accelerating Application Delivery with Continuous Testing
Serena Webcast: Accelerating Application Delivery with Continuous Testing
Serena Software
 
Continuous Performance Testing and Monitoring in Agile Development
Continuous Performance Testing and Monitoring in Agile Development
Neotys
 
Agile Transformation: People, Process and Tools to Make Your Transformation S...
Agile Transformation: People, Process and Tools to Make Your Transformation S...
QASymphony
 
Top Ten Secret Weapons For Agile Performance Testing
Top Ten Secret Weapons For Agile Performance Testing
Andriy Melnyk
 
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
Codemotion
 
Large-Scale Agile Test Automation Strategies in Practice
Large-Scale Agile Test Automation Strategies in Practice
TechWell
 
ConFoo: Moving web performance testing to the left
ConFoo: Moving web performance testing to the left
Tom Chavez
 
Sd times-june-24-2015
Sd times-june-24-2015
Dan Boutin
 
STPCon fall 2012: The Testing Renaissance Has Arrived
STPCon fall 2012: The Testing Renaissance Has Arrived
SOASTA
 
Atagg2015 Where testing is moving in agile cloud world!
Atagg2015 Where testing is moving in agile cloud world!
Agile Testing Alliance
 
Building a Performance A Team
Building a Performance A Team
SOASTA
 
Accelerating Your Digital Agenda with Continuous Testing ft. Forrester
Accelerating Your Digital Agenda with Continuous Testing ft. Forrester
Sauce Labs
 
Techniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App Testing
SOASTA
 
Agile-plus-DevOps Testing for Packaged Applications
Agile-plus-DevOps Testing for Packaged Applications
Worksoft
 
App Dyanmics & SOASTA Testing & Monitoring Coverage, March 2012
App Dyanmics & SOASTA Testing & Monitoring Coverage, March 2012
SOASTA
 
DevOps evolution architecting the modern software factory - cloud expo east 2017
DevOps evolution architecting the modern software factory - cloud expo east 2017
Anand Akela
 
Testing In Production (TiP) Advances with Big Data and the Cloud
Testing In Production (TiP) Advances with Big Data and the Cloud
SOASTA
 
They don't call it Continuous Integration for nothing!
They don't call it Continuous Integration for nothing!
Dan Boutin
 
Testing Tools Landscape
Testing Tools Landscape
Compuware APM
 
Top ten secret weapons for performance testing in an agile environment
Top ten secret weapons for performance testing in an agile environment
alistairjones
 
Serena Webcast: Accelerating Application Delivery with Continuous Testing
Serena Webcast: Accelerating Application Delivery with Continuous Testing
Serena Software
 
Continuous Performance Testing and Monitoring in Agile Development
Continuous Performance Testing and Monitoring in Agile Development
Neotys
 
Agile Transformation: People, Process and Tools to Make Your Transformation S...
Agile Transformation: People, Process and Tools to Make Your Transformation S...
QASymphony
 
Top Ten Secret Weapons For Agile Performance Testing
Top Ten Secret Weapons For Agile Performance Testing
Andriy Melnyk
 
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
Lars Wolff - Performance Testing for DevOps in the Cloud - Codemotion Amsterd...
Codemotion
 
Large-Scale Agile Test Automation Strategies in Practice
Large-Scale Agile Test Automation Strategies in Practice
TechWell
 
Ad

More from SOASTA (20)

Mobile Performance: State of the Union
Mobile Performance: State of the Union
SOASTA
 
Velocity 2015 building self healing systems (slide share version)
Velocity 2015 building self healing systems (slide share version)
SOASTA
 
Metrics, Metrics Everywhere (but where the heck do you start?)
Metrics, Metrics Everywhere (but where the heck do you start?)
SOASTA
 
3 tips to increase mobile test coverage
3 tips to increase mobile test coverage
SOASTA
 
Webinar: Was die Top eCommerce Firmen über Ihre Performance auf Web- & Mobile
Webinar: Was die Top eCommerce Firmen über Ihre Performance auf Web- & Mobile
SOASTA
 
Dach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
Dach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
SOASTA
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps soasta and utopia
SOASTA
 
Synthetic and rum webinar
Synthetic and rum webinar
SOASTA
 
How to measure the business impact of web performance
How to measure the business impact of web performance
SOASTA
 
Lasttest auf Zuruf CloudTest on Demand webinar presentation
Lasttest auf Zuruf CloudTest on Demand webinar presentation
SOASTA
 
The Mobile Testing Checklist
The Mobile Testing Checklist
SOASTA
 
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
SOASTA
 
Reducing 3rd party content risk with Real User Monitoring
Reducing 3rd party content risk with Real User Monitoring
SOASTA
 
Getting started w ct lite load_testing 21.05.14
Getting started w ct lite load_testing 21.05.14
SOASTA
 
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
SOASTA
 
What Retailers Know About Performance and User Experience
What Retailers Know About Performance and User Experience
SOASTA
 
Getting started w ct lite load_testing 03.04.14
Getting started w ct lite load_testing 03.04.14
SOASTA
 
Erste schritte mit ct lite load_testing 02.04.14
Erste schritte mit ct lite load_testing 02.04.14
SOASTA
 
EMEA Webinar - An Introduction to Real User Measurement
EMEA Webinar - An Introduction to Real User Measurement
SOASTA
 
Continuous Load Testing with CloudTest and Jenkins
Continuous Load Testing with CloudTest and Jenkins
SOASTA
 
Mobile Performance: State of the Union
Mobile Performance: State of the Union
SOASTA
 
Velocity 2015 building self healing systems (slide share version)
Velocity 2015 building self healing systems (slide share version)
SOASTA
 
Metrics, Metrics Everywhere (but where the heck do you start?)
Metrics, Metrics Everywhere (but where the heck do you start?)
SOASTA
 
3 tips to increase mobile test coverage
3 tips to increase mobile test coverage
SOASTA
 
Webinar: Was die Top eCommerce Firmen über Ihre Performance auf Web- & Mobile
Webinar: Was die Top eCommerce Firmen über Ihre Performance auf Web- & Mobile
SOASTA
 
Dach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
Dach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
SOASTA
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps soasta and utopia
SOASTA
 
Synthetic and rum webinar
Synthetic and rum webinar
SOASTA
 
How to measure the business impact of web performance
How to measure the business impact of web performance
SOASTA
 
Lasttest auf Zuruf CloudTest on Demand webinar presentation
Lasttest auf Zuruf CloudTest on Demand webinar presentation
SOASTA
 
The Mobile Testing Checklist
The Mobile Testing Checklist
SOASTA
 
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
SOASTA
 
Reducing 3rd party content risk with Real User Monitoring
Reducing 3rd party content risk with Real User Monitoring
SOASTA
 
Getting started w ct lite load_testing 21.05.14
Getting started w ct lite load_testing 21.05.14
SOASTA
 
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
SOASTA
 
What Retailers Know About Performance and User Experience
What Retailers Know About Performance and User Experience
SOASTA
 
Getting started w ct lite load_testing 03.04.14
Getting started w ct lite load_testing 03.04.14
SOASTA
 
Erste schritte mit ct lite load_testing 02.04.14
Erste schritte mit ct lite load_testing 02.04.14
SOASTA
 
EMEA Webinar - An Introduction to Real User Measurement
EMEA Webinar - An Introduction to Real User Measurement
SOASTA
 
Continuous Load Testing with CloudTest and Jenkins
Continuous Load Testing with CloudTest and Jenkins
SOASTA
 

Recently uploaded (20)

Using the SQLExecutor for Data Quality Management: aka One man's love for the...
Using the SQLExecutor for Data Quality Management: aka One man's love for the...
Safe Software
 
The Future of Technology: 2025-2125 by Saikat Basu.pdf
The Future of Technology: 2025-2125 by Saikat Basu.pdf
Saikat Basu
 
Smarter Aviation Data Management: Lessons from Swedavia Airports and Sweco
Smarter Aviation Data Management: Lessons from Swedavia Airports and Sweco
Safe Software
 
Cyber Defense Matrix Workshop - RSA Conference
Cyber Defense Matrix Workshop - RSA Conference
Priyanka Aash
 
PyCon SG 25 - Firecracker Made Easy with Python.pdf
PyCon SG 25 - Firecracker Made Easy with Python.pdf
Muhammad Yuga Nugraha
 
Connecting Data and Intelligence: The Role of FME in Machine Learning
Connecting Data and Intelligence: The Role of FME in Machine Learning
Safe Software
 
OpenPOWER Foundation & Open-Source Core Innovations
OpenPOWER Foundation & Open-Source Core Innovations
IBM
 
Lessons Learned from Developing Secure AI Workflows.pdf
Lessons Learned from Developing Secure AI Workflows.pdf
Priyanka Aash
 
GenAI Opportunities and Challenges - Where 370 Enterprises Are Focusing Now.pdf
GenAI Opportunities and Challenges - Where 370 Enterprises Are Focusing Now.pdf
Priyanka Aash
 
You are not excused! How to avoid security blind spots on the way to production
You are not excused! How to avoid security blind spots on the way to production
Michele Leroux Bustamante
 
Curietech AI in action - Accelerate MuleSoft development
Curietech AI in action - Accelerate MuleSoft development
shyamraj55
 
Oh, the Possibilities - Balancing Innovation and Risk with Generative AI.pdf
Oh, the Possibilities - Balancing Innovation and Risk with Generative AI.pdf
Priyanka Aash
 
The Future of Product Management in AI ERA.pdf
The Future of Product Management in AI ERA.pdf
Alyona Owens
 
AI VIDEO MAGAZINE - June 2025 - r/aivideo
AI VIDEO MAGAZINE - June 2025 - r/aivideo
1pcity Studios, Inc
 
CapCut Pro Crack For PC Latest Version {Fully Unlocked} 2025
CapCut Pro Crack For PC Latest Version {Fully Unlocked} 2025
pcprocore
 
Security Tips for Enterprise Azure Solutions
Security Tips for Enterprise Azure Solutions
Michele Leroux Bustamante
 
ReSTIR [DI]: Spatiotemporal reservoir resampling for real-time ray tracing ...
ReSTIR [DI]: Spatiotemporal reservoir resampling for real-time ray tracing ...
revolcs10
 
Cracking the Code - Unveiling Synergies Between Open Source Security and AI.pdf
Cracking the Code - Unveiling Synergies Between Open Source Security and AI.pdf
Priyanka Aash
 
Salesforce Summer '25 Release Frenchgathering.pptx.pdf
Salesforce Summer '25 Release Frenchgathering.pptx.pdf
yosra Saidani
 
Daily Lesson Log MATATAG ICT TEchnology 8
Daily Lesson Log MATATAG ICT TEchnology 8
LOIDAALMAZAN3
 
Using the SQLExecutor for Data Quality Management: aka One man's love for the...
Using the SQLExecutor for Data Quality Management: aka One man's love for the...
Safe Software
 
The Future of Technology: 2025-2125 by Saikat Basu.pdf
The Future of Technology: 2025-2125 by Saikat Basu.pdf
Saikat Basu
 
Smarter Aviation Data Management: Lessons from Swedavia Airports and Sweco
Smarter Aviation Data Management: Lessons from Swedavia Airports and Sweco
Safe Software
 
Cyber Defense Matrix Workshop - RSA Conference
Cyber Defense Matrix Workshop - RSA Conference
Priyanka Aash
 
PyCon SG 25 - Firecracker Made Easy with Python.pdf
PyCon SG 25 - Firecracker Made Easy with Python.pdf
Muhammad Yuga Nugraha
 
Connecting Data and Intelligence: The Role of FME in Machine Learning
Connecting Data and Intelligence: The Role of FME in Machine Learning
Safe Software
 
OpenPOWER Foundation & Open-Source Core Innovations
OpenPOWER Foundation & Open-Source Core Innovations
IBM
 
Lessons Learned from Developing Secure AI Workflows.pdf
Lessons Learned from Developing Secure AI Workflows.pdf
Priyanka Aash
 
GenAI Opportunities and Challenges - Where 370 Enterprises Are Focusing Now.pdf
GenAI Opportunities and Challenges - Where 370 Enterprises Are Focusing Now.pdf
Priyanka Aash
 
You are not excused! How to avoid security blind spots on the way to production
You are not excused! How to avoid security blind spots on the way to production
Michele Leroux Bustamante
 
Curietech AI in action - Accelerate MuleSoft development
Curietech AI in action - Accelerate MuleSoft development
shyamraj55
 
Oh, the Possibilities - Balancing Innovation and Risk with Generative AI.pdf
Oh, the Possibilities - Balancing Innovation and Risk with Generative AI.pdf
Priyanka Aash
 
The Future of Product Management in AI ERA.pdf
The Future of Product Management in AI ERA.pdf
Alyona Owens
 
AI VIDEO MAGAZINE - June 2025 - r/aivideo
AI VIDEO MAGAZINE - June 2025 - r/aivideo
1pcity Studios, Inc
 
CapCut Pro Crack For PC Latest Version {Fully Unlocked} 2025
CapCut Pro Crack For PC Latest Version {Fully Unlocked} 2025
pcprocore
 
Security Tips for Enterprise Azure Solutions
Security Tips for Enterprise Azure Solutions
Michele Leroux Bustamante
 
ReSTIR [DI]: Spatiotemporal reservoir resampling for real-time ray tracing ...
ReSTIR [DI]: Spatiotemporal reservoir resampling for real-time ray tracing ...
revolcs10
 
Cracking the Code - Unveiling Synergies Between Open Source Security and AI.pdf
Cracking the Code - Unveiling Synergies Between Open Source Security and AI.pdf
Priyanka Aash
 
Salesforce Summer '25 Release Frenchgathering.pptx.pdf
Salesforce Summer '25 Release Frenchgathering.pptx.pdf
yosra Saidani
 
Daily Lesson Log MATATAG ICT TEchnology 8
Daily Lesson Log MATATAG ICT TEchnology 8
LOIDAALMAZAN3
 

Get Ready for Changes To Load Testing

  • 1. April 16, 2015 1© 2015 SOASTA. All rights reserved. Webinar
  • 2. April 16, 2015 2© 2015 SOASTA. All rights reserved. Today’s Presenters Mark Tomlinson Independent Performance Coach F1000 Companies Microsoft HP (former LoadRunner PM) Brad Johnson Performance Product “Lifer” SOASTA Borland Mercury Interactive Compuware
  • 3. April 16, 2015 3© 2015 SOASTA. All rights reserved.
  • 4. April 16, 2015 4© 2015 SOASTA. All rights reserved. Agenda Changes are upon us 1. Breaking the Status Quo 2. Apps are Eating the World 3. What about the Center of Excellence?
  • 5. User ExpectationsUnpredictable Demand Continuous DeliveryMultiple Devices P Performance Is Complicated Speed Quality
  • 6. April 16, 2015 6© 2015 SOASTA. All rights reserved. Models are inaccurate
  • 7. April 16, 2015 7© 2015 SOASTA. All rights reserved. Models are inaccurate Silos are not agile
  • 8. April 16, 2015 8© 2015 SOASTA. All rights reserved. Models are inaccurate Silos are not agile Production scale tests are rare
  • 9. April 16, 2015 9© 2015 SOASTA. All rights reserved. RetestTest Development Infra setup RepeatFix Tes t Analyze TIME Breaking the Status Quo The Legacy Approach
  • 10. April 16, 2015 10© 2015 SOASTA. All rights reserved. Breaking the Status Quo Everything has changed… o Real user data-driven test specifications o Collaborative teams are displacing specialist teams o Increased test frequency
  • 11. April 16, 2015 11© 2015 SOASTA. All rights reserved. Breaking the Status Quo Everything has changed… o Real user data-driven test specifications o Collaborative teams are displacing specialist teams
  • 12. April 16, 2015 12© 2015 SOASTA. All rights reserved. o Real user data-driven test specifications o Collaborative teams are displacing specialist teams o Increased test frequency Breaking the Status Quo Everything has changed…
  • 13. April 16, 2015 13© 2015 SOASTA. All rights reserved. Tips for Breaking the Status Quo Taking your first steps into a larger world… o Calculate the ROI of increased feedback on performance o Calculate the KPI trends on repeated release candidates o Invade the sprint planning and add performance to the stories o Replace your test plans with continuous feedback from APM
  • 14. April 16, 2015 14© 2015 SOASTA. All rights reserved. Apps are Eating the World So What? o Mobile is everywhere (obviously)
  • 15. April 16, 2015 15© 2015 SOASTA. All rights reserved. Apps are Eating the World So What? o Mobile is everywhere (obviously) o Digital commerce & User Experience has changed Dev Cycles o Competing is different
  • 16. April 16, 2015 16© 2015 SOASTA. All rights reserved. Apps are Eating the World So What? o Mobile is everywhere (obviously) o Digital commerce & User Experience has changed Dev Cycles o Competing is different
  • 17. April 16, 2015 17© 2015 SOASTA. All rights reserved. Tips for the Explosion of Apps Less is more… o Investigate performance sooner & faster, in smaller scope o Trust external dependencies, until proven otherwise o Know your competitors’ performance - leverage that knowledge o Calculate your impact on time-to-market or project schedules
  • 18. April 16, 2015 18© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo
  • 19. April 16, 2015 19© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo o Stop being a bottleneck
  • 20. April 16, 2015 20© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo o Stop being a bottleneck o Integrate to the continuous pace o Add value with complete, integrated performance tests
  • 21. April 16, 2015 21© 2015 SOASTA. All rights reserved. What About the Center of Excellence? Agile meets a Silo o Stop being a bottleneck o Integrate to the continuous pace o Add value with complete, integrated performance tests
  • 22. April 16, 2015 22© 2015 SOASTA. All rights reserved. The Modern Approach TIME The Legacy Approach Run more tests in less time. Start earlier. Cover more ground.repeat / Test Analyz e Fix Test Dev Test Development Infra setup Tes t Analyze Retest RepeatFix Distributed Performance
  • 23. April 16, 2015 23© 2015 SOASTA. All rights reserved. Distributed Perforamance Component scalability Performance baseline Integration testing End to End w/ Service Virtualization Unit scalability Database testing 3rd party services Live E2E tests Stress testing Soak test (reliability) Failover Capacity Latency Performance Regression (smoke tests) Network Testing (staging) Operations (prod)Development (sandbox) Define Tests with Real User Data
  • 24. April 16, 2015 24© 2015 SOASTA. All rights reserved. Tips for Distributed Excellence Measure yourself by the impact on others… o Find project champions - create institutionalized excellence there o Start an inclusive, collaborative working group - not exclusive silo o Integrate with open-source tools across the lifecycle - enable them o Abandon the questionnaire - assign full-time facilitators
  • 25. April 16, 2015 25© 2015 SOASTA. All rights reserved. • Rapidly collect accurate test specifications • Collaborate with all teams • Integrate testing processes • Try new approaches….
  • 26. April 16, 2015 26© 2015 SOASTA. All rights reserved. 1. Break the Status Quo 2. Embrace the “App” culture of change 3. Reconsider centalized approches in an agile world
  • 27. April 16, 2015 27© 2015 SOASTA. All rights reserved. o Read up on Performance Engineering o Try a free product o Get certified for FREE (SOASTA University) o Test Now and see! NEW WHITEPAPER! www.soasta.com