Download to read offline
More Related Content
![How to create a performance-first culture [2018 WebPerfDays Amsterdam]](https://cdn.slidesharecdn.com/ss_thumbnails/2018-webperfdays-181116191738-thumbnail.jpg?width=640&height=640&fit=bounds)
![The 7 Habits of Highly Effective Performance Teams [PerfNow 2019]](https://cdn.slidesharecdn.com/ss_thumbnails/2019-perfnow-performance-culture-191121112338-thumbnail.jpg?width=640&height=640&fit=bounds)
![How slow load times hurt UX (and what you can do about it) [FluentConf 2016]](https://cdn.slidesharecdn.com/ss_thumbnails/2016-fluent-even-more-abridged-tammyeverts-160310192653-thumbnail.jpg?width=640&height=640&fit=bounds)
![Performance Is About People, Not Metrics [2017 Web Directions Summit]](https://cdn.slidesharecdn.com/ss_thumbnails/directions-summit-performance-is-about-people-171110003205-thumbnail.jpg?width=640&height=640&fit=bounds)
![The hunt for the unicorn performance metric [DeltaV London 2018]](https://cdn.slidesharecdn.com/ss_thumbnails/2018-deltav-unicorn-metric-180511092516-thumbnail.jpg?width=640&height=640&fit=bounds)
Similar to Continuous Performance Testing and Monitoring in Agile Development
Continuous Performance Testing and Monitoring in Agile Development
- 1. Continuous Performance Testingand Monitoring in Agile Development
- 2. Deliver faster applicationsfaster through continuous performance validation Who We Are Mission: Deliver faster applications faster through continuous performance validation
- 3. User Demands ProcessRevolutions We’re Driven by Your Challenges Technology Transitions Docker
- 4. AGENDA Performance matters Agile testing FromAgile to DevOps DevOps pipeline Dynatrace Integration
- 5. 40% of usersare moving towards the competition following a bad experience 57 % of users use their mobile 44-61 % of users share their feelings on social network User Experience is Key
- 6.
- 7. Etam reduces it'saverage page load time from 1.2s to 500ms and increased conversions by 20%, time on site by 21%, and pages viewed per visit by 28%. Walmart saw up to a 2% increase in conversions for every 1 second of improvement in load time. Every 100ms improvement also resulted in up to a 1% increase in revenue. Shopzilla decreased load time by 5 seconds and saw a 12% increase in conversion rate, a 25% increase in page views and a 50% reduction in infrastructure required. Etsy saw a 12% increase in bounce rate when they added 160kb of images to their mobile page. User Experience Impact on Business
- 9. AGENDA Performance matters Agile testing FromAgile to DevOps DevOps pipeline Dynatrace Integration
- 10. Performance Testing UsedTo Be ….
- 11. Performance Design isThe Key
- 12. Standard Performance TestingWorkflow Strategy Scenarios Prepare Execute AnalyzeTuning
- 13. Testing Earlier Early Riskanalysis • Understand the application • Performance needs to be included in the PRA • ATAM ( Architecture Tradeoff Analysis Method) Automation Smarter and faster Validation Follow our KPI Monitor Detect problems before the end users
- 14. Performance is drivenby : • The end users • Third party system • … We need to ask the right questions : • How the users work on the system? • What are their habits • When ? and how often • Are we going to expand in different geos? • Is the marketing plan to market/promote the application? If yes what is the type audience? … Take The Time To Understand The Application
- 15. Performance testing anexisting application • Ask the support of functional architect, HR..etc • Understand the behavior of the application with the help of the logs Migration project : Don’t underestimate the history of the application Performance testing a new application/service • Involve the project leader , functional architect • Try to understand the purpose and relation with the business plan Testing scenarios
- 16. Unit Performance Testing Anypart of the system Not a standard practice Do not wait until the system is assembled Test cases are simpler, fewer variables • Test-Driven Development may be an answer Many systems are monolithic Third-party components
- 17. Change Mentality Before Laterecord/playback performance testing System-level requirements Record/playback approach "Black Box" Now Early Performance Engineering Component-level requirements Programming to generate load/create stubs "Grey Box”
- 18. Workflow 3) Development lifecycle Component Testing Business Test Case 1) Specification 2) Risk Analysis Project Lifecycle
- 19. Neotys Continuous PerformanceValidation Solution Component testing Requirements Daily Cycle Performance End-to-End testing Sprint Assemble and Deployment Feedback Production Monitoring Performance Qualification Continuous Integration
- 20. AGENDA Performance matters Agile testing FromAgile to DevOps DevOps pipeline Dynatrace Integration
- 21. Organizations Adopt Agileand DevOps as an Answer • 99% of organizations have adopted Agile development methods • 88% of CIOs are using DevOps World Quality Report 2016-17
- 22. But Speed isNothing Without Quality “Surviving Disruption, Leading Change: Winning in the Application Economy,” 2015 2/3 of business leaders say their company’s future DEPENDS on the QUALITY of their software
- 23. “The term everyoneis using is DevOps, but I think it should really be DevTestOps. Testing is really crucial for achieving quality & speed” Diego La Guidice, Principal Analyst DevTestOps Rather Than DevOps
- 24. AGENDA Performance matters Agile testing FromAgile to DevOps DevOps pipeline Dynatrace integration
- 25. Planning • Provide transparencyto the stakeholders Source Control • Tracking Change of the code ( infrastructure, application..Etc) Configuration management • Infrastructure is treated exactly like code Continuous integration • Tools to automate the Build and the deployment Deployment tools • Application can be released to production any time you want in order to improve time to market Testing and validation • Validate the quality of the release APM • applications are commonly tested and monitored with APM tools to ensure high availability, low response time, and quality of service DevOps Toolchain
- 26.
- 27.
- 28. Stage 3: Test receivetask integration test DEV QA UAT Test Integration Functional Performance Security
- 29. Stage 4 :Release Release PROD
- 30. receive task integration test Devops toolchain Build request DeployRelease DEV QA UAT PROD Test Prepare Build Compile Packaging Integration Functional Performance Security
- 31. AGENDA Performance matters Agile testing FromAgile to DevOps DevOps pipeline Dynatrace integration
- 32. • response time •infrastructure behavior Capture performance metrics that go beyond • Failures, bottlenecks, slower-than-expected response times Actionable data in case of problems Why Combine Load Testing And APM During a Load Test?
- 33. How Does theIntegration Works? Web Model Mobile Model Rest Interface Business logic Data Access logic XML Legacy Relationnal Presentation Business Data NeoLoad Virtual Users Load
- 34. • Transaction name,virtual user, script name, unique id • Easier correlation between load testing solution and Dynatrace AppMon Web request tagging • Start & stop recording of data to cover exactly one test run Session Recording • Each web request is tagged with a test id • Allows to distinguish between requests if two test are run in parallel Registering individual test executions NeoLoad/Dynatrace Integration
- 35. Next Steps henrik.rexed@neotys.com Visit NeotysCommunity at answers.neotys.com Download NeoLoad Free Edition from www.neotys.com Questions? Visit neotys.com Follow us on Twitter @hrexed
Editor's Notes
- #3 Our mission: help organizations deliver FASTER applications FASTER through continuous performance validation {click} Offices around the globe {click} Over 1600 customers Nearly every industry Big name organizations trust Neotys [Transition] Choose Neotys because of focus on key performance challenges they face… {click}
- #4 3 categories of challenges: User Demands Application Development Process Revolutions Technology Transitions {click} [User Demands] High expectations for performance As fast as google search Mobile as fast as desktop The results of bad performance: Lost revenue Lose users to competitor apps Brand damage Lost productivity for internal apps FASTER APPLICATIONS {click} [Process Revolutions] Agile DevOps Continuous Integration and Continuous Delivery Force testing to become more automated QA being squeezed out QA needs to keep up with development DELIVER FASTER {click} [Technology Transitions] More and more interfaces: Web Mobile APIs IoT New technologies: WebSocket Docker HTML5 HTTP/2 Need to test whatever technologies developers send your way [Transition] And this is why we developed our Continuous Performance Validation solution… {click}
- #8 Ah le fameux 100ms d’Amazon. Le 100 ms perdu sur une page qui entraine 1% de chiffre d’affaire en moins. Vous devez surement tous le connaître celui-là. Mais je ne suis pas sur qu’il vous parle … il a le mérite d’avoir existé mais il est tellement déconnecté de notre réalité et date de tellement longtemps … Heureusement depuis, il y a en a eu d’autres des études : régulièrement on interroge des utilisateurs, on fait des sondages, on mesure
- #9 alors Thibault, j’imagine que ça te parle ce genre de chiffres, mais d’abord quel était le contexte ?
- #22 From a report conducted by Vanson Bourne we learn that By adopting DevOps up to 97% of companies have seen increased frequency of deployment of software
- #23 User experience is critical in a digital economy, and application performance is a key element of the UX. Performance validation is becoming more and more critical
- #24 Dans les faits, j’ai tendance à accepter la proposition que DevTestOps serait plus représentatif des enjeux en cours. Le DevOps ou une approche Agile ne peut pas fonctionner sans mettre le test au cœur du processus. Cela dit, il existe un risque majeur qui est que le test ne devienne un goulet d’étranglement et ralentisse le rythme de livraison des applications.
- #36 Start Q&A session (While waiting for questions, read the next steps)