Performance Testing in Agile and DevOps Environments

Performance Testing in Agile and DevOps Environments

• 1.
  W7 Session 10/26/2016 11:30:00 AM PerformanceTesting in Agile and DevOps Environments Presented by: Syed Hossain QA Consultants Brought to you by: 350 Corporate Way, Suite 400, Orange Park, FL 32073 888-­‐268-­‐8770 ·∙ 904-­‐278-­‐0524 - info@techwell.com - http://www.starcanada.techwell.com/
• 2.
  Syed Hossain QA Consultants SyedHossain is a proven test management consultant with more than twelve years of experience in top-tier retail, financial, and workforce industries. At QA Consultance he provides consulting services in designing and implementing performance testing solutions. Syed has successfully developed, managed, and executed QA programs and projects that helped clients deliver optimized solutions to meet business needs. He is skilled in designing tests that reduce business risk. Syed engages effectively with senior management, business, technology, and vendors to plan, negotiate, and execute plans. He is experienced in building and implementing testing practices, standards, and methodology.
• 3.
  10/17/2016 1 AGILE PERFORMANCE TESTING AGENDA •Why Performance Testing in AGILE is a ‘brave new world’ • The role you will play • When to conduct performance testing • How to optimize performance testing
• 4.
  10/17/2016 2 ABOUT QA CONSULTANTS QAConsultants helps companies maintain strongQA Consultants helps companies maintain strong reputations for building software products and systems. QA Consultants accomplish this by conducting comprehensive software testing.p g WHY PERFORMANCE TESTING IN AGILE IS A ‘BRAVE NEW WORLD’
• 5.
  10/17/2016 3 WHAT IS DONE? SCRUMFRAMEWORK & PERFORMANCE TESTING Use Story 1 User Stories Product Backlog Use Story 1 User Stories Sprint Backlog Use Story 1 User Stories Use Story 1Tasks to Deliver User Stories Shippable Product Increment 2 – 4 Week Sprints Scrum Meetings & Re-prioritization DONE
• 6.
  10/17/2016 4 AGILE MANIFESTO &TESTING Individuals and interactions over processes and tools - Product quality is whole cross-functional team’s responsibility Working software over comprehensive documentation - Test requirements from user stories, examples and interactions Customer collaboration over contract negotiation - Testing requirements developed with customer engagement Responding to change over following a plan - Enables continuous improvement of the testing process http://agilemanifesto.org THE ROLE YOU WILL PLAY
• 7.
  10/17/2016 5 TEAMS AND MANAGERRESPONSIBILITIES • Teams self manage • Team is responsible for delivery and quality • Performance test manager focuses on enabling the performance testers • Organizational standards & governance models • ToolingTooling • Best practices THE ‘TRADITIONAL MINDSET’ • All or nothing • Require documentation • Too slow • Preparation • Execution • Test early, test often • Code level • Component level • Build performance acceptance into user stories • Preparation • Scripting – tools like neoload, SOASTA, Taurus • Isolated Environment – envExecution • Functionality unstable • Time pressed Isolated Environment env virtualizaion • Test Data – stub, service virtualizaion, autonomous tests • Execution • Automated test execution, analysis & reporting • Utilize coding standards that helps build script robustness – e.g. use unique identifiers• Incorporate separate sprints for long running or end-to-end tests
• 8.
  10/17/2016 6 WHEN TO CONDUCTPERFORMANCE TESTING WHEN TO CONDUCT PERFORMANCE TESTS DELIVERY MODELS – STAGGERED SPRINTS AKA N-1 Hardening Sprints Feature Sprint Team Feature Sprint Team PerformancePerformance Sprint Team
• 9.
  10/17/2016 7 DELIVERY MODELS –TARGETED SPRINTS / SPIKES Hardening Sprints Feature Sprint Team Feature Sprint Team PerformancePerformance Sprint Team DELIVERY MODELS – IN SPRINT Hardening Sprints Feature Sprint Team Feature Sprint Team PerformancePerformance Sprint Team
• 10.
  10/17/2016 8 HOW TO OPTIMIZEPERFORMANCE TESTING CONTINUOUS PERFORMANCE TESTING DEMO
• 11.
  10/17/2016 9 SUMMARY • The ‘bravenew world’ • The role of Managers and Team • Timing options: Staggered, Targeted, and ‘In sprint’ • Leveraging the latest automation tools AGILE PERFORMANCE TESTING