Download as PDF, PPTX
Uploaded byAnand Bagmar
Change Tyres In A Moving Car - Make Functional Test Automation Effective Keynote
The document discusses effective functional test automation, emphasizing the benefits of automated tests, such as speed, independence from manual intervention, and the ability to provide deterministic feedback. It highlights common anti-patterns that hinder automation success, such as poor code quality and ineffective test data management, and suggests best practices to mitigate these issues. The presentation concludes with a call to understand and evolve automation practices to avoid pitfalls and improve overall testing efficiency.
More Related Content
Similar to Change Tyres In A Moving Car - Make Functional Test Automation Effective Keynote
Change Tyres In A Moving Car - Make Functional Test Automation Effective Keynote
- 1. @BagmarAnand 1 Changing TyresIn A Moving Car Making Functional Test Automation Effective Anand Bagmar Software Quality Evangelist
- 2.
- 3. @BagmarAnand 3 • Automatedtests run fast. • The automated test execution needs no manual intervention to run/complete successfully – across environments, in parallel, for all team members & CI execution. Raise your hand if you disagree
- 4. @BagmarAnand 4 • Automatedtests are triggered automatically on any product change. • Automated tests can run, on-demand, on different (supported) browsers/devices with no changes in code or configuration. Raise your hand if you disagree
- 5. @BagmarAnand 5 • Theautomated test code is clean and easy to maintain, reuse and scale. • Your automated tests can run in any order, and in parallel. Raise your hand if you disagree
- 6. @BagmarAnand 6 • Consolidatedreports and trends from test runs are available in a central reporting server for the team. • You have all the relevant information to do RCA of failed tests readily available. Raise your hand if you disagree
- 7. @BagmarAnand 7 • Yourautomated functional tests give deterministic feedback - i.e. no flaky/intermittent test failures. • As a result of your functional automation, manual testing efforts are reduced. Raise your hand if you disagree
- 8. @BagmarAnand 8 Why doyou disagree? Why is your automation not effective?
- 9.
- 10.
- 11. @BagmarAnand 11 Changing TyresIn A Moving Car
- 12. 12 @BagmarAnand Anti-Patterns Prevent desired outcomefrom your automated tests
- 13. @BagmarAnand 13 What isan anti-pattern?
- 14. @BagmarAnand 14 Ideas thatseem good, but are not! https://likesmag.com/wp-content/uploads/2017/10/funny-design-fails.jpg
- 15. @BagmarAnand 15 Why dowe do this? https://martech.org/wp-content/uploads/2015/08/shortcut-strategy-maze-path-direction-ss-1920.jpg
- 16. @BagmarAnand 16 Caught inthe headlights! https://worlddeer.org/wp-content/uploads/elementor/thumbs/deer-in-headlights-meaning-pge44ctbg1qqspz7fp4erd9gy0dwohfbykadnxpp54.jpg
- 17.
- 18.
- 19. @BagmarAnand 19 Common anti-patterns& ways to address them
- 20. 20 @BagmarAnand Code Quality Code Quality Waits ExceptionHandling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 21.
- 22. @BagmarAnand 22 Deeply nestedcode Assertions all over the place Impossible to understand
- 23.
- 24.
- 25. 26 @BagmarAnand Code Quality Code Quality Waits ExceptionHandling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 26.
- 27.
- 28.
- 29. 30 @BagmarAnand Waits Code Quality Waits Exception Handling TestData & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 30.
- 31.
- 32. 33 @BagmarAnand Waits Code Quality Waits Exception Handling TestData & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 33.
- 34.
- 35.
- 36. @BagmarAnand 37 https://octopus.com/blog/selenium/8-mixing-waits/mixing-waits Do NOTmix Implicit & Explicit Waits
- 37. 38 @BagmarAnand Exception Handling Code Quality Waits Exception Handling TestData & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 38. @BagmarAnand 39 Swallowed /ignored exceptions
- 39. @BagmarAnand 40 Assertions allover the place!
- 40. 41 @BagmarAnand Exception Handling Code Quality Waits ExceptionHandling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 41.
- 42.
- 43.
- 44. 45 @BagmarAnand Test Data & Data Provider CodeQuality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 45.
- 46. @BagmarAnand 47 https://i.pinimg.com/originals/a6/04/2c/a6042c1e63cc3dc35cdfb202aff42b8a.jpg The journeyis not explicit RCA becomes challenging
- 47. 48 @BagmarAnand Code Quality Waits Exception Handling TestData & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects Test Data & Data Provider
- 48. @BagmarAnand 49 Identify &automate unique journeys
- 49.
- 50. @BagmarAnand 51 • Datais complex • Needs to mimic “real” data • Needs to be unique • Data can be nested • Though specified as static, may need to be Dynamic • Data can be shared and reused Criteria for Test Data
- 51. @BagmarAnand 52 • InTest implementation • In Test specification / intent • In code … separate data structures / classes / etc. • External files Different ways to specify Test Data
- 52. @BagmarAnand 53 • Automatedtests should have dedicated test data • This data should not be mixed with data required for manual / exploratory testing • Test data approach: • Identify test data requirements to enable manual testing and automated testing • Parallel execution, and CI-based execution to be kept in mind! • Seed from Production / higher environments • Create using REST APIs Test Data for Automation
- 53. 54 @BagmarAnand Test Execution Priority Code Quality Waits ExceptionHandling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 54.
- 55.
- 56.
- 57. 58 @BagmarAnand Code Quality Waits Exception Handling TestData & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects Test Execution Priority
- 58.
- 59. @BagmarAnand 60 Test Test Test Test Framework TestExecution Scheduler Optimised Test Execution
- 60. 61 @BagmarAnand Test execution configuration - testng.xml CodeQuality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 61.
- 62.
- 63. @BagmarAnand 64 testng.xml Suites /Classes / Tests Parameters (test data)
- 64. 65 @BagmarAnand Test execution configuration - testng.xml CodeQuality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 65. 66 @BagmarAnand Example: Smoke / Sanity/ Regression Module / Component https://media.istockphoto.com/vectors/blank-tag-labels-vector-id585063630 Tag your tests
- 66. 67 @BagmarAnand Separate build/test configuration fromtest implementation example: gradle/groovy over maven https://www.cashanalytics.com/wp-content/uploads/2019/01/Understanding-Robotic-Process-Automation.png
- 67. 68 @BagmarAnand • Run specificsubset of tests on demand, based on tag name • Configurable from command line • No code change required Configurable Test Execution
- 68. 69 @BagmarAnand Magic – Rerun failedtests, automatically Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 69.
- 70. 71 @BagmarAnand DO NOT USERetry Listener
- 71. 72 @BagmarAnand DO NOT Forceactions
- 72.
- 73.
- 74.
- 75. 76 @BagmarAnand Magic – Rerunfailed tests, automatically Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 76.
- 77.
- 78. @BagmarAnand 79 Do ‘proper’RCA for failing & flaky tests
- 79. 80 @BagmarAnand Page Objects Code Quality Waits ExceptionHandling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 80.
- 81.
- 82.
- 83. @BagmarAnand 84 “Dad” isa “Human” ”Mom” is a “Human” Inheritance
- 84. @BagmarAnand 85 Is “SearchPage”a “BasePage?” Poor use of Inheritance
- 85. 86 @BagmarAnand Page Objects Code Quality Waits ExceptionHandling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 86.
- 87.
- 88. 89 @BagmarAnand Do not usePageFactory https://titusfortner.com/2021/02/03/page-factory-optimization.html
- 89.
- 90.
- 91.
- 92. @BagmarAnand 93 How canwe avoid this trap? https://www.gallereo.com/clients/c4ca4238a0b923820dcc509a6f75849b/image/istock%20avoid.jpg
- 93.
- 94.
- 95. @BagmarAnand 96 Take astep back Think about the big picture https://study.com/cimages/course-image/big-picture-thinking-in-business_183979_large.jpg
- 96.
- 97. @BagmarAnand 98 https://www.selenium.dev/documentation/test_practices/encouraged/ Understand andchoose the right practices
- 98.
- 99. @BagmarAnand 100 Tech Debt Understand,Track, Address https://strapi-appunite.s3.eu-central-1.amazonaws.com/r_1951381_w_F85_X_3f65c9a221.jpg
- 100.
- 101.
- 102.
- 103.
- 104.