Automation Open Source
         Tools




                   QA Talks #3
Selenium

- is a suit of tools for web browser
  automation and it is composed of:

- Selenium IDE
- Selenium 1.0(RC)
- Selenium 2.0(Webdriver)
- Selenium Grid
Supported by
  Selenium
Selenium IDE Example
Selenium IDE Limitation
- for Firefox only
- do not support:
   - loops, exception handling
   - conditional statement
   - re-execution of failed test
   - video recording
   - reporting functionality
   - flash
Watir
- is a Ruby libraries for automating web browsers. It allows
you to write easy to read and maintain tests.
Ruby script example
Watir Example
Pros&Cons
                Pros                              Cons
Selenium:                         Selenium:
- cross browser, OS               - doesn't work directly with Flash
- programming languages           - IDE for Firfox only
- native IDE                      - updates
- record and play functionality
- webdriver                       Watir:
                                  - doesn't work directly with Flash
Watir:                            - IE only by default (but there is
- easy to understand              watir-webdriver)
- rich API                        - ruby (if you don't learn before)
- Watir(Ruby), Watij(Java),
WatiN(.NET)
- cross browser, OS
- webdriver
FlexMonkey
- is a free tool for used for
testing Flex and Air based
applications




 - Record and Playback
 - Verifying that ER match AR
 - Generating ready-to-run FlexUnit scripts
Meet the Monkeys!


                            FoneMonkey for
 FlexMonkey for testing     Android
Flex and AIR applications




        Selenium IDE            FoneMonkey for
        Plugin                  iOS
FlexMonkey Example
Turnkeylinux
    45+ ready-to-use free open source solutions


●   Specials (LAMP, SVN, Torrent, Domain
    Controller, Jabber)
●   Content management (Joomla, Drupal,
    WordPress)
●   Web development (Ruby, Symphony)
●   Issue tracking (Redmine,Bugzilla)
●   Messaging (Jabber, Mail)
●   Database (MySQL, PostgreSQL)
Save your time!




and much more...
TestLink
- is open source web-based test management tool
Redmine
- is a project management & issue tracking tool
Summary

- easy to setup and understand
- easily integrates with other tools (e.g.
  Teslink+RedmineTestLink+Bugzilla)
- containes almost all required features
- crossplatform
- plugins
- compare all available tools
Useful links
http://www.w3.org/QA/Tools/ W3C validator tools
http://www.bugzilla.org/ Bug-tracking system
http://seleniumhq.org/ Selenium web automation
http://code.google.com/p/aost/ Tellurium
http://www.teamst.org/ test management tool
http://watir.com/ Watir web automation
http://watirwebdriver.com watir-webdriver
http://www.gorillalogic.com WebMonkey Flex Automation test tool
http://cacique.mercadolibre.com Web automation test tool
http://www.turnkeylinux.org/all linux based ready-to-use solutions
http://bitnami.org/stacks linux based ready-to-use solutions
http://www.redmine.org project&issue management tool
http://www.opensourcetesting.org/ Open Source Tools
http://qtpselenium.com Selenium training
Automation Open Source Tools
      for Windows OS
How to choose the best
 software test automation tool?
- What are you trying to accomplish with the
  automation tool?
- Define goals of automation
- Is there repeated work in the project?
- Time taken for My current Manual project
  testing
- Error rate by Manual testing
- Return on Investment
Main characteristics
- OS compatibility
- Scripting languages
- Documentation
- Capture driven
- Keyword driven
- Code driven
- Object tree
- Control Finder tool
Main characteristics
- Record and Playback
- Video recording
- Test suites
- Portability
- Run from Console
- Continuous Integration systems
- Performance monitoring
- Reporting/Logging
Check-list
- Define the main goals for automation
- Define the main features which you need
- Define the required team's skills
- Choose several suitable tools
- Create prototype using each tool
- Create comparison chart with
  characterictics
- Choose more suitable tool for your project
QAliber Test Builder
- Framework for creating tests with no coding skills
- Simply drag and drop Test Cases from repository
- Use loops, conditions and parameters to create
robust scenarios.
- Run automated tasks such as handling windows
and dialogs, I/O, registry, devices and more.
- Log with screenshots, movies, performance
graphs.
- Supported by an open source community
Qaliber plug-in for Visual Studio
QAliber Test Developer is Visual Studio plug-in:
- Write C#/.net code, use the .NET framework capabilities.
- Create test cases as an integral part of your development solution.
- Create GUI / API level test quick!
- Record / Play GUI automation.
- Support .NET forms / WPF / WEB GUI testing.
- Run on all windows platforms with .NET framework 3.0
- An ever growing Open source Common tools repository.
AutoIt
AutoIt v3 is a freeware BASIC-like scripting language designed for
  automating the Windows GUI and general scripting.
- Easy to learn BASIC-like syntax
- Manipulate windows and processes, interact with all standard
  windows controls
- Scripts can be compiled into standalone executables
- COM support, regular expressions, directly call external DLL and
  Windows API functions
- Scriptable RunAs functions
- Detailed helpfile and large community-based support forums
White
Framework for automating rich client applications based
 on Win32, WinForms, WPF, Silverlight and SWT (Java)
 platforms:

- It is .NET based
- Provides a consistent object-oriented API
- Hiding the complexity of Microsoft's UIAutomation library
Sikuli
Visual technology to automate and test graphical user interfaces
   (GUI) using images (screenshots).
- Includes Sikuli Script, a visual scripting API for Jython
- Includes Sikuli IDE, an integrated development environment
   for writing visual scripts with screenshots easily.
- Automates anything you see on the screen without internal
   API's support.
- You can programmatically control a web page, a
   Windows/Linux/Mac OS X desktop application,
- Support iphone or android application running in a simulator or
   via VNC.
Comparison chart
                      AutoIT              QAliber              White              Sikuli

OS compatibility      Windows 2000/       HTML (IE),           Win32, WinForms,   Windows
                      XP/ 2003/ Vista /   WinForms, WPF,       WPF, Silverlight   Linux
                      2008/ Windows 7/    Silverlight, Java,   and SWT (Java)     MacOS
                      2008 R2             MFC                  platforms.

Scripting languages   Basic-like scripting VB.net/C#           .NET               Jyton/Python
                      language

Documentation         Help, Manuals,      Help, Manuals,       Community on       Help, Video
                      Video examples      Video Tutorials      codeplex.com       examples

Capture driven        Code-driven         Keyword-driven       Code-driven        Capture-driven
Keyword driven                            Code-driven
Code driven

Object tree           No                  Yes                  Yes                No


Control Finder tool   Yes                 Yes                  Yes (UIspy)        No
Comparison chart
Record and          Yes   Yes   Yes (record   No
Playback                        classes)

Video recording     No    Yes   No            No


Test suites         Yes   Yes   Yes           No


Portability         Yes   Yes   Yes           No


Run from Console    Yes   No    Yes           No


Continuous          Yes   No    Yes           No
Integration
systems

Performance         No    Yes   No            No
monitoring

Reporting/Logging   Yes   Yes   Yes           No
Useful Links
http://qaliber.net/ Qaliber Test Builder, plug-in for MS VS
http://www.autoitscript.com/site/autoit/ AutoIt
http://white.codeplex.com/ White
http://sikuli.org/ Sikuli
http://www.opensourcetesting.org/ Open Source Tools
http://software-testing.ru/ Software-testing forum
http://www.testingexperience.com/ QA Magazines
Contacts:


email: info@qaclubkiev.com

Oleksandr Maidaniuk
Andrii Matukhno


  alexander.maydanyuk

  andrej_2704


                         Kiev 2011
Обсуждение лучших инструментов
и практик, применимых в сфере
тестирования и обеспечения
качества.


        http://qaclubkiev.com/

Automation Open Source tools

  • 1.
    Automation Open Source Tools QA Talks #3
  • 2.
    Selenium - is asuit of tools for web browser automation and it is composed of: - Selenium IDE - Selenium 1.0(RC) - Selenium 2.0(Webdriver) - Selenium Grid
  • 4.
    Supported by Selenium
  • 5.
  • 6.
    Selenium IDE Limitation -for Firefox only - do not support: - loops, exception handling - conditional statement - re-execution of failed test - video recording - reporting functionality - flash
  • 7.
    Watir - is aRuby libraries for automating web browsers. It allows you to write easy to read and maintain tests.
  • 8.
  • 9.
  • 10.
    Pros&Cons Pros Cons Selenium: Selenium: - cross browser, OS - doesn't work directly with Flash - programming languages - IDE for Firfox only - native IDE - updates - record and play functionality - webdriver Watir: - doesn't work directly with Flash Watir: - IE only by default (but there is - easy to understand watir-webdriver) - rich API - ruby (if you don't learn before) - Watir(Ruby), Watij(Java), WatiN(.NET) - cross browser, OS - webdriver
  • 11.
    FlexMonkey - is afree tool for used for testing Flex and Air based applications - Record and Playback - Verifying that ER match AR - Generating ready-to-run FlexUnit scripts
  • 12.
    Meet the Monkeys! FoneMonkey for FlexMonkey for testing Android Flex and AIR applications Selenium IDE FoneMonkey for Plugin iOS
  • 13.
  • 14.
    Turnkeylinux 45+ ready-to-use free open source solutions ● Specials (LAMP, SVN, Torrent, Domain Controller, Jabber) ● Content management (Joomla, Drupal, WordPress) ● Web development (Ruby, Symphony) ● Issue tracking (Redmine,Bugzilla) ● Messaging (Jabber, Mail) ● Database (MySQL, PostgreSQL)
  • 15.
    Save your time! andmuch more...
  • 16.
    TestLink - is opensource web-based test management tool
  • 17.
    Redmine - is aproject management & issue tracking tool
  • 18.
    Summary - easy tosetup and understand - easily integrates with other tools (e.g. Teslink+RedmineTestLink+Bugzilla) - containes almost all required features - crossplatform - plugins - compare all available tools
  • 19.
    Useful links http://www.w3.org/QA/Tools/ W3Cvalidator tools http://www.bugzilla.org/ Bug-tracking system http://seleniumhq.org/ Selenium web automation http://code.google.com/p/aost/ Tellurium http://www.teamst.org/ test management tool http://watir.com/ Watir web automation http://watirwebdriver.com watir-webdriver http://www.gorillalogic.com WebMonkey Flex Automation test tool http://cacique.mercadolibre.com Web automation test tool http://www.turnkeylinux.org/all linux based ready-to-use solutions http://bitnami.org/stacks linux based ready-to-use solutions http://www.redmine.org project&issue management tool http://www.opensourcetesting.org/ Open Source Tools http://qtpselenium.com Selenium training
  • 20.
    Automation Open SourceTools for Windows OS
  • 21.
    How to choosethe best software test automation tool? - What are you trying to accomplish with the automation tool? - Define goals of automation - Is there repeated work in the project? - Time taken for My current Manual project testing - Error rate by Manual testing - Return on Investment
  • 22.
    Main characteristics - OScompatibility - Scripting languages - Documentation - Capture driven - Keyword driven - Code driven - Object tree - Control Finder tool
  • 23.
    Main characteristics - Recordand Playback - Video recording - Test suites - Portability - Run from Console - Continuous Integration systems - Performance monitoring - Reporting/Logging
  • 24.
    Check-list - Define themain goals for automation - Define the main features which you need - Define the required team's skills - Choose several suitable tools - Create prototype using each tool - Create comparison chart with characterictics - Choose more suitable tool for your project
  • 25.
    QAliber Test Builder -Framework for creating tests with no coding skills - Simply drag and drop Test Cases from repository - Use loops, conditions and parameters to create robust scenarios. - Run automated tasks such as handling windows and dialogs, I/O, registry, devices and more. - Log with screenshots, movies, performance graphs. - Supported by an open source community
  • 26.
    Qaliber plug-in forVisual Studio QAliber Test Developer is Visual Studio plug-in: - Write C#/.net code, use the .NET framework capabilities. - Create test cases as an integral part of your development solution. - Create GUI / API level test quick! - Record / Play GUI automation. - Support .NET forms / WPF / WEB GUI testing. - Run on all windows platforms with .NET framework 3.0 - An ever growing Open source Common tools repository.
  • 27.
    AutoIt AutoIt v3 isa freeware BASIC-like scripting language designed for automating the Windows GUI and general scripting. - Easy to learn BASIC-like syntax - Manipulate windows and processes, interact with all standard windows controls - Scripts can be compiled into standalone executables - COM support, regular expressions, directly call external DLL and Windows API functions - Scriptable RunAs functions - Detailed helpfile and large community-based support forums
  • 28.
    White Framework for automatingrich client applications based on Win32, WinForms, WPF, Silverlight and SWT (Java) platforms: - It is .NET based - Provides a consistent object-oriented API - Hiding the complexity of Microsoft's UIAutomation library
  • 29.
    Sikuli Visual technology toautomate and test graphical user interfaces (GUI) using images (screenshots). - Includes Sikuli Script, a visual scripting API for Jython - Includes Sikuli IDE, an integrated development environment for writing visual scripts with screenshots easily. - Automates anything you see on the screen without internal API's support. - You can programmatically control a web page, a Windows/Linux/Mac OS X desktop application, - Support iphone or android application running in a simulator or via VNC.
  • 30.
    Comparison chart AutoIT QAliber White Sikuli OS compatibility Windows 2000/ HTML (IE), Win32, WinForms, Windows XP/ 2003/ Vista / WinForms, WPF, WPF, Silverlight Linux 2008/ Windows 7/ Silverlight, Java, and SWT (Java) MacOS 2008 R2 MFC platforms. Scripting languages Basic-like scripting VB.net/C# .NET Jyton/Python language Documentation Help, Manuals, Help, Manuals, Community on Help, Video Video examples Video Tutorials codeplex.com examples Capture driven Code-driven Keyword-driven Code-driven Capture-driven Keyword driven Code-driven Code driven Object tree No Yes Yes No Control Finder tool Yes Yes Yes (UIspy) No
  • 31.
    Comparison chart Record and Yes Yes Yes (record No Playback classes) Video recording No Yes No No Test suites Yes Yes Yes No Portability Yes Yes Yes No Run from Console Yes No Yes No Continuous Yes No Yes No Integration systems Performance No Yes No No monitoring Reporting/Logging Yes Yes Yes No
  • 32.
    Useful Links http://qaliber.net/ QaliberTest Builder, plug-in for MS VS http://www.autoitscript.com/site/autoit/ AutoIt http://white.codeplex.com/ White http://sikuli.org/ Sikuli http://www.opensourcetesting.org/ Open Source Tools http://software-testing.ru/ Software-testing forum http://www.testingexperience.com/ QA Magazines
  • 33.
    Contacts: email: info@qaclubkiev.com Oleksandr Maidaniuk AndriiMatukhno alexander.maydanyuk andrej_2704 Kiev 2011
  • 34.
    Обсуждение лучших инструментов ипрактик, применимых в сфере тестирования и обеспечения качества. http://qaclubkiev.com/