Practical Experience in Automated
Testing at Pronto Marketing
Poomjai Saeyong ft. Kan Ouivirach, PhD
Thailand Practical Software Engineering Conference 2013
Speakers

Poomjai Saeyong

Kan Ouivirach, PhD

Agile Tester at Pronto Marketing

Research and Development Engineer
at Pronto Marketing
Agile Testing

Automated
Testing at Pronto
Marketing?

Why
Automated
Testing?

Sins of
Automation
Agile Testing
What is Agile Testing?
“Agile testing involves all members of a cross-functional
Agile team, with special expertise contributed by testers, to
ensure delivering the business value desired by the customer
at frequent intervals, working at a sustainable pace.”
-- Wikipedia
Haruka Miyashita
Why Automated Testing?
Benefits
● Test faster
● Consistency
● Able to run over and over again with less
overhead (save time and money)
● Improve accuracy, less human error
● Increase test coverage
Automated Testing at
Pronto Marketing
Automated Testing Tools We Use
● Continuous Integration (CI)
○ Buildbot

● Unit Test
○ PHPUnit with WordPress Unit Tests http://core.
trac.wordpress.org/browser/tests

● Functional Test
○ Selenium + Lettuce
Continuous Integration Process
Buildbot for Continuous Integration
at Pronto Marketing
PHPUnit with WordPress Unit Tests
Functional Test

+
Selenium
http://seleniumhq.org
Lettuce
http://lettuce.it
Current Problems We Found
● Test scripts are too fast.
○ No problem for PHPUnit
○ Big problem for Selenium + Lettuce

● Language we use in the features are too
low level.
● Higher level language would cause a lot of
duplicated and complicated steps.
Trade Off
Sins of Automated Testing
● Flawed comparison between manual test
and automation
● Loving the UI so much that all tests are
executed through the UI
● Too lazy to maintain automated tests
Thank You
boss@prontomarketing.com
kan@prontomarketing.com
Credits
●

●

Content from
○ http://www.methodsandtools.com/archive/archive.php?id=33
○ http://www.agileengineeringdesign.com/2012/01/7-deadly-sins-ofautomated-software-testing/
Images from
○ https://plus.google.com/+BrunoOliveira/posts/MGxauXypb1Y
○ http://www.ranorex.com/blog/integrating-ranorex-automation-injenkins-continuous-integration-process
○ http://www.33rdsquare.com/
○ http://www.greenfieldbelser.com/

Practical Experience in Automated Testing at Pronto Marketing