Download to read offline
Uploaded byadamcarmi
Building Universal Servers (On-prem meets Azure PAAS)
The document discusses the automation of visual software testing, highlighting Applitools' universal server and its integration with Azure PaaS. It covers the operational requirements, system architecture, deployment strategies, storage options, and the benefits of using Azure, such as scalability and reliability. Additionally, it emphasizes the importance of testability and ease of deployment while managing complexity in design.
More Related Content
Similar to Building Universal Servers (On-prem meets Azure PAAS)
![[webinar] Cutting-edge Functional UI Testing Techniques - w/ Adam Carmi](https://cdn.slidesharecdn.com/ss_thumbnails/20200325-functionalvisualai-200330145548-thumbnail.jpg?width=640&height=640&fit=bounds)
Building Universal Servers (On-prem meets Azure PAAS)
- 1. Automating visual softwaretesting BUILDING UNIVERSAL SERVERS ON-PREM MEETS AZURE PAAS Adam Carmi Applitools Co-Founder & CTO
- 2. Automating visual softwaretesting ABOUT ME
- 3. Automating visual softwaretesting AGENDA • About Applitools • Why Azure? • Applitools’ universal server • Q&A
- 4. Automating visual softwaretesting WHAT IS VISUAL TESTING? A quality assurance activity aimed to verify that a Graphical User Interface appears correctly to users
- 5. Automating visual softwaretesting
- 6. Automating visual softwaretesting
- 7. Automating visual softwaretesting THE WORKFLOW Drive the AUT and take screenshots Compare screenshots with baseline images Report differences Update the baseline
- 8. Automating visual softwaretesting DEMO
- 9. Automating visual softwaretesting AGENDA • About Applitools • Why Azure? • Applitools’ universal server • Q&A
- 10. Automating visual softwaretesting OPERATIONAL REQUIREMENTS • A 30K tenant public cloud • 5M CPU and memory intensive tests / month • Multiple single tenant dedicated clouds • On-Prem installations • Massive image uploads that are rarely fully downloaded • 1Y data retention • Permanent availability • Growing 50% Q/Q
- 11. Automating visual softwaretesting SYSTEM ARCHITECTURE API Server Tests, Image processing, Tasks, Auth, Admin, Externals, App APP Server Tests, Image processing, Tasks, Auth, Admin, Externals, App SDK Data + State Eyes Server (On-Prem / Azure Web-Role) User APP Tests
- 12. Automating visual softwaretesting AZURE WEB-ROLE A collection of identical, auto-managed, load-balanced VMs that run IIS compatible web-applications • Same web-apps (binaries and resources) • Same configuration
- 13. Automating visual softwaretesting WHY AZURE WEB-ROLE? • Infinite scale and high availability • Extremely reliable • No hardware / OS maintenance concerns • Rolling deployments • Immediate emergency rollback to staging • A thin wrapper around a standard IIS web-site (VS Project) • .NET
- 14. Automating visual softwaretesting AGENDA • About Applitools • Why Azure? • Applitools’ universal server • Q&A
- 15. Automating visual softwaretesting APPLITOOLS’ UNIVERSAL SERVER • Design • Deployment • Runtime • Storage • Framework • Testability
- 16. Automating visual softwaretesting DESIGN TOWARDS THE WEB-ROLE • Multiple stateless instances (scale-out, rolling upgrades) • Optimistic concurrency and eventual consistency • Data partitioning • Automatic instance recycling • Transient local storage • Async long running tasks (hard timeouts)
- 17. Automating visual softwaretesting BUT DEPEND ON AS FEW PAAS ARTIFACTS AS POSSIBLE... In order to keep the On-Prem deployment simple.
- 18. Automating visual softwaretesting APPLITOOLS’ UNIVERSAL SERVER • Design • Deployment • Runtime • Storage • Framework • Testability
- 19. Automating visual softwaretesting ON-PREM DEPLOYMENT
- 20. Automating visual softwaretesting CLOUD-SERVICE DEFINITION Packaging
- 21. Automating visual softwaretesting • Deployed together with a cloud-service package • Initial instance count • SSL certificate • Configuration settings CLOUD-SERVICE CONFIGURATION
- 22. Automating visual softwaretesting PUBLISHING OPTIONS • Visual Studio • Azure management portal • REST APIs • Programmatically • Azure PowerShell
- 23. Automating visual softwaretesting APPLITOOLS’ UNIVERSAL SERVER • Design • Deployment • Runtime • Storage • Framework • Testability
- 24. Automating visual softwaretesting RUNTIME ABSTRACTION IServiceRuntime • Access configuration settings • Access local file storage paths • Get the instance name (for logging) • Register runtime event listeners
- 25. Automating visual softwaretesting APPLITOOLS’ UNIVERSAL SERVER • Design • Deployment • Runtime • Storage • Framework • Testability
- 26. Automating visual softwaretesting NOSQL? • Infinite storage • High availability • Speed • Pricing • No schema migration
- 27. Automating visual softwaretesting NOSQL STORAGE ABSTRACTIONS IObjectStore<T>, IByteStore, … • Key/value based • Atomic update/create with optimistic concurrency • In-memory, File System, Entity Framework, Azure Table, Azure Blob implementations
- 28. Automating visual softwaretesting STORAGE CONFIGURATION Web-Role On-Prem
- 29. Automating visual softwaretesting APPLITOOLS’ UNIVERSAL SERVER • Design • Deployment • Runtime • Storage • Framework • Testability
- 30. Automating visual softwaretesting FRAMEWORK SERVICES • Framework services are built on top of the storage abstraction • Access control • Counters • Named locks • Notifications • Long running tasks
- 31. Automating visual softwaretesting APPLITOOLS’ UNIVERSAL SERVER • Design • Deployment • Runtime • Storage • Framework • Testability
- 32. Automating visual softwaretesting TESTABILITY • Run any version of the server on your local machine with a simple SVN update command. • Execute thousands of API tests in less than a minute by using in-memory storage. • Easily debug local code changes step-by-step running against production data.
- 33. Automating visual softwaretesting SUMMARY Universal Scale Availability Deployment Testability Cost (storage) × Design complexity (storage, PaaS services)
- 34. Automating visual softwaretesting QUESTIONS? Adam Carmi Applitools Co-Founder & CTO