Client-Side Performance Testing

•

1 like•4,788 views

Slides from my 4-hour workshop on Client-Side Performance Testing conducted at Phoenix, AZ in STPCon 2017 (March). Workshop Takeaways: Understand difference between is Performance Testing and Performance Engineering. Hand’s on experience of some open-source tools to monitor, measure and automate Client-side Performance Testing. Examples / code walk-through of some ways to automate Client-side Performance Testing. See blog for more details - https://essenceoftesting.blogspot.com/2017/03/workshop-client-side-performance.html

CLIENT-SIDE
PERFORMANCE TESTING
Anand Bagmar
Software Quality Evangelist

ABOUT ME
@BagmarAnand
Blog - essenceoftesting
about.me/anand.bagmar

Why do we have to think
about, or, do
Performance Testing?

https://www.crazyegg.com/blog/speed-up-your-website/

https://en.wikipedia.org/wiki/Software_performance_testing

https://en.wikipedia.org/wiki/Performance_engineering

TECHNIQUES TO IMPROVE PERFORMANCE
We need to understand, and optimize
¨ Architecture, and
¨ How content gets delivered to the end-user

https://en.wikipedia.org/wiki/Content_delivery_network

http://www.slideshare.net/gsluthra/harnessing-the-power-of-cdns

By Kanoha - Own work, CC BY-SA 3.0, https://commons.wikimedia.org/w/index.php?curid=7868809
CDN DISTRIBUTION NETWORK

Are there any
problems / limitations
of CDNs?

Caching!
In computing, a cache (/ˈkæʃ/ KASH) is a component that stores
data so future requests for that data can be served faster; the data
stored in a cache might be the results of an earlier computation, or
the duplicates of data stored elsewhere.

WHY CDN?
¨ Caching: Reduced Page Construction Time
¨ Closer: Reduced Latency
¨ Traffic Offloaded: Reduced Loads
¨ Backup: Served even if site is down
¨ Protection: Prevent DoS Attacks
¨ Others: Redirects/Auto-compression/Best-route detection

TYPICAL ARCHITECTURE
Improve user experienceReduce server load

TYPES OF CACHES
¨ Web browser
¨ Proxy
¨ CDNs
¨ Reverse Proxies
¨ Web Server’s / Specialized Caches

WE WILL FOCUS ON
Improve user experienceReduce server load

To fix performance issues, we need
to be able to measure it first!

MEASURING CLIENT SIDE PERFORMANCE
Synthetic Monitoring (& Testing)
Ø WebPageTest.org
Ø SiteSpeed.io
Ø ShowSlow
Ø Google PageSpeed
Ø Chrome Developer Tools

MEASURING CLIENT SIDE PERFORMANCE
Real User Monitoring
Ø Akamai RUM
Ø Monitis RUM
Ø Google Analytics

WEBPAGETEST – HOSTED SOLUTION
Advantages
Ø Free to use
Ø Global spread
Ø Caters to current web development practices /
approaches (responsive / lazy loading / etc.)

IMPORTANT METRICS
What to
Measure?
WebPageTest
Metric
Explanation
First
reaction
Time to First
Byte (TTFB)
Time from the start of the initial navigation until the first
byte of the base page is received by the browser (after
following redirects).
Content
appears
Time to Start
Render
Time from the start of the initial navigation until the first
non-white content is painted to the browser display.
Page
processing
completed
DOM Content
Ready End
The point when the HTML parser has reached the end of
the document which means it has executed any blocking
scripts. The CSSOM may not be complete yet.
Full page
loaded
Doc Complete
Time
The onload event which fires when all of the scripts, css and
images defined in the HTML have finished loading
(including below-the-fold content).
Refer to WebPageTest documentation for more details:
• https://sites.google.com/a/webpagetest.org/docs/using-webpagetest/metrics
• https://sites.google.com/a/webpagetest.org/docs/advanced-features/raw-test-results

WEBPAGETEST – HOSTED SOLUTION
Disadvantages
Ø Need to get in the queue of currently executing tests
Ø Can run only against publically available URLs / pages
Ø Limited automation using REST APIs

WEBPAGETEST – PRIVATE INSTANCE
Advantages
Ø Free to use, Open-source
Ø Can run multiple scenarios in parallel (limited by number
of agents configured)
Ø Can run against public and private available URLs / pages
Ø Results available for as long as configured
Ø There is no limit on number of tests run per day

WEBPAGETEST – PRIVATE INSTANCE
Disadvantages
Ø Need to setup the WPT server and WPT agents in our own
infrastructure, or in AWS

WEBPAGETEST - AUTOMATION
Ø REST API calls
Ø Poll for results / implement call back
Ø Parse summary / detail CSV file to do assertions /
validations
Challenges
Ø Managing infrastructure
Ø Polling for results can be time consuming and error prone

YSLOW
Advantages
Ø Simple to use (with phantomJS)
Ø Gives reasonably decent information
Ø Easy to hook with Continuous Integration (CI) Server

http://phantomjs.org/download.html
https://github.com/anandbagmar/client-side-perf-tests

YSLOW
Disadvantages
Ø OLD
Ø Does not consider lazy loading / responsive design

https://developers.google.com/web/tools/chrome-devtools/

https://developers.google.com/speed/pagespeed/insights/

GOOGLE PAGE SPEED
Ø De facto standard
Ø Shows opportunities to increase page speed score
Ø Works only for public URLs / pages

RESOURCES
Ø www.webpagetest.org
Ø Page Speed
Ø PhantomJS – YSlow
Ø Sample automation –client-side-perf-tests
Ø Chrome Developer Tools

@BagmarAnand
Blog - essenceoftesting
about.me/anand.bagmar
THANK YOU

What's hot

Load testing with J meter

Manoj Shankaramanchi

Performance Testing Using JMeter | Edureka

Edureka!

** Selenium Certification Training: https://www.edureka.co/testing-with-selenium-webdriver ** This Edureka PPT on Performance Testing Tutorial gives a complete insight on performance testing, its types, and how to do performance testing with the help of JMeter. Below topics are covered in this PPT: 1:07 - Performance Testing Overview 3:03 - Performance Testing Types 3:54 - Performance Testing Problems 6:14 - Performance Testing Process 9:24 - Performance Testing examples 10:33 - Tools of Performance Testing 13:16 - Jmeter Demo Follow us to never miss an update in the future. Instagram: https://www.instagram.com/edureka_learning/ Facebook: https://www.facebook.com/edurekaIN/ Twitter: https://twitter.com/edurekain LinkedIn: https://www.linkedin.com/company/edureka

Performance testing with JMeter

Mikael Kundert

This document discusses performance testing tools and techniques. It defines performance from the perspectives of developers, infrastructure, and end users. Key aspects covered include defining realistic user scenarios, available tools like JMeter, ApacheBench, Gatling and Locust, and the importance of continuous performance testing. The document recommends using the Apdex score as part of your definition of done, specifying good test scenarios, running tests simultaneously, choosing the right tool for your needs, and considering tools like Taurus that enable continuous performance testing.

An Introduction to Performance Testing

SWAAM Tech

The document discusses performance testing, including its goals, importance, types, prerequisites, management approaches, testing cycle, activities, common issues, typical fixes, challenges, and best practices. The key types of performance testing are load, stress, soak/endurance, volume/spike, scalability, and configuration testing. Performance testing aims to assess production readiness, compare platforms/configurations, evaluate against criteria, and discover poor performance. It is important for meeting user expectations and avoiding lost revenue.

Jmeter Performance Testing

Atul Pant

The document discusses performance testing using Apache JMeter. It covers topics like an overview of performance testing, the purpose of performance testing, key types of performance testing like load testing and stress testing. It also discusses pre-requisites of performance testing, the performance testing life cycle, challenges of performance testing and how to record and playback tests using JMeter.

Apache JMeter - A brief introduction

silenceIT Inc.

Selenium Concepts

Swati Bansal

This document provides an overview of Selenium, an open source tool for automating web application testing. It discusses key Selenium concepts like Selenese commands, components like actions, assertions, and locators. It also covers the different flavors of Selenium including Selenium IDE for recording tests in Firefox, Selenium RC for executing tests programmatically in various languages, and Selenium Grid for distributed testing. The document aims to help users understand the basics of Selenium and how to get started with test automation.

Sanity testing and smoke testing

MUHAMMAD FARHAN ASLAM

Types of performance testing

NaveenKumar Namachivayam

Performance testing validates an application's responsiveness, stability, and other quality attributes under various workloads. It involves load testing, stress testing, endurance testing, spike testing, volume testing, availability testing, and scalability testing. The key parameters analyzed are response time, throughput, and memory utilization. Performance testing helps determine an application's speed, scalability, stability, and ability to handle changes in load and traffic over time.

Performance Testing

Selin Gungor

This document discusses performance testing and provides information on several related topics: - It defines performance, load, and stress testing and explains their differences. - It outlines why performance testing is important, when it should be conducted, and what aspects of a system should be tested. - The performance testing process is described as involving planning, creating test scenarios and scripts, running tests, monitoring tests, and analyzing results. - Automated performance testing is presented as more effective than manual testing due to issues with resources, coordination, and repeatability when using human testers.

Load Testing and JMeter Presentation

Neill Lima

Load testing simulates multiple users accessing an application simultaneously to evaluate performance under different load scenarios. There are three main types of load testing: 1. Performance testing gradually increases load to determine the maximum number of users/requests per second an application can handle. 2. Stress testing pushes load beyond normal limits to identify the breaking point and ensure error handling. 3. Soak testing subjects an application to high load over an extended period to check for resource allocation problems, memory leaks, and server overloading. The tool JMeter is commonly used for load testing and allows simulating many users and transactions. It can test HTTP, databases, and other components. Plugins extend its functionality and distributed testing improves load

Case study: Open Source Automation Framework using Selenium WebDriver

RTTS

Synopsis: The client provides training, nutrition, and physical therapy programs by a team of specialists. As part of their program, they utilize software that integrates with workout machines to provide the user with recommended training exercises based on previous workouts, weekly workout challenges, and member goals. Athletes’ Performance is looking to implement a functional test automation framework for their application in order to perform regression testing as new builds are released.

Apache jMeter

NexThoughts Technologies

Load Testing Best Practices

Apica

Automation Testing using Selenium

Naresh Chintalcheru

Selenium is an open source browser automation tool used for automating web application testing. It supports recording and playback of test cases in multiple programming languages like Java, Python and Ruby. Selenium has several components like Selenium IDE for recording and playing back tests without coding, Selenium RC for running tests on remote machines, and Selenium Webdriver which allows directly controlling browser behavior without relying on external servers. Selenium Grid enables parallel execution of tests on different machines for faster test runs. Selenium is used by many companies for testing web applications and is useful for both functional and regression testing of websites and web apps.

End to end testing - strategies

anuvip

This document discusses end-to-end testing and why it is important for complex modern software systems with multiple interconnected subsystems. End-to-end testing ensures that all subsystems work together as expected by testing user journeys that trigger actions across systems. It recommends planning end-to-end test cases that think through scenarios from start to finish and avoid adding unnecessary tests. Automating end-to-end test cases is difficult but valuable as it can catch issues that arise from system interactions.

Redux Thunk

ASIMYILDIZ

Selenium WebDriver Tutorial | Selenium WebDriver Tutorial For Beginner | Sele...

Simplilearn

This presentation about Selenium WebDriver will help you understand what is Selenium, why Selenium WebDriver was developed, what exactly is Selenium WebDriver, the architecture of Selenium WebDriver and the limitations of Selenium WebDriver. In the end, we'll be looking at a demo showing the working of WebDriver using java. Selenium is an automated testing tool that tests web applications across various platforms and browsers. WebDriver happens to be one of the Selenium tools with a simple yet robust architecture. It controls the browser based on the user program. WebDriver revolutionized automation testing and continues to do so. Let's move further and understand the selenium web driver in detail. Below are the topics we will be discussing in the presentation: 1. What is Selenium? 2. Why Selenium WebDriver? 3. What is Selenium WebDriver? 4. The architecture of Selenium WebDriver 5. Limitations of Selenium WebDriver 6. Demo: Automation testing with WebDriver Selenium training has been designed to help developers and manual testers learn how to automate web applications with a robust framework, and integrate it within the DevOps processes of an organization. The course includes basic as well as advanced concepts of WebDriver and other tools/frameworks like TestNG, Maven, AutoIT, Sikuli, log4j. Special focus is given on building a robust framework with Page Object Design Pattern, Data-Driven Approach, and creating reusable components to improve productivity. The course also covers the Selenium Grid, which along with TestNG helps achieve parallel execution to improve coverage and reduce execution time for faster feedback. Appium is an open source test automation framework for use with native, hybrid, and mobile web applications. The course includes a project where you have to create the test automation for an eCommerce application with a framework and reporting. What are the objectives of this Selenium training course? This course will enable you to: 1. Revise the core Java concepts which are essential for learning Selenium WebDriver 2. Understand the scope of Test Automation in DevOps and fundamentals of Test Automation 3. Create Test Cases using Selenium IDE – Record and Playback tool 4. Understand Selenium WebDriver architecture and various layers of interaction 5. Set up WebDriver project in Eclipse and write test cases using TestNG 6. Locate elements using various locating techniques 7. Work with various WebDriver commands to drive web browser and various WebElement commands to deal with various web components 8. Learn to deal with various possible scenarios in terms of pop-ups, multiple Windows, frames, taking screenshots 9. Implement Page Object Design Pattern and Data Driven Testing 10. Understand how to use Maven, ANT, AutoIT, Sikuli, log4j, and listeners 11. Learn to use Selenium Grid with TestNG for parallel execution Learn more at https://www.simplilearn.com/selenium-certification-training

Automation - web testing with selenium

Tzirla Rozental

Automation testing

Mona M. Abd El-Rahman

This document discusses automation testing. It begins by defining automation testing and listing its benefits, which include saving time and money, improving accuracy, and increasing test coverage. It then covers levels of automation testing, frameworks, approaches like record and playback, modular scripting, and keyword-driven testing. The document also discusses the automation testing lifecycle, how to choose a testing tool, types of tools, when to automate and who should automate, supporting practices, and skills needed for automation testing.

What's hot (20)

Load testing with J meter

Performance Testing Using JMeter | Edureka

Performance testing with JMeter

An Introduction to Performance Testing

Jmeter Performance Testing

Apache JMeter - A brief introduction

Selenium Concepts

Sanity testing and smoke testing

Types of performance testing

Performance Testing

Load Testing and JMeter Presentation

Case study: Open Source Automation Framework using Selenium WebDriver

Apache jMeter

Load Testing Best Practices

Automation Testing using Selenium

End to end testing - strategies

Redux Thunk

Selenium WebDriver Tutorial | Selenium WebDriver Tutorial For Beginner | Sele...

Automation - web testing with selenium

Automation testing

Similar to Client-Side Performance Testing

Client-side Performance Testing

Thoughtworks

This document discusses client-side performance testing. It describes measuring client-side performance through synthetic monitoring tools like WebPageTest.org, SiteSpeed.io and ShowSlow which test page load speeds, and real user monitoring through Akamai RUM, Monitis RUM and Google Analytics. WebPageTest.org is demonstrated in more detail, showing how to use it to test pages and understand key metrics like time to first byte, time to start render and full page loaded time. Private instances and automation of WebPageTest is also covered. YSlow and Google PageSpeed are also mentioned as alternatives for measuring client performance.

Client-Side Performance Testing

Client-Side Performance Testing

More Related Content

What's hot

What's hot (20)

Similar to Client-Side Performance Testing

Similar to Client-Side Performance Testing (20)

More from Anand Bagmar

More from Anand Bagmar (20)

Recently uploaded

Recently uploaded (20)

Client-Side Performance Testing