Automating the real-user scenarios across multi-apps, and multi-devices

•

0 likes•299 views

This document discusses teswiz, an open source framework for automating real-user scenarios across multiple apps, devices, users, and platforms. It can simulate user actions and behavior to test web, mobile web, Android, iOS, Windows, MacOS and Linux applications. Teswiz uses Cucumber, Appium, Selenium and other tools and supports features like multi-device testing, visual testing with Applitools, and generating reports with ReportPortal. The document provides instructions on getting started with teswiz and links to its GitHub page.

@BagmarAnand 1
Automating the real-user scenarios
across multi-apps & multi-devices
Anand Bagmar
Software Quality Evangelist

@BagmarAnand 2
BagmarAnand
https://www.linkedin.com/in/anandbagmar/
About Me

@BagmarAnand 3
• Simulate user actions & behaviour
Why do we automate functional tests?
https://psmag.com/.image/t_share/MTI3NTgxNjE2MTc1MzU2Mzgy/replicate-this.jpg

@BagmarAnand 4
• Includes delays / waits to inspect and then proceed with next
action
Functional automation includes …
https://thumbs.dreamstime.com/b/colorful-pedestrian-safety-sign-board-closeup-detail-view-161641524.jpg

@BagmarAnand 5
Application under test
https://sites.udel.edu/njimenez/files/2018/05/how-to-create-a-website-feature-image-e1496943224192-1yzdyp6.jpg

@BagmarAnand 6
Automation Scenarios
https://i.stack.imgur.com/W4hm7.png

@BagmarAnand 7
Solved problem
https://www.joydeepdeb.com/images/problem-solved.jpg

@BagmarAnand 8
Many options
https://www.joydeepdeb.com/images/problem-solved.jpg

@BagmarAnand 9
teswiz
https://github.com/znsio/teswiz

@BagmarAnand 10
How does teswiz solve this problem?

@BagmarAnand 11
How does teswiz solve this problem?
API paths called out clearly

@BagmarAnand 13
There is another category of
complexity

@BagmarAnand 14
We live in a hyperconnected world
https://www.oxfordmartin.ox.ac.uk/images/_810x540_crop_center-center_none/dreamstime-worldtrademap.jpg

@BagmarAnand 15
World of
Collaboration & Interactions
https://res.cloudinary.com/hy4kyit2a/f_auto,fl_lossy,q_70/learn/modules/manage_the_sfdc_way_virtual_collaboration/msfw_virtual_collab_recognize_importance_impact/images/3deb17ff7e28a047bb
95f9206ccfddff_ck-36-flx-10004-l-0-yaq-9-gi-941-pw.png

@BagmarAnand 16
How do you automate such
scenarios?
https://moodle.loyola.ca/pluginfile.php/81311/mod_label/intro/man-with-question-01.png

@BagmarAnand 17
teswiz
https://github.com/znsio/teswiz

@BagmarAnand 18
Multi-users
Web, Mobile-Web, Android, iOS, Windows, MacOS, Linux
https://us.123rf.com/450wm/mar1koff/mar1koff2004/mar1koff200400003/145344525-video-conference-colleagues-taking-part-in-video-conference-in-home-virtual-work-meeting-software-fo.jpg

@BagmarAnand 19
How does teswiz solve this problem?

@BagmarAnand 20
teswiz demo
CONFIG=./configs/jiomeet_config.properties TAG="@jiomeet and @multiuser-android and @single-
app" ./gradlew run

@BagmarAnand 21
Multi-platforms
Web, Mobile-Web, Android, iOS, Windows, MacOS, Linux
https://us.123rf.com/450wm/mar1koff/mar1koff2004/mar1koff200400003/145344525-video-conference-colleagues-taking-part-in-video-conference-in-home-virtual-work-meeting-software-fo.jpg

@BagmarAnand 22
How does teswiz solve this problem?

@BagmarAnand 24
teswiz demo
CONFIG=./configs/jiomeet_config.properties TAG="@jiomeet and @multiuser-android-web and
@single-app" ./gradlew run

@BagmarAnand 25
Multi-app Scenario
https://d2908q01vomqb2.cloudfront.net/fb644351560d8296fe6da332236b1f8d61b2828a/2020/12/14/Picture1-6.png
https://www.eseller365.com/wp-content/uploads/2017/08/woman-warehouse-scan-packages.jpg
https://expresswaycourier.com/wp-content/uploads/2018/08/delivery-mail-people-and-shipping-concept-picture-id891482746.jpg
1. Place order 2. Warehouse processes order
3. Ship order to local
delivery station
4. Deliver order
5. Confirm order status “delivered”

@BagmarAnand 26
Multi-app (versions)
https://qph.cf2.quoracdn.net/main-qimg-8c332da930627cec802864b43a9d27bf-lq

@BagmarAnand 27
How does teswiz solve this problem?

@BagmarAnand 28
teswiz demo
CONFIG=./configs/jiomeet_config.properties TAG="@jiomeet and @multiuser-android and @multi-app"
./gradlew run
CONFIG=./configs/jiomeet_config.properties TAG="@jiomeet and @multiuser-android-web and @multi-app"
./gradlew run

@BagmarAnand 29
teswiz - Reports
ReportPortal
Applitools
Feature / Functional Coverage

@BagmarAnand 35
Feature / Functional Coverage

@BagmarAnand 36
teswiz
https://github.com/znsio/teswiz

@BagmarAnand 37
• Open source framework to automate real-user scenarios
• Multi-user
• Multi-device
• Multi-app
• Various cloud device farm integrations
Unique capabilities of teswiz

@BagmarAnand 38
• Web browsers
• Mobile-web browsers
• Android apps
• iOS apps
• Windows desktop apps
Platform support

@BagmarAnand 39
• cucumber-jvm (https://cucumber.io)
• AppiumTestDistribution
(https://github.com/AppiumTestDistribution/AppiumTestDistribution) -manages Android
and iOS devices, and Appium
• Appium (https://appium.io)
• Selenium WebDriver (https://selenium.dev)
• reportportal.io (https://reportportal.io)
• Visual Testing integration with Applitools Visual AI & Applitools Ultrafast
Grid (https://applitools.com)
• Build tool: gradle 7.3.3
teswiz tech stack

@BagmarAnand 40
Running tests using teswiz
Defaults
Property files
Environment
Variables

@BagmarAnand 41
How to proceed?
https://images.squarespace-cdn.com/content/v1/52d2e67ee4b061d68ce10eb3/1482242743879-A3JNK2SSZYJFWKX648BD/image-asset.jpeg

@BagmarAnand 42
getting-started-with-teswiz
https://github.com/znsio/getting-started-with-teswiz/
https://ky.learningprofessor.com/wp-content/uploads/2022/03/get-started.jpg

@BagmarAnand 43
teswiz
https://github.com/znsio/teswiz

@BagmarAnand 44
BagmarAnand
https://www.linkedin.com/in/anandbagmar/
Thank You

Similar to Automating the real-user scenarios across multi-apps, and multi-devices

Eradicate Flaky Tests

Anand Bagmar

Eradicate Flaky Tests - AppiumConf 2021

Anand Bagmar

Dive into Angular, part 5: Experience

Oleksii Prohonnyi

This presentation has been prepared by Oleksii Prohonnyi for internal Angular.js training to improve skills of newbies in JS/Angular. Part 1 (Introduction): http://www.slideshare.net/oprohonnyi/dive-into-angular-part-1-introduction Part 2 (Architecture): http://www.slideshare.net/oprohonnyi/dive-into-angular-part-2-architecture Part 3 (Performance): http://www.slideshare.net/oprohonnyi/dive-into-angular-part-3-performance Part 4 (Angular 2.0): http://www.slideshare.net/oprohonnyi/dive-into-angular-part-4-angular-20

JS Fest 2018. Anna Herlihy. How to Write a Compass Plugin

JSFestUA

Compass is a MongoDB user interface tool written for Electron using NodeJS and React. So what happens if a user has a feature request we can’t support? We let them do it themselves! This talk is about how we implemented a plugin architecture for Compass so that users can write their own features. I will demo Compass, describe the plugin architecture, and then live-code an example plugin. Attendees who are interested in writing their own plugin architecture will learn about how we solved the specific problems with supporting external plugins in an Electron app. I will also explore the security implications of having third-party plugins and the unique challenges involved with supporting open-source plugins in a closed-source project. Writing a Compass plugin is a lot of fun, as well as a great way to get to know React, Node, MongoDB. Attendees will leave the talk with an understanding of how the Compass plugin architecture works and how to start writing their own plugin

Visual Validation - The missing tip of the automation pyramid @GoT2022

Anand Bagmar

The document discusses visual validation testing as a missing piece of the automation testing pyramid. Visual testing is important but challenging as it is typically done manually, which is tedious, error-prone, and difficult to scale. Automating visual testing can help by taking screenshots of expected user interfaces and comparing them to actual screenshots. However, automating also poses challenges around false positives/negatives, maintaining baselines, and accounting for product changes. The document promotes using artificial intelligence in visual test automation to help address these challenges and advocates for including visual testing in an organization's overall quality and automation strategy.

Does your functional automation really add value?

Anand Bagmar

We all know that automation is one of the key enablers for those on the CI-CD journey. Most teams are: • implementing automation • talking about its benefits • up-skilling themselves • talking about tooling • etc. In my experience, unfortunately most of the functional automation that is built is: • not optimal • not fit-for-purpose • does not run fast enough • gives inconsistent feedback, hence unreliable Hence, for the amount of effort invested in implementing automation, are you really getting the value from this activity? In this talk, we will discuss these challenges and why it would lead to poor ROI of automation. More importantly, we will discuss the following techniques to make automation valuable: • know the objective for the automation framework • establish criteria for tests to be automated • design your framework with proper abstraction layers • develop using appropriate design patterns

How to feature flag and run experiments in iOS and Android

Optimizely

Join Tom Zurkan and Kody O’Connell from Optimizely’s Engineering and Developer Relations teams to learn about the developer experience for the iOS and Android SDKs. In this webinar, you’ll learn: - How feature flagging sets a strong foundation for app development - How the iOS and Android SDKs work - What to expect when implementing and maintaining Full Stack in your app - The steps to create feature flags and experiments in your app - How to get started for free with Optimizely Rollouts

Voxxed Athens 2018 - Getting real with progressive web apps in 2018

Voxxed Athens

This document discusses progressive web apps (PWAs) and provides steps to build one. It notes that 2018 is the year of the rise of PWAs as core technologies like service workers are now supported by major browsers. It then outlines 6 steps to build a PWA, including setting up HTTPS, registering a service worker to handle caching and offline capabilities, adding a web app manifest for installation prompts, and using additional features like push notifications. It acknowledges that mature tools and libraries exist to simplify the PWA development process.

Automating with operators - FossAsia Summit 2019

Jorge Morales

This document discusses Kubernetes operators and how they can be used to automate the installation, management, and operation of complex stateful applications on Kubernetes. It begins with an overview of operators and why they are useful for stateful applications that require ongoing management. It then covers key topics like how operators work, how to build an operator using the Operator SDK, and examples of existing operators like for etcd. The document aims to explain the operator framework and resources for learning more.

Guidelhhghghine document final

nanirao686

This document provides guidelines for capturing and formatting test content for popular applications to be used on the Mu Dynamics test platform. It describes how to capture packet capture (PCAP) files using Wireshark for non-HTTP applications, and HTTP Archive (HAR) files using Firebug for HTTP-based applications. The steps include installing the necessary software, capturing representative application traffic, filtering the captures, generating scenarios in the Mu platform, and validating the scenarios. Standards are also defined for naming, formatting and describing the scenario files, JSON metadata files and PCAP/HAR captures to ensure consistency.

A Modern Dive into QA Automation and Beyond

Pratik Patel

A Modern Dive into Automation and Beyond This presentation provides a comprehensive overview of software testing and test automation fundamentals, techniques, and tools. It covers: 1) Basics of software testing - validation, verification, key testing types 2) Introduction to manual testing - its role, writing test cases, test management 3) Overview of test automation - benefits, categories, examples 4) Web test automation - tools like Selenium, Cypress, Playwright 5) Mobile test automation - tools like Appium, Espresso, XCUITest 6) Leveraging AI for test automation

Magnolia & Angular JS - an Approach for Javascript RIAs Delivered by a CMS

Magnolia

When the technology stack of a content and logic driven web application gets defined, there is often the question if it should be build on an open source content management system like Magnolia or if it should be a standalone app which might include several pages from a CMS. Agido's Moritz Rebbert will show an approach where the web application is based on and delivered by the CMS but it's logic is completely separated within REST based services and AngularJS based client side code.

Business Utility Application

IRJET Journal

This document describes a business utility application that was developed to help business owners manage multiple branches more easily. The application allows cashiers to generate bills and tokens, and analyze sales data like best selling items on a daily, weekly or monthly basis. It also allows managers to add/remove items and categories, and view transaction reports. The application was built using React Native and uses a MySQL database. It was tested across different functions and helped business owners reduce waste and better monitor cashiers' work.

SMX West 2014 - Schemas & Microdata

Benu Aggarwal

This document discusses using structured data and schemas to improve search engine optimization. It covers choosing the right markup format, deploying schemas at the content management system level, testing schemas, restructuring content to support schemas, and measuring their impact. The presentation includes examples of implementing different schema types like events, products, and local businesses. It also addresses common schema errors and the importance of ongoing testing and validation.

Towards cross-platfrom application development

ESUG

The document discusses the goals and approach of a cross-platform development framework. The framework allows developing a single application model in a single environment that can run on different platforms without code generation. It models objects as entities with properties, behaviors, and GUI defined according to the platform. The framework implements widget APIs following standards for styles, events and other aspects to provide a consistent development model across platforms.

Building an E-Commerce Application Efficiently

IRJET Journal

This document describes a research project to build an efficient e-commerce application for farmers to purchase crops from local greenhouses. It discusses the current inefficient process farmers face in buying crops and the need for a centralized mobile application. The proposed solution is an Android application using Firebase as the backend database to allow farmers to view nearby greenhouses, crops for sale and quantities. It also considers integrating maps to help farmers calculate land area and determine optimal crop quantities to order. The document reviews several research papers on related topics like land area estimation and mobile web GIS development to incorporate maps. Finally, it outlines the planning process for the application including use case modeling, frontend and backend design.

Streamlining End-to-End Testing Automation

Anand Bagmar

Streamlining End-to-End Testing Automation with Azure DevOps Build & Release Pipelines Automating end-to-end (e2e) test for Android and iOS native apps, and web apps, within Azure build and release pipelines, poses several challenges. This session dives into the key challenges and the repeatable solutions implemented across multiple teams at a leading Indian telecom disruptor, renowned for its affordable 4G/5G services, digital platforms, and broadband connectivity. Challenge #1. Ensuring Test Environment Consistency: Establishing a standardized test execution environment across hundreds of Azure DevOps agents is crucial for achieving dependable testing results. This uniformity must seamlessly span from Build pipelines to various stages of the Release pipeline. Challenge #2. Coordinated Test Execution Across Environments: Executing distinct subsets of tests using the same automation framework across diverse environments, such as the build pipeline and specific stages of the Release Pipeline, demands flexible and cohesive approaches. Challenge #3. Testing on Linux-based Azure DevOps Agents: Conducting tests, particularly for web and native apps, on Azure DevOps Linux agents lacking browser or device connectivity presents specific challenges in attaining thorough testing coverage. This session delves into how these challenges were addressed through: 1. Automate the setup of essential dependencies to ensure a consistent testing environment. 2. Create standardized templates for executing API tests, API workflow tests, and end-to-end tests in the Build pipeline, streamlining the testing process. 3. Implement task groups in Release pipeline stages to facilitate the execution of tests, ensuring consistency and efficiency across deployment phases. 4. Deploy browsers within Docker containers for web application testing, enhancing portability and scalability of testing environments. 5. Leverage diverse device farms dedicated to Android, iOS, and browser testing to cover a wide range of platforms and devices. 6. Integrate AI technology, such as Applitools Visual AI and Ultrafast Grid, to automate test execution and validation, improving accuracy and efficiency. 7. Utilize AI/ML-powered central test automation reporting server through platforms like reportportal.io, providing consolidated and real-time insights into test performance and issues. These solutions not only facilitate comprehensive testing across platforms but also promote the principles of shift-left testing, enabling early feedback, implementing quality gates, and ensuring repeatability. By adopting these techniques, teams can effectively automate and execute tests, accelerating software delivery while upholding high-quality standards across Android, iOS, and web applications.

Most Advanced GTM Deployment. Ever!

Phil Pearce

Phil recently completed a 400 man-hours GTM project & shares lessons learned. Migrating from GA Classic to Universal on 6 CMS platforms and 600 GA classic events is one thing, but facing a fine if the project is not complete within 3 months ads a touch of spice! Phil cleaned-up 2 years of in-house changes, including changes such as consolidated 74 pageview tags and centralizing 20 tags into easy to mange lookup table. Phil provides Technical insights for Advanced Implementers, aswell as Tactical insights for project managers & business people on area such as QA automation, mistakes to avoid, process examples & knowledge sharing tips. Take-aways: - QA tool - Planning tools - Free GTM developer guide

LabVIEW based SCADA system for CERAMIC INDUSTRY

Vaishali Suthar

Real World AngularJS recipes: beyond TodoMVC - Carlo Bonamico, Sonia Pini - C...

Codemotion

This document summarizes a presentation on best practices for developing real world applications with AngularJS. It discusses topics like modularizing the app into components, organizing source code, writing small controllers, using directives, authentication, logging, packaging, and testing Angular apps. References are provided for further reading on techniques like dependency injection, TypeScript, ES6, reusable components, Angular 2.0, Cucumber for BDD testing, and more.

Similar to Automating the real-user scenarios across multi-apps, and multi-devices (20)

Eradicate Flaky Tests

Eradicate Flaky Tests - AppiumConf 2021

Dive into Angular, part 5: Experience

JS Fest 2018. Anna Herlihy. How to Write a Compass Plugin

Visual Validation - The missing tip of the automation pyramid @GoT2022

Does your functional automation really add value?

How to feature flag and run experiments in iOS and Android

Voxxed Athens 2018 - Getting real with progressive web apps in 2018

Automating with operators - FossAsia Summit 2019

Guidelhhghghine document final

A Modern Dive into QA Automation and Beyond

Magnolia & Angular JS - an Approach for Javascript RIAs Delivered by a CMS

Business Utility Application

SMX West 2014 - Schemas & Microdata

Towards cross-platfrom application development

Building an E-Commerce Application Efficiently

Streamlining End-to-End Testing Automation

Most Advanced GTM Deployment. Ever!

LabVIEW based SCADA system for CERAMIC INDUSTRY

Real World AngularJS recipes: beyond TodoMVC - Carlo Bonamico, Sonia Pini - C...

More from Anand Bagmar

Design Patterns in Automation

Anand Bagmar

Next Generation Functional & Visual Testing powered by AI

Anand Bagmar

Slides from hands-on workshop at Agile India 2021. Machine setup instructions are available in the proposal - https://confengine.com/conferences/agile-india-2021/proposal/15552/next-generation-functional-amp-visual-testing-powered-by-ai In this workshop, using numerous examples, we will explore: Why Automated Visual Validation is essential to be part of your Test Strategy How Visual AI increases the coverage of your functional testing, while reducing the code, and increasing stability of your automated tests Potential solutions / options for Automated Visual Testing, with pros & cons of each How an AI-powered tool, Applitools Eyes, can solve this problem Hands-on look at Applitools Visual AI and how to get started using it

The Best Test Automation Framework is...

Anand Bagmar

Visual Validation - The missing tip of the automation pyramid @AgileIndia2020

Anand Bagmar

https://confengine.com/agile-india-2020/proposal/11065/visual-validation-the-missing-tip-of-the-automation-pyramid The top of the pyramid is our UI / end-2-end functional tests - which simulate end-user behavior and interactions with the product-under test. While Automation helps validate functionality of your product, aspects of UX validations can only be seen and captured by the human eye and is hence mostly a manual activity. This is an area where AI & ML can truly help. With everyone wanting to be Agile, make quick releases, the look & feel / UX validation, which is a slow, and error-prone activity, quickly becomes a huge bottleneck. In addition, with any UX related issues propping up cause huge brand-value and revenue loss, may lead to social-trolling and worse - dilute your user-base. In this session, using numerous examples, we will explore: Why Automated Visual Validation is essential to be part of your Test Strategy Potential solutions / options for Automated Visual Testing, with pros & cons of each How an AI-powered tool, Applitools Eyes, can solve this problem.

Selenium Deep Dive

Anand Bagmar

This document outlines an agenda for a Selenium workshop. It covers topics like getting started with Selenium, implementing page object models and design patterns, handling test data, using assertions, and responsive web design testing. Exercises are provided to demonstrate concepts like building page objects, running tests across browsers, and using test data. The goal is to help students learn Selenium concepts and address common automation challenges.

Measuring Coverage From E2E Tests

Anand Bagmar

It is easy to measure code coverage when running unit tests. However, very frequently the following questions come up: - How can we measure API test coverage and e2e / UI test coverage? - Does e2e / UI test coverage add value? - If not, what other data can we look at to know if the e2e tests have good coverage? This session is about understanding the above questions, and finding solutions for the same.

Getting started with Visual Testing using Applitools - @TPC, Feb2020

Anand Bagmar

Visual validation - The missing tip of the automation pyramid @ QA Symposium

Anand Bagmar

Collaboration - A Taboo!

Anand Bagmar

When one has fun at work, work becomes fun. However, daily pressures, metrics, KPIs, and what not, have dissolved the fun, and made work drudgery in various ways. This creates stress for individuals, in teams, and across teams, there is mistrust, unnecessary competition, blame, finger-pointing ….What better way to learn, and re-learn the basics of life, work, team-work - than to play a game, have fun, and correlate it with how life and work indeed should be treated as a game, and we should have fun in this journey. Only then can people truly succeed, and so can organisations.Here, we will play a game – “Collaboration - A Taboo!” – where you will –Re-learn collaboration techniques via a game!Learning applicable for individuals & teams, in small or big organisationsRe-live your childhood when playing this gameBe prepared for a twist which will leave you thinking!

Measuring Consumer Quality - The Missing Feedback Loop

Anand Bagmar

What is Agile Testing? How does Automation help?

Anand Bagmar

Agile Methodology is not new. Many organisations / teams have already adopted Agile way of Software Development or are in the enablement journey for the same. What does this mean for Testing? There is no doubt that the Testing approach and mindset also needs to change to be in tune with the Agile Development methodology. Learn what does it mean to Test on Agile Projects. Also, learn how Test Automation approach needs to change for the team to be successful! Also, see the skills and capabilities required to make anyone in the Quality / Testing role add tremendous value to the team!

The What, Why and How of Analytics Testing

Anand Bagmar

Patterns of a “good” test automation framework

Anand Bagmar

This document discusses patterns for test automation frameworks. It begins by introducing common patterns like page objects, business layer, and factories. It then provides examples of page object and business layer page object patterns. The document also discusses test data patterns and different ways to specify test data and locators. Finally, it outlines advantages of using patterns like reduced complexity, reusability, and maintenance. The key message is that the best pattern depends on the specific test automation context.

Client-Side Performance Testing

Anand Bagmar

Slides from my 4-hour workshop on Client-Side Performance Testing conducted at Phoenix, AZ in STPCon 2017 (March). Workshop Takeaways: Understand difference between is Performance Testing and Performance Engineering. Hand’s on experience of some open-source tools to monitor, measure and automate Client-side Performance Testing. Examples / code walk-through of some ways to automate Client-side Performance Testing. See blog for more details - https://essenceoftesting.blogspot.com/2017/03/workshop-client-side-performance.html

Sharing (less) Pain of using Protractor & WebDriver

Anand Bagmar

Automating Web Analytics

Anand Bagmar

Slides from workshop conducted at ThoughtWorks, Pune in vodQA, on Sat, 27th August, 2016. Workshop Facilitators - Anand Bagmar, Smriti Tuteja, Pallipuspa Samal, Rohit Singhal, S Ramalingam, Shilpa G More information about vodQA, and this workshop can be found from the following links - https://essenceoftesting.blogspot.com/2016/08/vodqa-pune-less-talk-only-action-agenda.html https://essenceoftesting.blogspot.com/search/label/vodQA https://essenceoftesting.blogspot.com/search/label/waat

Sharing the pain using Protractor

Anand Bagmar

Test Data - Food for your Test Automation Framework

Anand Bagmar

Slides from my talk in Selenium Conference 2016, Bangalore Blog post: http://essenceoftesting.blogspot.com/2016/06/test-data-food-for-test-automation.html Abstract: Building a Test Automation Framework is easy - there are so many resources / guides / blogs / etc. available to help you get started and help solve the issues you get along the journey. Teams already building 1000s of tests of various types - UI, web service-based, integration, unit, etc. is a proof of that. However, building a "good" Test Automation Framework is not very easy. There are a lot of principles and practices you need to use, in the right context, with a good set of skills required to make the Test Automation Framework maintainable, scalable and reusable. In this talk, we will focus on one of the critical aspects and patterns in building the Test Automation framework - Test Data! We will look at different data patterns as options and techniques how to create, manage, use, reuse Test Data in a way to keep the tests running in an reliable and deterministic way. We will also discuss what questions to ask, what things to think about in selecting your approach for Test Data! This discussion will be applicable for any type of Test Automation (web / mobile / desktop), but, we will focus primarily on UI automation frameworks, ex. using Selenium. Video & blog post will be linked soon!

Test Automation - Principles and Practices

Anand Bagmar

This document discusses principles and practices for test automation. It covers topics like different levels of testing from unit to integration to UI, the importance of testing non-functional requirements, using a test pyramid approach with more unit and component tests than UI tests. It also discusses practices like continuous integration, test automation framework design considerations, sample framework architectures, and page object patterns. The overall goal is to provide guidance on building quality into software through effective test automation practices.

The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)

Anand Bagmar

Learning Objectives: The most used and heard about buzz words in the Software Industry today are … IoT and Big Data! With IoT, with a creative mindset looking for opportunities and ways to add value, the possibilities are infinite. With each such opportunity, there is a huge volume of data being generated - which if analyzed and used correctly, can feed into creating more opportunities and increased value propositions. There are 2 types of analysis that one needs to think about. 1. How is the end-user interacting with the product? This will give some level of understanding into how to re-position and focus on the true value add features for the product. 2. With the huge volume of data being generated by the end-user interactions, and the data being captured by all devices in the food-chain of the offering, it is important to identify patterns from what has happened, and find out new product / value opportunities based on usage patterns. Learn what is Web Analytics, why is it important, and see some techniques how you can test it manually and and also automate that validation.

More from Anand Bagmar (20)

Design Patterns in Automation

Next Generation Functional & Visual Testing powered by AI

The Best Test Automation Framework is...

Visual Validation - The missing tip of the automation pyramid @AgileIndia2020

Selenium Deep Dive

Measuring Coverage From E2E Tests

Getting started with Visual Testing using Applitools - @TPC, Feb2020

Visual validation - The missing tip of the automation pyramid @ QA Symposium

Collaboration - A Taboo!

Measuring Consumer Quality - The Missing Feedback Loop

What is Agile Testing? How does Automation help?

The What, Why and How of Analytics Testing

Patterns of a “good” test automation framework

Client-Side Performance Testing

Sharing (less) Pain of using Protractor & WebDriver

Automating Web Analytics

Sharing the pain using Protractor

Test Data - Food for your Test Automation Framework

Test Automation - Principles and Practices

The What, Why and How of (Web) Analytics Testing (Web, IoT, Big Data)

Recently uploaded

MVP Mobile Application - Codearrest.pptx

Mitchell Marsh

An MVP (Minimum Viable Product) mobile application is a streamlined version of a mobile app that includes only the core features necessary to address the primary needs of its users. The purpose of an MVP is to validate the app concept with minimal resources, gather user feedback, and identify any areas for improvement before investing in a full-scale development. This approach allows businesses to quickly launch their app, test its market viability, and make data-driven decisions for future enhancements, ensuring a higher likelihood of success and user satisfaction.

Wired_2.0_Create_AmsterdamJUG_09072024.pptx

SimonedeGijt

In this talk, we will explore strategies to optimize the success rate of storing and retaining new information. We will discuss scientifically proven ideal learning intervals and content structures. Additionally, we will examine how to create an environment that improves our focus while you remain in the “flow”. Lastly we will also address the influence of AI on learning capabilities. In the dynamic field of software development, this knowledge will empower you to accelerate your learning curve and support others in their learning journeys.

CViewSurvey Digitech Pvt Ltd that works on a proven C.A.A.G. model.

bhatinidhi2001

CViewSurvey is a SaaS-based Web & Mobile application that provides digital transformation to traditional paper surveys and feedback for customer & employee experience, field & market research that helps you evaluate your customer's as well as employee's loyalty. With our unique C.A.A.G. Collect, Analysis, Act & Grow approach; business & industry’s can create customized surveys on web, publish on app to collect unlimited response & review AI backed real-time data analytics on mobile & tablets anytime, anywhere. Data collected when offline is securely stored in the device, which syncs to the cloud server when connected to any network.

Seamless PostgreSQL to Snowflake Data Transfer in 8 Simple Steps

Estuary Flow

Unlock the full potential of your data by effortlessly migrating from PostgreSQL to Snowflake, the leading cloud data warehouse. This comprehensive guide presents an easy-to-follow 8-step process using Estuary Flow, an open-source data operations platform designed to simplify data pipelines. Discover how to seamlessly transfer your PostgreSQL data to Snowflake, leveraging Estuary Flow's intuitive interface and powerful real-time replication capabilities. Harness the power of both platforms to create a robust data ecosystem that drives business intelligence, analytics, and data-driven decision-making. Key Takeaways: 1. Effortless Migration: Learn how to migrate your PostgreSQL data to Snowflake in 8 simple steps, even with limited technical expertise. 2. Real-Time Insights: Achieve near-instantaneous data syncing for up-to-the-minute analytics and reporting. 3. Cost-Effective Solution: Lower your total cost of ownership (TCO) with Estuary Flow's efficient and scalable architecture. 4. Seamless Integration: Combine the strengths of PostgreSQL's transactional power with Snowflake's cloud-native scalability and data warehousing features. Don't miss out on this opportunity to unlock the full potential of your data. Read & Download this comprehensive guide now and embark on a seamless data journey from PostgreSQL to Snowflake with Estuary Flow! Try it Free: https://dashboard.estuary.dev/register

Splunk_Remote_Work_Insights_Overview.pptx

sudsdeep

WhatsApp Tracker - Tracking WhatsApp to Boost Online Safety.pdf

onemonitarsoftware

Cultural Shifts: Embracing DevOps for Organizational Transformation

Mindfire Solution

Mindfire Solutions specializes in DevOps services, facilitating digital transformation through streamlined software development and operational efficiency. Their expertise enhances collaboration, accelerates delivery cycles, and ensures scalability using cloud-native technologies. Mindfire Solutions empowers businesses to innovate rapidly and maintain competitive advantage in dynamic market landscapes.

React vs Next js: Which is Better for Web Development? - Semiosis Software Pr...

Semiosis Software Private Limited

Abortion pills in Fujairah *((+971588192166*)☎️)¥) **Effective Abortion Pills...

Medical / Health Care (+971588192166) Mifepristone and Misoprostol tablets 200mg

IN Dubai [WHATSAPP:Only (+971588192166**)] Abortion Pills For Sale In Dubai** UAE** Mifepristone and Misoprostol Tablets Available In Dubai** UAE CONTACT DR. SINDY Whatsapp +971588192166* We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai** Sharjah** Abudhabi** Ajman** Alain** Fujairah** Ras Al Khaimah** Umm Al Quwain** UAE** Buy cytotec in Dubai +971588192166* '''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol** Cytotec” +971588192166* ' Dr.SINDY ''BUY ABORTION PILLS MIFEGEST KIT** MISOPROSTOL** CYTOTEC PILLS IN DUBAI** ABU DHABI**UAE'' Contact me now via What's App… abortion pills in dubai Mtp-Kit Prices abortion pills available in dubai/abortion pills for sale in dubai/abortion pills in uae/cytotec dubai/abortion pills in abu dhabi/abortion pills available in abu dhabi/abortion tablets in uae … abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all** Cytotec Abortion Pills are Available In Dubai / UAE** you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pills in Dubai** UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if it's beyond 6 months. Our Abu Dhabi** Ajman** Al Ain** Dubai** Fujairah** Ras Al Khaimah (RAK)** Sharjah** Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical** medical and surgical abortion methods for early through late second trimester** including the Abortion By Pill Procedure (RU 486** Mifeprex** Mifepristone** early options French Abortion Pill)** Tamoxifen** Methotrexate and Cytotec (Misoprostol). The Abu Dhabi** United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used** 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need for surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi** United Arab Emirates** uses the latest medications for medical abortions (RU-486** Mifeprex** Mifegyne** Mifepristone** early options French abortion pill)** Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi** United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our

ANSYS Mechanical APDL Introductory Tutorials.pdf

sachin chaurasia

Ansys Mechanical enables you to solve complex structural engineering problems and make better, faster design decisions. With the finite element analysis (FEA) solvers available in the suite, you can customize and automate solutions for your structural mechanics problems and parameterize them to analyze multiple design scenarios. Ansys Mechanical is a dynamic tool that has a complete range of analysis tools.

Intro to Amazon Web Services (AWS) and Gen AI

Ortus Solutions, Corp

Shivam Pandit working on Php Web Developer.

shivamt017

FAST Channels: Explosive Growth Forecast 2024-2027 (Buckle Up!)

Roshan Dwivedi

BITCOIN HEIST RANSOMEWARE ATTACK PREDICTION

ssuser2b426d1

NBFC Software: Optimize Your Non-Banking Financial Company

NBFC Softwares

NBFC Software: Optimize Your Non-Banking Financial Company Enhance Your Financial Services with Comprehensive NBFC Software NBFC software provides a complete solution for non-banking financial companies, streamlining banking and accounting functions to reduce operational costs. Our software is designed to meet the diverse needs of NBFCs, including investment banks, insurance companies, and hedge funds. Key Features of NBFC Software: Centralized Database: Facilitates inter-branch collaboration and smooth operations with a unified platform. Automation: Simplifies loan lifecycle management and account maintenance, ensuring efficient delivery of financial services. Customization: Highly customizable to fit specific business needs, offering flexibility in managing various loan types such as home loans, mortgage loans, personal loans, and more. Security: Ensures safe and secure handling of financial transactions and sensitive data. User-Friendly Interface: Designed to be intuitive and easy to use, reducing the learning curve for employees. Cost-Effective: Reduces the need for additional manpower by automating tasks, making it a budget-friendly solution. Benefits of NBFC Software: Go Paperless: Transition to a fully digital operation, eliminating offline work. Transparency: Enables managers and executives to monitor various points of the banking process easily. Defaulter Tracking: Helps track loan defaulters, maintaining a healthy loan management system. Increased Accessibility: Cutting-edge technology increases the accessibility and usability of NBFC operations. Request a Demo Now!

$Development of Chatbot Using AI\ML Technologies$ $Development of Chatbot Using AI\ML Technologies$

Development of Chatbot Using AI\ML Technologies

MaisnamLuwangPibarel

A captivating AI chatbot PowerPoint presentation is made with a striking backdrop in order to attract a wider audience. Select this template featuring several AI chatbot visuals to boost audience engagement and spontaneity. With the aid of this multi-colored template, you may make a compelling presentation and get extra bonuses. To easily elucidate your ideas, choose a typeface with vibrant colors. You can include your data regarding utilizing the chatbot methodology to the remaining half of the template.

Discover the Power of ONEMONITAR: The Ultimate Mobile Spy App for Android Dev...

onemonitarsoftware

Unlock the full potential of mobile monitoring with ONEMONITAR. Our advanced and discreet app offers a comprehensive suite of features, including hidden call recording, real-time GPS tracking, message monitoring, and much more. Perfect for parents, employers, and anyone needing a reliable solution, ONEMONITAR ensures you stay informed and in control. Explore the key features of ONEMONITAR and see why it’s the trusted choice for Android device monitoring. Share this infographic to spread the word about the ultimate mobile spy app!

AWS Cloud Practitioner Essentials (Second Edition) (Arabic) AWS Security .pdf

karim wahed

introduction of Ansys software and basic and advance knowledge of modelling s...

sachin chaurasia

dachnug51 - Whats new in domino 14 .pdf

DNUG e.V.

Recently uploaded (20)

MVP Mobile Application - Codearrest.pptx

Wired_2.0_Create_AmsterdamJUG_09072024.pptx

CViewSurvey Digitech Pvt Ltd that works on a proven C.A.A.G. model.

Seamless PostgreSQL to Snowflake Data Transfer in 8 Simple Steps

Splunk_Remote_Work_Insights_Overview.pptx

WhatsApp Tracker - Tracking WhatsApp to Boost Online Safety.pdf

Cultural Shifts: Embracing DevOps for Organizational Transformation

React vs Next js: Which is Better for Web Development? - Semiosis Software Pr...

Abortion pills in Fujairah *((+971588192166*)☎️)¥) **Effective Abortion Pills...

ANSYS Mechanical APDL Introductory Tutorials.pdf

Intro to Amazon Web Services (AWS) and Gen AI

Shivam Pandit working on Php Web Developer.

FAST Channels: Explosive Growth Forecast 2024-2027 (Buckle Up!)

BITCOIN HEIST RANSOMEWARE ATTACK PREDICTION

NBFC Software: Optimize Your Non-Banking Financial Company

$Development of Chatbot Using AI\ML Technologies$ $Development of Chatbot Using AI\ML Technologies$

Development of Chatbot Using AI\ML Technologies

Discover the Power of ONEMONITAR: The Ultimate Mobile Spy App for Android Dev...

AWS Cloud Practitioner Essentials (Second Edition) (Arabic) AWS Security .pdf

introduction of Ansys software and basic and advance knowledge of modelling s...

dachnug51 - Whats new in domino 14 .pdf

Automating the real-user scenarios across multi-apps, and multi-devices

1. @BagmarAnand 1 Automating the real-user scenarios across multi-apps & multi-devices Anand Bagmar Software Quality Evangelist

2. @BagmarAnand 2 BagmarAnand https://www.linkedin.com/in/anandbagmar/ About Me

3. @BagmarAnand 3 • Simulate user actions & behaviour Why do we automate functional tests? https://psmag.com/.image/t_share/MTI3NTgxNjE2MTc1MzU2Mzgy/replicate-this.jpg

4. @BagmarAnand 4 • Includes delays / waits to inspect and then proceed with next action Functional automation includes … https://thumbs.dreamstime.com/b/colorful-pedestrian-safety-sign-board-closeup-detail-view-161641524.jpg

5. @BagmarAnand 5 Application under test https://sites.udel.edu/njimenez/files/2018/05/how-to-create-a-website-feature-image-e1496943224192-1yzdyp6.jpg

6. @BagmarAnand 6 Automation Scenarios https://i.stack.imgur.com/W4hm7.png

7. @BagmarAnand 7 Solved problem https://www.joydeepdeb.com/images/problem-solved.jpg

8. @BagmarAnand 8 Many options https://www.joydeepdeb.com/images/problem-solved.jpg

9. @BagmarAnand 9 teswiz https://github.com/znsio/teswiz

10. @BagmarAnand 10 How does teswiz solve this problem?

11. @BagmarAnand 11 How does teswiz solve this problem? API paths called out clearly

12. @BagmarAnand 13 There is another category of complexity

13. @BagmarAnand 14 We live in a hyperconnected world https://www.oxfordmartin.ox.ac.uk/images/_810x540_crop_center-center_none/dreamstime-worldtrademap.jpg

14. @BagmarAnand 15 World of Collaboration & Interactions https://res.cloudinary.com/hy4kyit2a/f_auto,fl_lossy,q_70/learn/modules/manage_the_sfdc_way_virtual_collaboration/msfw_virtual_collab_recognize_importance_impact/images/3deb17ff7e28a047bb 95f9206ccfddff_ck-36-flx-10004-l-0-yaq-9-gi-941-pw.png

15. @BagmarAnand 16 How do you automate such scenarios? https://moodle.loyola.ca/pluginfile.php/81311/mod_label/intro/man-with-question-01.png

16. @BagmarAnand 17 teswiz https://github.com/znsio/teswiz

17. @BagmarAnand 18 Multi-users Web, Mobile-Web, Android, iOS, Windows, MacOS, Linux https://us.123rf.com/450wm/mar1koff/mar1koff2004/mar1koff200400003/145344525-video-conference-colleagues-taking-part-in-video-conference-in-home-virtual-work-meeting-software-fo.jpg

18. @BagmarAnand 19 How does teswiz solve this problem?

19. @BagmarAnand 20 teswiz demo CONFIG=./configs/jiomeet_config.properties TAG="@jiomeet and @multiuser-android and @single- app" ./gradlew run

20. @BagmarAnand 21 Multi-platforms Web, Mobile-Web, Android, iOS, Windows, MacOS, Linux https://us.123rf.com/450wm/mar1koff/mar1koff2004/mar1koff200400003/145344525-video-conference-colleagues-taking-part-in-video-conference-in-home-virtual-work-meeting-software-fo.jpg

21. @BagmarAnand 22 How does teswiz solve this problem?

22. @BagmarAnand 24 teswiz demo CONFIG=./configs/jiomeet_config.properties TAG="@jiomeet and @multiuser-android-web and @single-app" ./gradlew run

23. @BagmarAnand 25 Multi-app Scenario https://d2908q01vomqb2.cloudfront.net/fb644351560d8296fe6da332236b1f8d61b2828a/2020/12/14/Picture1-6.png https://www.eseller365.com/wp-content/uploads/2017/08/woman-warehouse-scan-packages.jpg https://expresswaycourier.com/wp-content/uploads/2018/08/delivery-mail-people-and-shipping-concept-picture-id891482746.jpg 1. Place order 2. Warehouse processes order 3. Ship order to local delivery station 4. Deliver order 5. Confirm order status “delivered”

24. @BagmarAnand 26 Multi-app (versions) https://qph.cf2.quoracdn.net/main-qimg-8c332da930627cec802864b43a9d27bf-lq

25. @BagmarAnand 27 How does teswiz solve this problem?

26. @BagmarAnand 28 teswiz demo CONFIG=./configs/jiomeet_config.properties TAG="@jiomeet and @multiuser-android and @multi-app" ./gradlew run CONFIG=./configs/jiomeet_config.properties TAG="@jiomeet and @multiuser-android-web and @multi-app" ./gradlew run

27. @BagmarAnand 29 teswiz - Reports ReportPortal Applitools Feature / Functional Coverage

28. @BagmarAnand 30 ReportPortal

29. @BagmarAnand 31 ReportPortal

30. @BagmarAnand 32 ReportPortal

31. @BagmarAnand 33 ReportPortal

32. @BagmarAnand 34 Applitools

33. @BagmarAnand 35 Feature / Functional Coverage

34. @BagmarAnand 36 teswiz https://github.com/znsio/teswiz

35. @BagmarAnand 37 • Open source framework to automate real-user scenarios • Multi-user • Multi-device • Multi-app • Various cloud device farm integrations Unique capabilities of teswiz

36. @BagmarAnand 38 • Web browsers • Mobile-web browsers • Android apps • iOS apps • Windows desktop apps Platform support

37. @BagmarAnand 39 • cucumber-jvm (https://cucumber.io) • AppiumTestDistribution (https://github.com/AppiumTestDistribution/AppiumTestDistribution) -manages Android and iOS devices, and Appium • Appium (https://appium.io) • Selenium WebDriver (https://selenium.dev) • reportportal.io (https://reportportal.io) • Visual Testing integration with Applitools Visual AI & Applitools Ultrafast Grid (https://applitools.com) • Build tool: gradle 7.3.3 teswiz tech stack

38. @BagmarAnand 40 Running tests using teswiz Defaults Property files Environment Variables

39. @BagmarAnand 41 How to proceed? https://images.squarespace-cdn.com/content/v1/52d2e67ee4b061d68ce10eb3/1482242743879-A3JNK2SSZYJFWKX648BD/image-asset.jpeg

40. @BagmarAnand 42 getting-started-with-teswiz https://github.com/znsio/getting-started-with-teswiz/ https://ky.learningprofessor.com/wp-content/uploads/2022/03/get-started.jpg

41. @BagmarAnand 43 teswiz https://github.com/znsio/teswiz

42. @BagmarAnand 44 BagmarAnand https://www.linkedin.com/in/anandbagmar/ Thank You

Automating the real-user scenarios across multi-apps, and multi-devices

More Related Content

Similar to Automating the real-user scenarios across multi-apps, and multi-devices

Similar to Automating the real-user scenarios across multi-apps, and multi-devices (20)

More from Anand Bagmar

More from Anand Bagmar (20)

Recently uploaded

Recently uploaded (20)

Automating the real-user scenarios across multi-apps, and multi-devices