Coming-Soon-Selenium-41

Selenium 4 is releasing soon: What every QA must know?

Selenium 4 version is all set to release this Christmas. Simon Stewart (founding member of Selenium) has officially announced at the recently held selenium conference at Bangalore. Some major changes in the upcoming Selenium 4 have been revealed. So, it’s time to get ahead of the curve and figure out what is going to be changed, added and deprecated. In this article, we will take a look a few important features and give an insight on updates you can expect for your automation framework.

W3C WebDriver Standardization

The Selenium 4 WebDriver will be completely W3C Standardized. The WebDriver API has grown to be relevant outside of Selenium. It is used in multiple tools for automation. For example, it’s used heavily in mobile testing through tools such as Appium and iOS Driver. The W3C standard will encourage compatibility across different software implementations of the WebDriver API.

Let’s take an example of how Selenium Grid communicates with Driver executables as of now –

Adopting New Protocol

Adopting-New-Protocol

A test in Selenium 3.x, at local end (through json wire protocol) communicates with browser at End node.This requires encoding and decoding of API. In Selenium 4, test will directly communicate without any encoding and decoding of API requests (through W3C Protocol) though java bindings will be backward compatible but focusing more on W3C Protocol.

The Json wire protocol will no longer be used.

There are multiple contributors in webdriver  W3C specs. All of the work done is on github which can be found on- https://github.com/w3c/webdriver

Selenium 4 IDE TNG

Selenium-4-IDE-TNG

The Selenium IDE support for Chrome is in bucket. As we all know that Selenium IDE is a record and playback tool. It will now be available with much more rich and advance features such as:

  • New plugin system– Any browser vendor will now be able to easily plug-in to the new selenium IDE. You can have your own locator strategy and can plug in selenium IDE.
  • New CLI runner – It will be completely based on nodejs and not old html based runner. It will have following capabilities-
    • WebDriver Playback – The new Selenium IDE runner will be completely based on WebDriver.
    • Parallel execution- The new CLI runner will also support parallel test case execution and will provide useful information like time taken, number of test cases passed and failed.

Improved Selenium Grid

The one who have worked on Selenium Grid must know how difficult it is to setup and configure.Selenium Grid supports test case execution on different browsers, operating systems and machines. Thus it provides parallel execution capability.

There are two main elements in Selenium Grid-  Hub and  Node.

Hub- Acts as a server,a central point to control all the test machines in a network. In selenium grid there is only one hub which allocates the test execution to a particular node based on capability matches.

Node- In simple words node is a test machine where test cases actually run.

Selenium-Node-Container

For more details on selenium grid,follow the tutorial here- https://www.seleniumhq.org/docs/07_selenium_grid.jsp

The typical process to setup selenium grid till now caused testers sometimes to face difficulty in connecting node to hub.

In Selenium 4 the grid experience is going to be easy and smooth. As there will not be any need to setup and start hub and node separately. Once we start selenium server, the grid will act as both hub and node.

Selenium 4 will come up with more stable selenium grid in terms of removing all thread-safety bugs, and a better support for docker.

Better Selenium Grid UI

The Selenium 4 would come up with more user friendly UI of grid having relevant informations about sessions running, capacity etc.

Better Observability

“Passive observability is the ability to do descriptive tracing.”  
– Simon Stewart

Observability, logging and debugging is no more confined to DevOps in recent times. As part of this release request tracing and logging with hooks will be improved so as to provide automation engineers a hold on debugging.

Refreshed Documentation

Documentation plays a key role in any project’s success. Selenium docs were not updated since selenium 2.0 release. In the latest upgrade selenium documentation is also going to be refreshed and detailed [WIP].You can access it on – https://seleniumhq.github.io/docs/

Here’s the video from Selenium Conference 2018 held at Bangalore recently

Selenium 4 In a nutshell

Upgrading to the latest version of selenium should not require any code changes.  Setting up node and hub will become smooth and the entire grid experience is going to be streamlined. For automation engineers, the latest version should not be challenging and existing automation framework should work with minimal changes.

More to come

These are few important changes. Stay tuned as there is plenty more to come.

Talk to our Test Engineers

Fast track your ecommerce monitoring

RECENT POSTS

Glitch

What is synthetic testing?

Your website can misbehave anytime. Learn how you can use synthetic testing to watch if performance is low and correct it on-time so that your users are not affected.

Synthetic Monitoring tools

Synthetic Monitoring – why & when to use it

Website monitoring has advanced from checking for web page availability to analysing real user journeys through a website. Learn if synthetic monitoring is the right fit for you to maintain a quality digital experience.

Like this post share it with your friends
Ecommerce Monitoring

5 reasons why ecommerce monitoring is so important

No website is free from technical issues. In fact, chances are, your customers faced a glitch in the past 24 hours. This is due to the issues like poor coding, incompatible browser and delays in loading at a location. If such issues go unnoticed for a long time they can damage your sales and reputation. We’ll show how you can use Synthetic Monitoring to overcome these challenges.

use synthetic monitoring for customers shopping online

Want a flawless ecommerce website? Use Synthetic Monitoring

No website is free from technical issues. In fact, chances are, your customers faced a glitch in the past 24 hours. This is due to the issues like poor coding, incompatible browser and delays in loading at a location. If such issues go unnoticed for a long time they can damage your sales and reputation. We’ll show how you can use Synthetic Monitoring to overcome these challenges.

Discover how Selenium helps in performance monitoring to take proactive measures against bad user experience

LIKE THIS POST SHARE IT WITH YOUR FRIENDS

Glitch

What is synthetic testing?

Users demand Google-like response time that pushes companies to monitor the performance and availability of their applications continually. Accomplishing a comprehensive view of your applications requires the integration of multiple approaches and instrumentation after a release. One of the approach adopted by various sector like ecommerce, health,and banking is synthetic testing.

Synthetic testing that uses distributed test engines to dedicatedly test performance and availability of your web applications and sites remotely – even when there is no traffic. Simply deploy the scripts onto a web browser to simulate the path a real customer takes through a website. The transaction scripts or workflow test are created in advance and then uploaded to the cloud  to run it after a the new code has been released into production.

Glitch

Top 5 reasons to use synthetic testing

When and why should you use Synthetic Testing, here are the top five reasons to use Synthetic Testing for your web application –

Measure SLA’s

SLA could be critical when an application has a number of third parties to host. Synthetic testing helps in making informed decisions backed up by numbers be it about performance, or stability, thereby maintaining transparency. It also helps in validating performance to ensure consistent delivery of third party services before committing an SLA thereby providing best of services to your customers.

Monitoring Web application during Peak and off traffic periods

The application these days are not standalone there are number of components interface, web services, protocols, etc., as a service provider, how could you be assured all of these components work perfectly fine when integrated? That’s when Synthetic Testing comes in handy, as it helps in measuring application performance 24*7 from every node/point and alerts the IT team about the issues found, that may affect the customer. Synthetic testing helps in exploring the production environment of your app/infrastructure Interestingly, the testing could be simulated and scheduled for different regions and period like low traffic zone or during a high traffic period.  

Benchmark Trends across Geographies

Once you have the data and trends you captured in one region, you could extend the same test to different areas, by monitoring the key transactions, geographies and extend validation to multiple devices and browsers.

The data collected would also help you streamlining your SLA, as you would know the[nearly] accurate time and measures are taken to rectify a particular problem.

Test business-to-business web services

Synthetic Testing helps businesses to test web services that use SOAP, REST or other web technologies. While these webservices help in building a communication with upstream and downstream, it also helps in reusing the existing web services for multiple workflows. So when one business service uses customer name to retrieve customer id, the same could also be used to get its details.

How does it complement real user monitoring to deliver better performance

While Synthetic monitoring helps in getting answers to queries like –

  1.       Is my web application up and running?
  2.       Is the transaction working smoothly?
  3.       How fast is my application?
  4.       Is there a failure or connectivity issue?
  5.       Are my upstream and downstream system well connected?
  6.       What is the performance of my website?

It might not be able to answer questions like –

  1.       The experience/issues end-user is facing
  2.       Geographical problems or browser issue not included in the synthetic test plan
  3.       End-user actions while browsing or exploring the website
  4.       The actual workflow took by the end user

This is where Real User Monitoring or RUM comes into the picture. RUM approach provides you an insight into how an end user interacts with your web application. Synthetic testing, on the other hand, offers the insight to “expected” user experience, so combining the power of two one could get a complete view of the user experience. Utilizing both approaches could help you in getting rid of blind spots and enhancing the user experience by providing –

  1.       Transparency
  2.       Reducing MTTR
  3.       Understanding business workflow from an end-user perspective

Some tips on how to select the best synthetic testing tool

  1. A synthetic monitoring tool should be easy in use, so if you do not want to spend time in scripting look for record and playback tool or if you are comfortable with scripting you can explore tools that allow you to code.
  2. The monitoring tool should support working with complex web functionalities.
  3. The tool should allow users to expand their testing scripts, i.e., adding more steps or an easy way to create complex workflows.
  4. The tool should have reusability feature where testing scripts could be recalled whenever a new business workflow needs them like login, logout, etc.
  5. Ability to test all data-driven test cases
  6. Capable of reducing false positives as issues arise from server maintenance, glitches, sparse coding, etc
  7. Able to minimize overheads like retesting for any false alerts.
  8. The tool should perform evenly across locations thereby measuring latency and load issues
  9. A synthetic monitoring tool should be capable of alerting using services like SMS or email.
  10. With users now accessing web application via multiple devices, a tool that allows you to expand testing across devices and browsers comes in handy.

Summary

The web is filled with complications and you need to watch it round the clock, make sure the users have a glitch-free and delightful digital experience. A well-defined test strategy combined with the well-designed synthetic tool could help you in achieving expected performance and removing bottlenecks.

Talk to our Test Engineers

Fast track your ecommerce monitoring

RECENT POSTS

Glitch

What is synthetic testing?

Your website can misbehave anytime. Learn how you can use synthetic testing to watch if performance is low and correct it on-time so that your users are not affected.

Synthetic Monitoring tools

Synthetic Monitoring – why & when to use it

Website monitoring has advanced from checking for web page availability to analysing real user journeys through a website. Learn if synthetic monitoring is the right fit for you to maintain a quality digital experience.

Like this post share it with your friends
Ecommerce Monitoring

5 reasons why ecommerce monitoring is so important

No website is free from technical issues. In fact, chances are, your customers faced a glitch in the past 24 hours. This is due to the issues like poor coding, incompatible browser and delays in loading at a location. If such issues go unnoticed for a long time they can damage your sales and reputation. We’ll show how you can use Synthetic Monitoring to overcome these challenges.

use synthetic monitoring for customers shopping online

Want a flawless ecommerce website? Use Synthetic Monitoring

No website is free from technical issues. In fact, chances are, your customers faced a glitch in the past 24 hours. This is due to the issues like poor coding, incompatible browser and delays in loading at a location. If such issues go unnoticed for a long time they can damage your sales and reputation. We’ll show how you can use Synthetic Monitoring to overcome these challenges.

LIKE THIS POST SHARE IT WITH YOUR FRIENDS

Dynatrace-vs-CloudQA

Dynatrace vs. CloudQA TruMonitor Synthetic Monitoring Tools Comparison

Most website description of the tools only add to confusion and you can lose a ton of time if you pick a tool that doesn’t match your expectations. So, before you put all your faith the in the most popular synthetic monitoring tools it is better to question whether they are really worth your time.
In this article we’ll compare Dynatrace synthetic monitoring which one of the popular options and CloudQA TruMonitor which brings promising features that pack a punch. Staring with a short  introduction for both synthetic monitoring tools and then a juxtaposition of most relevant features for an in-depth tool comparison.

HubSpot claims, if the site brings in $100,000 / day in revenues, 1 sec page improvement will bring in extra $7,000. That’s how much a second is worth; it can mean a 7% increase or decrease in your revenues.

Dynatrace-vs-CloudQA

Dynatrace – Synthetic Monitoring:

Short synopsis: Dynatrace is an Application Performance Management (APM) software that runs for on-premise and cloud applications. Dynatrace – Synthetic Monitoring is one of its performance analysis tools.

How does it work: Record and playback tool for creation of monitoring scenarios.

Standout features: Monitoring for multiple locations in a single execution.

Challenges: Basic record and playback tool to build monitoring scenarios.

Pros: Global coverage, rich dashboard and detailed reporting.

Cons:  Doesn’t work on complex web applications like Single Page Application, no provision to edit a scenario after being created and high costs.

Bottomline: Dynatrace – Synthetic Monitoring tool is useful ONLY for very basic monitoring and can be very costly to operate.

CloudQA TruMonitor:

Short synopsis: CloudQA is a cloud based web testing and performance analysis platform. TruMonitor is a synthetic monitoring tool by CloudQA.

How does it work: Record and playback tool for creation of monitoring scenarios.

Standout features: Powerful recorder and agility in management.

Challenges: There is no out of the box APM but CloudQA works well with 3rd party APM tools from Google (name of the tool) & NewRelic.

Pros: Very easy to setup and use. Works with even the most complex web applications and is cost effective.

Cons: Geographical monitoring from XX locations compared to YY offered by Dynatrace

Bottomline: TruMonitor is the easiest and the most effective synthetic monitoring solution available in the market.  

Side by side feature comparison:

CategoryFeatureDynatrace – Synthetic MonitoringCloudQA – TruMonitor
CreationRecording ScenariosBasic recording of user actionsAdvanced recording of user actions with support for assertions and hovers
MonitoringBrowsersReal browser supportReal browser support
Location Based MonitoringMonitor multiple locations around the world Simultaneous monitoring of same scenarios across multiple regionsMonitor multiple locations around the world
ComplexitiesSupports basic web applicationsMonitor complex web applications like Single Page Application
MaintenanceEditing ScenariosOnly addition of validation and editing CSSPerform complex actions- Adding scripts, store variables, random variables, alerts, waits etc
3rd Party IntegrationsOut-of-the-box integrations with popular toolsOut-of-the-box integrations with popular tools
Scheduling FrequencyChoice of 5, 10, and 15, 30 and 60 minute frequenciesChoice of 5, 10, and 15, 30 and 60 minute frequencies
ReliabilityFalse Positive ResistanceBased on deviation from historical baseline metricRetrial of monitoring, automatic waits and robust CSS selectors
ReportingDashboardCan create and share custom dashboardBasic dashboard
Performance MetricsAvailability, uptime, full loaded time, network time, client time, server time, and resource timings.Availability, uptime, full loaded time, network time, client time, server time, and resource timings.
Performance Analysis– Line graphs, pie charts and histograms based date and time series analysis of Load times for URLs, and User actions
– Interactive graphs with user action and URL filters
– Run trends for status on application glitches while monitoring a scenario
– Drill-down for glitches with screenshots
– Other graphs
– Line graphs and histograms based date and time series analysis of Load times for URLs, and User actions
– Interactive graphs with user action and URL filters
– Run trends for status on application glitches while monitoring a scenario
– Drill-down for glitches with screenshots
Alerts and NotificationEmail, Dynatrace mobile app and custom integrations like Slack, PagerDuty and JIRASMS, email, and custom integrations like Slack, PagerDuty and JIRA
Competitive BenchmarkingUsing Apdex ratingsOn request
OtherSupport (Basic Subscription)– Product onboarding
– Live chat
– 8 Hours / 5 Working Days available
– Product onboarding
– Dedicated Support Assistant
– Live chat
– 8 Hours / 5 Working Days available
InfrastructureOn premise and CloudOn premise and Cloud
Price$ 0.35 per 25 runs$ 0.14 per 25 runs

Summary

With growing performance expectations and web complexities, synthetic monitoring is indispensable for companies who want to stay ahead of the competition. Unlike other monitoring tools, TruMonitor offers a comprehensive solution for analysis of user journey; even on complex web applications. Contact us to learn more on how you can leverage synthetic monitoring to become proactive in delivering quality digital experience.

Talk to our Test Engineers

Fast track your ecommerce monitoring

RECENT POSTS

Glitch

What is synthetic testing?

Your website can misbehave anytime. Learn how you can use synthetic testing to watch if performance is low and correct it on-time so that your users are not affected.

Synthetic Monitoring tools

Synthetic Monitoring – why & when to use it

Website monitoring has advanced from checking for web page availability to analysing real user journeys through a website. Learn if synthetic monitoring is the right fit for you to maintain a quality digital experience.

Like this post share it with your friends
Ecommerce Monitoring

5 reasons why ecommerce monitoring is so important

No website is free from technical issues. In fact, chances are, your customers faced a glitch in the past 24 hours. This is due to the issues like poor coding, incompatible browser and delays in loading at a location. If such issues go unnoticed for a long time they can damage your sales and reputation. We’ll show how you can use Synthetic Monitoring to overcome these challenges.

use synthetic monitoring for customers shopping online

Want a flawless ecommerce website? Use Synthetic Monitoring

No website is free from technical issues. In fact, chances are, your customers faced a glitch in the past 24 hours. This is due to the issues like poor coding, incompatible browser and delays in loading at a location. If such issues go unnoticed for a long time they can damage your sales and reputation. We’ll show how you can use Synthetic Monitoring to overcome these challenges.

LIKE THIS POST SHARE IT WITH YOUR FRIENDS

Synthetic Monitoring tools

Synthetic Monitoring - why & when to use it

Introduction

A bad digital experience can be very costly. On an average, the cost to acquire an online visitor is around $5 and while only a 3% of them actually convert, any performance issues can burn a big hole in your pocket. But how can you set a benchmark for a quality digital experience?

According to industry experts, your website / application should be glitch free to begin with and all web pages should load within 3 seconds.

HubSpot claims, if the site brings in $100,000 / day in revenues, a 1 second page improvement will bring in extra $7,000. That’s how much a second is worth; it can mean a 7% increase or decrease in your revenues.

Though upholding performance at a benchmark is difficult, monitoring them to take proactive actions can be easy. But performance monitoring yields results only if you choose the right tool. This is because most monitoring tools offer some basic features like pinging URLs to check availability and load time. Moreover, it is different from how a real user would behave on your website. So, why would you use a monitoring tool that doesn’t tell you anything about the user journey?

The only way you can analyze whether a user journey meets the customer expectations is by using a Synthetic Monitoring tool. It is used to monitor critical user journeys on a website and warn developers in case something doesn’t work or perform as expected. If you’re not familiar with Synthetic Monitoring, this article will help you learn about it in-depth.

Synthetic Monitoring tools

What is Synthetic Monitoring

Synthetic monitoring (also known as active monitoring or proactive monitoring) is web application monitoring that is done using a Web browser emulation or scripted recordings of web transactions regardless of whether or not users are currently visiting your site. Synthetic monitoring tools are used to identify and resolve web application performance and availability issues from different geographical locations worldwide.

When and why is Synthetic Monitoring needed

  • Synthetic monitoring is useful to check your site’s availability and end-to-end performance 24/7  from the end-user perspective. Synthetic monitoring predicts, to a fair degree of accuracy, how your application will perform in which geographies and isolate the root cause of any detected bottlenecks. Synthetic monitoring prevented or pre-empted  95 to 99 percent of previous performance issues for most of our customers.
 
  • To provide rich customer experiences, websites and applications increasingly depend on 3rd parties such as shopping carts, ads, customer reviews, web analytics, social networking, SEO, video, and more. In fact, retailers around the globe increased the number of 3rd parties by 21% in 2015, from an average of 25 to 30 3rd parties.These third parties help increase traffic, conversions, and improve customer satisfaction, but any one of them could weaken your site’s overall performance or even take it down. While SLAs may let you point the finger, from the end-user point of view, you’re the one who’s accountable. Using synthetic monitoring, you can evaluate components via pre-production testing for proof of concept and load testing based upon what you expect during high-traffic periods.
 
  • To objectively measure your own service level agreements (SLAs) and also your third party service provider’s. When your site is not functional, loading so slow and timing out that customers go elsewhere, then your site becomes unreliable. Imagine if this happens at a business-critical moment such as cyber Monday or during a major news event, this will impact your entire year negatively. Continuous testing and synthetic monitoring are the best possible ways to ensure your web applications are reliable. No application is immune from performance issues. Complex infrastructure and integrations that support web application delivery in today’s world makes it even more vulnerable. You can get ahead of any problems and preserve your customer experience by taking a top down approach and having visibility into how your application is performing and all of the factors that affect that performance.
 
  • To measure, baseline and analyze performance trends of your application across different geographies, browsers and resolutions. If you don’t track and baseline your performance during normal operations, you won’t know how your applications are performing for your end-users during peak periods. Synthetic monitoring enables a consistent, reliable approach to measure performance throughout the days, weeks or months. With synthetic monitoring, baseline tests can mirror the way your end users access your applications. These simulated user tests can monitor key transactions across geographies, browsers, and devices. Armed with this data, you can assess whether you are meeting user requirements, identify areas to improve, and use the data for capacity planning. Established baseline metrics from synthetic monitoring will give you concrete data to support negotiations and to monitor going forward before entering an SLA.
 
  • To track and benchmark your application performance versus the competitors. Benchmarking using synthetic monitoring provides valuable insight into how market leaders and the competition are performing. It also provides a context for shared goal-setting between IT and business stakeholders to improve business results, and as a tool for measuring performance over time.

What Synthetic Monitoring will not do

  • Resolve end user complaints. Synthetic Monitoring would tell nothing about what the end user was actually doing or experiencing when a real user raises a support ticket.
 
  • Troubleshoot servers and network problems. Operation team may need visibility into servers and network related problems. Synthetic monitoring does not provide this visibility.
 
  • Determine how server or network performance affect application performance. Under resourced network or servers impact application performance. Synthetic monitoring is not a good solution to identify root cause is such cases.
 
  • Analyze the performance of every page in an application. Creating and maintaining scripts for synthetic testing is time-consuming, even for one application. It should be judiciously used for monitoring only critical flows of an application
 
  • Validate the impact of change because of change in application or infrastructure. When IT team makes changes to applications or infrastructure, they must validate the impact of those changes on actual end user experience to determine the impact. Comparing metrics from synthetic testing won’t provide the full picture.
evaluate synthetic monitoring tools

How to evaluate Synthetic Monitoring tools

  • Creating monitoring scenarios:
    • It should be as easy as navigating the website like real users. The best way to do that is to use a record & playback tool which captures user-like actions and starts monitoring them. Not all monitoring tools offer record & playback. A few website monitoring tools like CloudQA and Dynatrace have this capability while some of the popular tools like Pingdom requires you to code for synthetic monitoring.  
    • Due to ever increasing complexities of modern web applications, synthetic monitoring tools should be able work on websites with technologies like single page applications. If the monitoring tool does not support working with complex web functionalities, the scope for catching performance issues is severely narrowed.
    • Once a scenarios is created for monitoring, a Synthetic Monitoring tools should provide an easy way to extend it. If such feature is not available then any incomplete scenarios can frustrate the tester working with the monitoring tool.
 
  • Management of monitoring scenarios
    • Agile methods bring frequent updates to the application. Hence, any synthetic monitoring tool should allow modification of scenarios that are as agile as as the application development process.
    • Websites usually have many workflows; however, there are some common scenarios like Login, Logout and Payment. Synthetic monitoring tools should allow joining separate scenarios to create a new one; thereby, reducing a lot of effort in creating new scenarios. Hence, a monitoring tool should contain a library of scenarios which can be tested collectively and interchangeably.
 
  • Data driven monitoring
    • No monitoring is complete without verifying all possible combinations of data inputs. For example, a website may have calendar settings/filter. In such case synthetic monitoring tools should be able to verify performance with alternating ‘Date’ inputs. The same can be said about other variations like a ‘Filter and Sort’ option on the website.
 
  • Minimize false positives
    • False positives are one of the most annoying thing about website monitoring. They however cannot be escaped. Issues arise from server maintenance, glitches, poor coding and  problems with the CDN. Synthetic monitoring tools should be capable of reducing false positives.
    • A well designed synthetic monitoring tool reduces overheads like retesting for any false alerts.
    • Only a handful of  synthetic monitoring tools are resistant to unexpected behavior of an application. For example, web elements of apps developed using AngularJS are dynamic and load  unpredictably. In such cases, an element loading slower than the speed of detection by a monitoring tool can misfire an alert.
 
  • Location based monitoring
    • Latency could be higher from certain location/s from where your customers access the website. Monitoring from different geographic locations is a way to see how the application performs with latency and load issues.
 
  • Alerts & Notification
    • Synthetic monitoring tools should offer an alerting mechanism  for situations where the desired performance goes below an established threshold . You should check whether the alerting tool of your choice integrates easily with your technology stack. Bare minimum requirements for monitoring alerts are SMS, and email. Integrations with popular tools like Slack and Pagerduty are also sought-after.
 
  • Reports
    • Baselining is an important feature for comparing current performance to a historical metric, or a baseline. The performance figures can be used as a comparative baseline for configuration changes.
    • Reports from a synthetic monitoring tool must include performance metrics for availability, uptime, full loaded time, network time, client time, server time, and resource timings.
    • Data retention is variable for monitoring tools. The retention offered is generally 6 months or 1 year.
 
  • Other criteria
    • Synthetic monitoring is not readily available with most APM tools. An integration with APM tools is desirable in such cases.  
    • AI / ML can be an important feature to reduce false alerts, prioritise problems and for prediction of issues.
    • Few synthetic monitoring tools offer mobile browser support. This is important for businesses having sizeable web traffic through smartphones and tablets.
    • To see how the application behaves with different bandwidths, a bandwidth throttling support is essential.  

Where does TruMonitor excel

If you are an ONLINE INSURANCE company
When someone is trying to buy an insurance online, the personal data like date of birth, gender,  location, etc are deciding factors for premium calculation. To get a true sense of how your application behaves for a true user, you should have the ability to monitor & measure your application performance with multiple data sets. TruMonitor is the only tool that makes multi-dataset monitoring possible and extremely easy to setup. With other tools, you are forced to a use single data set to monitor an insurance purchase journey and you will never be close to truly measuring your end user’s experience. Having different monitors for each data set is not a very good option from maintenance perspective. Imagine if you have a synthetic monitoring solution that could solve both these problems by using data as a variable executing one single script. That actually will give a very good idea of how your application is perceived by different types of end users.

If you are an E-COMMERCE company
When someone is buying a phone from an eCommerce site, they would look for product description, price, color and other important attributes of a product. Most synthetic monitoring solutions will not allow you to verify different types of elements like images, links, buttons etc on a page which your end user would need. With TruMonitor you can verify all types of elements on page and also add custom scripts for complex logical verifications.

If you are an ONLINE BOOKING company
Usually flights and hotels are booked by providing a date of travel or date of check-in. You record a script in June 2018 picking July 2018 travel and check-in dates. If you use the same recorded script for synthetic monitoring continuously it will start breaking after the chosen dates. The reason being calendar will start showing up differently from August 2018. Unlike other monitoring solutions which either do not offer this capability or have a flaky approach for addressing dynamic dates, CloudQA provides you an option to work with  dynamic dates f which would never break.

If you have an AGILE APPLICATION ENVIRONMENT
Online e-commerce can be very competitive and companies constantly have tweak their application to improve user experience. For example,  in an eCommerce purchase, let’s say you had a dropdown to display cities based on a state for a user to select. To improve this process you change the dropdown to an auto suggest text box. With other monitoring tools all your synthetic monitoring critical workflows would have to be discarded and created from scratch. With CloudQA, you have the flexibility of deleting the dropdown stop and add step to type into an auto suggest text box by just click of a button.

If your web application has EXTERNAL DEPENDENCIES (API’s)
While purchasing a product on eCommerce website, one would have to go through a delivery process by providing zip code and in most cases delivery is done by a third party service provider. Generally, third party providers use APIs for verifying if they can deliver to the specified zip code. With CloudQA, you can combine web application flows with API invocation into one single script and monitor them together make it a smooth process.

Support for MODERN WEB APPLICATIONS
Modern web applications are complex and beyond the capability of a basic synthetic monitoring tools. For example, web application based on AngularJS are difficult to monitor because their of dynamic web element loading capabilities. TruMonitor has robust engine which can handle such complex interactions.

Support for NEWS / MEDIA APPLICATIONS
News and Media web pages are content heavy. Having a 5Mb web page is common among the leading media sites. And having third party scripts like ad for marketing can drag the performance further. TruMonitor helps you gather performance intelligence to help you optimize web page for any user behaviour.

TruMonitor Features:

 
CategoryFeatureCloudQA – TruMonitor
CreationRecording ScenariosAdvanced recording of user actions with support for assertions and hovers
MonitoringBrowsersReal browser support
Location Based MonitoringMonitor multiple locations around the world
ComplexitiesMonitor complex web applications like Single Page Application
MaintenanceEditing ScenariosPerform complex actions- Adding scripts, store variables, random variables, alerts, waits etc
3rd Party IntegrationsOut-of-the-box integrations with popular tools
Scheduling FrequencyChoice of 5, 10, and 15, 30 and 60 minute frequencies
ReliabilityFalse Positive ResistanceRetrial of monitoring, automatic waits and robust CSS selectors
ReportingDashboardBasic dashboard
Performance MetricsAvailability, uptime, full loaded time, network time, client time, server time, and resource timings.
Performance Analysis– Line graphs and histograms based date and time series analysis of Load times for URLs, and User actions
– Interactive graphs with user action and URL filters
– Run trends for status on application glitches while monitoring a scenario
– Drill-down for glitches with screenshots
Alerts and NotificationSMS, email, and custom integrations like Slack, PagerDuty and JIRA
Competitive BenchmarkingOn request
OtherSupport (Basic Subscription)– Product onboarding
– Dedicated Support Assistant
– Live chat
– 8 Hours / 5 Working Days available
InfrastructureOn premise and Cloud

Summary

With growing performance expectations and web complexities, synthetic monitoring is indispensable for companies who want to stay ahead of the competition. Unlike other synthetic monitoring tools, TruMonitor offers a comprehensive solution for analysis of user journey even on complex web applications. Contact us to learn more on how you can leverage synthetic monitoring to become proactive in delivering quality digital experience.

Talk to our Test Engineers

Fast track your ecommerce monitoring

RECENT POSTS

Glitch

What is synthetic testing?

Your website can misbehave anytime. Learn how you can use synthetic testing to watch if performance is low and correct it on-time so that your users are not affected.

Synthetic Monitoring tools

Synthetic Monitoring – why & when to use it

Website monitoring has advanced from checking for web page availability to analysing real user journeys through a website. Learn if synthetic monitoring is the right fit for you to maintain a quality digital experience.

Like this post share it with your friends
Ecommerce Monitoring

5 reasons why ecommerce monitoring is so important

No website is free from technical issues. In fact, chances are, your customers faced a glitch in the past 24 hours. This is due to the issues like poor coding, incompatible browser and delays in loading at a location. If such issues go unnoticed for a long time they can damage your sales and reputation. We’ll show how you can use Synthetic Monitoring to overcome these challenges.

use synthetic monitoring for customers shopping online

Want a flawless ecommerce website? Use Synthetic Monitoring

No website is free from technical issues. In fact, chances are, your customers faced a glitch in the past 24 hours. This is due to the issues like poor coding, incompatible browser and delays in loading at a location. If such issues go unnoticed for a long time they can damage your sales and reputation. We’ll show how you can use Synthetic Monitoring to overcome these challenges.

LIKE THIS POST SHARE IT WITH YOUR FRIENDS

Like this post share it with your friends
TOP