Notifications

1563 views

Description

When running ATF tests that have client-side steps that will envoke the client test runner, test steps will return 'Success' but the test may timeout or return failure.

Steps to Reproduce

Replication Steps:

  1. Navigate to: System UI > UI Pages, and click on "New".
  2. Input any name. Copy the following in the "Client script" field:

    for (var i = 0; i < 10000; i++)
    top.console.log("Hello ATF!");

  3. Click on "Submit".
  4. Navigate to: Automated Test Framework (ATF) > Tests and click on "New".
  5. Input any value for "Name" and click on "Save".
  6. Click on "Add Test Step", navigate to the "Form" category and select "Open an Existing Record".
  7. Set Table to "UI Page [sys_ui_page]" and Record to the UI page created in Steps 1-3 and click on"Submit".
  8. Click on"Add Test Step", navigate to "Form" category and select "Click a UI Action".
  9. Set Table to "UI Page [sys_ui_page]" and UI action to "Try It", then click on "Submit".
  10. Click on "Run Test", select "Start a new test runner" then click on "Run Test".

> Expected: Test should run to completion without issue.

> Observed: Test seems to run in the client test runner, but gets stuck with a full progress bar at "Finished test execution, reporting result".

In the browser console, the message "ReportUITestProgress.reportBatchResult: failed X time(s) to report batch result, http status 0, trying again" is reported repeatedly until the batch times out after 10 minutes
The test eventually ends in failure with output "The test timed out because the max execution time (600 seconds) was reached while executing steps 1 - 2"

Here is an example of the type of errors seen in the browser console:

Workaround

Turning off debug mode will allow ATF tests to pass that are encountering this issue.

  • Navigate to: Automated Test Framework -> Administration -> Properties
  • Under "Test Debugging Properties" uncheck the "Yes" checkbox for "Enables additional debugging functionality..."
  • Save the form.

This problem is currently under review. You can contact ServiceNow Technical Support or subscribe to this Known Error article by clicking the Subscribe button at the top right of this form to be notified when more information will become available.


Related Problem: PRB1378364

Seen In

SR - IntegrationHub - JIRA Service Desk Integration r2 - v2.0.7
SR - IRM - Audit Management - New York 2019 Q3
SR - IRM - GRC Profiles - Madrid 2019 Q2
SR - IRM - GRC Workbench - New York 2019 Q3
SR - IRM - PA Premium Integration - New York 2019 Q3
SR - IRM - Policy and Compliance - Madrid 2019 Q2
SR - IRM - Risk Management - New York 2019 Q3
SR - IRM - SIG Assessment Legacy - Madrid 2019 Q1
SR - IRM - SIG Questionnaire - New York 2019 Q3
SR - IRM - Vendor Risk Management - Madrid 2019 Q1
SR - ITOM - Cloud Management IBM Cloud Connector v1.0
SR - ITOM - Cloud Management Terraform Connector - v1.0
SR - ITOM - CMDB CI Class Models - 201907
SR - ITOM - CMDB CI Class Models - 201908
SR - ITOM - CMDB CI Class Models - 201909
SR - ITOM - Discovery and Service Mapping - 201908
SR - ITOM - Discovery and Service Mapping - v1.0.35
SR - Security - Integration Framework - Madrid 2019 Q2
SR - Security - Support Common - Madrid 2019 Q2
SR - Security - Support Orchestration - Madrid 2019 Q2
SR - SIR - Security Incident Response - Madrid 2019 Q2
SR - SIR - Security Incident Response PA Content - New York 2019 Q3
SR - SIR - Security Incident Response UI Patch - London 2019 Q2 v.6.2.3
SR - SIR - Splunk Sighting Search Integration - Madrid 2019 Q1
SR - SIR - Store SecOps Setup Assistant - Madrid 2019 Q2
SR - SIR - Store Threat Core - Madrid 2019 Q2
SR - SIR - Store Trusted Security Circles Client - New York 2019 Q3
SR - SIR - Threat intelligence - New York 2019 Q3
SR - VR - Configuration Compliance - New York 2019 Q3
SR - VR - Qualys - New York 2019 Q3
SR - VR - Rapid7 - London 2019 Q2 v.6.2.1
SR - VR - Shodan Exploit - New York 2019 Q3
SR - VR - Solution Management Madrid Q2
SR - VR - Vulnerability Response - New York 2019 Q3
SR - VR - Vulnerability Response PA Content - Madrid 2019 Q2

Fixed In

Paris

Associated Community Threads

There is no data to report.

Article Information

Last Updated:2020-09-24 07:04:25
Published:2019-12-17