Pricing
Automated Testing
Help Documents menu

Automated Testing

Updated on: 2024-05-11 14:18

   The overall flow of automation testing is shown in the figure below. This module mainly provides the ability of automation task creation, task execution and report generation.
image.png

(1) Import automation script

   After completing the scripting, package your local scripts into a zip format and upload the file to the UDT project.

  • Click Automated Testing>Test Cases to go to the page.
    image.png
  • Click the Import Test Case Library button to create a new test case.
    image.png
  • Select Upload local zip file, upload the script file.
    image.png
  • You may also be able to import test cases via the git repository.
    image.png

(2) Create Task

  • Click Automation>Task Management to go to the page.
    image.png
       The current page shows a list of all the tasks that have been created, where you can see the task name, creator, test framework, last execution time, last test ID, etc.

2.1 Create a new test task

  • Click New Task button to enter the task creation page and complete the task creation.
    image.png

2.2 Application Selection

   First of all, choose the type of test you need. You can choose Android or iOS system devices to test your application, and then click the button to select an application or upload a new one from local.
image.png
   After clicking the button, you can see the app management pop-up. Select an app or upload a new one.
image.png

2.3 Resource Allocation

   Select test case, test devices, test Account and configure custom parameters.
   Script dependency environment:Choose the script dependency environment, you can choose Python, WeAumatour, Appium or Airtest.
image.png
   Test Case Library:Select the test case library for this test.
   You can go to the test cases page and add a new use case library through git hosting or script uploading.
image.png
   Select Test Case:Select the test case for this test.
   You can select all the cases or specify the test cases to be tested.
image.png
image.png
   Choose Devices: Select the device to be tested this time.
image.png
Select the device pool and specific devices you want to test, then click the confirm buuton.
image.png
image.png

Test Account:
   if you have test account file, you can click it to upload.
image.png
Custom parameters:This is an optional field and is empty by default. The custom parameters are stored as environment variables during the test run and can be retrieved by the user in the test script via the EXTRA_INFO. variable.
image.png
   Custom parameters:This is an optional field and is empty by default. The custom parameters are stored as environment variables during the test run and can be retrieved by the user in the test script via the EXTRA_INFO. variable.
image.png
Test Execution Configuration
   You can configure how tasks are executed, such as whether to automatically pull up the application, execution timeout, etc.
   You have two options to choose Execution Mode:
   Sequential Execution: All test cases are executed sequentially on each device.
   Distributed Execution: Evenly distributed by device, executed once per test case.
image.png
image.png
   Depending on your test scenario, choose whether or not to enable the following features.
image.png
   After configuring all the parameters, click the Create New Task button.

(3)Task execution

   Click Automation>Tasks to enter the page.
   The current page displays a list of tasks that have been created. Contains: task name, creator, test framework information, last execution time and test ID.
   Click on the Start up button to the right of the task to execute it.
image.png

(4)View Test Report

   Click Automation>Test Reports to view recent reports.
image.png
   By clicking on the record, you can view detailed test report.
image.png
   You can also check reports from tasks.
   Click the task name and choose the record to enter into the detailed test report.
image.png

image.png

4.1 Report Page

   A detailed test report is generated at the end of each Automated Testing. The report provides test details such as screenshots, logs, performance data, video and test files. We offer two ways to view the report: from the device or from the use case dimension.

  • Device Execution Summary
       The device dimension shows the information of the devices used in this test and the test results of the devices, you can click on the device name to view the execution information on the specific device.
    image.png
  • View by Test Case Dimension
      In the test case dimension, the list of use cases for this test is displayed, you can click test case name to view the execution information of specific use cases on the device.
    image.png

4.2 Device Details

On this page, you can see the test results for each device, including device activity, device screenshot, device video, performance data and device log and files.

  • Device Summary
    It shows the running test status of the test case on the current device.
    image.png
  • Device Information
    image.png
       If you need to debug this device, click on the Start button to open the remote debugging page for the device.
    image.png
  • Device State
       view all the device states and corresponding time during the execution of the device.
    image.png
  • Device Screenshots
       includes screenshots of the device testing process.
    image.png
  • Device Video
       Video of the device execution process. You can also download or share it to others.
    image.png
    image.png
  • Performance Data
       including CPU usage, memory, FPS, flow.
    image.png
  • Device Log
       log information can be viewed and queried on the page.
    image.png
  • Files
       Download test related files, such as log, performance data and video.
    image.png

4.3 Test Case Details

   Display test information in test case dimension, including test case information, device information, test case results (JSON), test case screenshots, test case video, performance data and test case log information.

  • Test Case Summary
       It shows the testing results of selected use cases on different devices.
    image.png
  • Test Case Information
    image.png
  • Device Information
       You can click the Start button to open the debug page for this device.
    image.png
  • Test Case Results(JSON)
    image.png
  • Screenshots
    image.png
  • Test Case Video
    image.png
  • Test Case Log
    image.png
  • Files
       Download test-related files
    image.png

(5)Other Task Management operations

5.1 Edit Automation Task

   On the Automated Test>tasks page, click the Edit button to go to the task edit page where you can update the task information.
image.png
   You can re-edit the task name, select a new test application, test cases and more.

5.2 Delete Automation Task

   Click on the Delete button to delete this task.
image.png

5.3 Clone Automation Task

   Click the Clone button to create a new task with the same configuration.
image.png
   Enter a task name to complete the task creation.
image.png