Automated testing

This topic defines parameters used for importing results of automated tests (thereby enabling tracking of those results).

Test Case type

Defines which of the configured Work Item types corresponds to a test case.

(Work Item Types are configured in Administration Work Items Enumerations.)

Default Test Run template

Defines which Test Run to use as a template for creating new Test Runs when importing results of automated tests. (May be overridden in a job or build configuration.) Enter the ID of an existing Test Run from the current project.

Default Test Case template

Defines which Work Item to use as a template for creating new Test Case Work Items while importing results of automated tests. (May be overridden in job or build configuration.) Enter the ID of a Work Item from current project or projectID/workItemID for Work Items from other project.

Custom field for Test Case ID

Defines which string-type Custom Field (of Test Case type Work Items) to use for storing the ID string of an automated test, the results of which are being imported. It is needed for subsequent imports of the tests in order to recognize Test Case type Work Items created by previous import(s). The value for Java JUnit tests is the name of a specific test class and method.

(Work Item Types are configured in Administration Work Items Custom Fields.)

Create Summary Defect item

Defines the conditions under which a single defect Work Item, referred to as a summary defect, is created and linked to a Test Run instead of multiple defect items, one for each failed Test Case. It is useful for situations when automated tests fail because of some environmental problem not directly related to the concrete Test Cases, which causes many test failures.

Map results of automated test to Enumerations

This section allows mapping of automated test results to configured Test Record Result and Test Run Status values in Polarion.

(Administration Testing Test Results)

This configuration also specifies for which Test Result(s) a linked Defect item should be created.

Before configuring this mapping, you need to configure the two enumerations: Test Run Statuses and Test Results, in the corresponding administration topics under Testing.

Note:

When there are multiple types of test results, the Test Run status will be mapped as follows:

  • If there are any errors, the Error status will be set.

  • If there are any failures (and no errors), the Failed status will be set.

  • Otherwise, the Passed status will be set.