Skip to main content

Testinium Run Test Plan

The Testinium Run Test Plan step integrates the Testinium testing platform into Appcircle's CI/CD workflow, allowing for automated testing of mobile applications directly within the Appcircle environment. This step enables developers to execute the test plan, analyze test outcomes, and verify the quality of their mobile apps before deployment.

Prerequisites

Before running the Testinium Run Test Plan step, you must complete certain prerequisites, as detailed in the table below:

Enterprise IP Whitelisting Requirements for Testinium

If you are using Testinium as an enterprise, you need to whitelist the IPs listed in the document below on the Testinium platform you are using:

Prerequisite Workflow StepDescription
Testinium Upload AppRequired to upload your application to Testinium before executing test plans with the Testinium Run Test Plan step.
tip

After using the Testinium Upload App step once, you can add multiple Testinium Run Test Plan steps to the workflow for each test plan.

Screenshot

Input Variables

This step contains some input variable(s). It needs these variable(s) to work. The table below gives explanation for this variable(s).

Screenshot
Sensitive Variables

Please do not use sensitive variables such as Username, Password, API Key, or Personal Access Key directly within the step.

We recommend using Environment Variables groups for such sensitive variables.

Variable NameDescriptionStatus
$AC_TESTINIUM_USERNAMESpecifies the Testinium username used for logging in.Required
$AC_TESTINIUM_PASSWORDSpecifies the Testinium password used for logging in.Required
$AC_TESTINIUM_PLAN_IDSpecifies the Testinium plan ID. This ID must be obtained from the Testinium platform.Required
$AC_TESTINIUM_ENTERPRISE_BASE_URLThe base URL for Testinium enterprise. This is required if you are using Testinium enterprise. Only for Testinium cloud users is this input not mandatory.Optional
$AC_TESTINIUM_COMPANY_IDSpecifies the Testinium company ID. This ID must be obtained from the Testinium platform.Required
$AC_TESTINIUM_MAX_FAIL_PERCENTAGESpecifies the maximum failure percentage limit to interrupt the workflow. It must be in the range 0-100. Selecting 0 means failures will not interrupt the workflow.Optional
$AC_TESTINIUM_TIMEOUTSpecifies the Testinium plan timeout in minutes.Required
$AC_TESTINIUM_MAX_API_RETRY_COUNTSpecifies the maximum retry in case of Testinium platform congestion or API errors.Required
$AC_TESTINIUM_UPLOADED_APP_IDThe unique identifier for the application was uploaded to Testinium. This ID is generated after the Testinium App Upload step.Required
$AC_TESTINIUM_APP_OSThe operating system of the uploaded application, either iOS or Android. This value is determined after the Testinium App Upload step.Required

Output Variables

The output(s) resulting from the operation of this component are as follows:

Screenshot
Variable NameDescription
AC_TESTINIUM_TEST_REPORTThe file path of the test report generated by Testinium after running the plan.
AC_TESTINIUM_RESULT_FAILURE_SUMMARYTotal number of failures in the test results.
AC_TESTINIUM_RESULT_ERROR_SUMMARYTotal number of errors in the test results.
AC_TESTINIUM_RESULT_SUCCESS_SUMMARYTotal number of successes in the test results.

To access the source code of this component, please use the following link:

Preview of GitHub - appcircleio/appcircle-testinium-run-test-plan-component: Testinium Plan Runner component for executing test plans on Testinium after uploading an application.