Managing data sets
Data sets are defined to identify the types of tests that you run in your development process to define the passing criteria for an application. When you define rules in a policy, IBM Cloud® DevOps Insights provides seven pre-defined data sets that you can use to run in your development process. Or, use custom data sets to represent the various types of tests. You can have policy rules for each data set and define rules for custom data sets. Separate policies can be created for each application. Data sets appear on the Quality Dashboard page after you start populating data for the data set.
For more information about viewing the Quality Dashboard, see DevOps data aggregation.
For more information about defining a policy, see Defining policies and rules.
Viewing data sets
View your current data sets by browsing your Quality Dashboard page. You can rearrange your data in the table to be in a more convenient order. To view your data sets, use the following steps:
- From the IBM Cloud console, click the Menu icon > Platform Automation > Toolchains.
- On the Toolchains page, select your toolchain.
- From your toolchain's Overview page, on the IBM Cloud tools card, click DevOps Insights.
- Select Quality Dashboard.
- Click the Overflow icon > Configure data set.
Adding predefined data sets
To add a data set to the application's test, use the following steps:
- Click the Menu icon > Platform Automation > Toolchains.
- On the Toolchains page, select your toolchain.
- From your toolchain's Overview page, on the IBM Cloud tools card, click DevOps Insights.
- Click Quality Dashboard.
- Click the Overflow icon > Configure data set.
- Click Add Quality Data Set.
- Select Predefined Quality Data Sets.
- Complete all required fields, and click Submit
The following are the seven pre-defined tags that are provided by DevOps Insights.
Pre-defined Data Set Tag | Display label | Data Type | Supported Data Formats |
---|---|---|---|
unittest |
Unit Tests | Test Case | JUnit (JSON), xUnit (xml), Mocha (JSON), KarmaMocha (JSON) |
code |
Code Coverage | Code Coverage | Cobertura (xml), lcov (info), JaCoCo (xml) |
fvt |
Functional Verification Tests | Test Case | JUnit (JSON), xUnit (xml), Mocha (JSON), KarmaMocha (JSON) |
sonarqube |
SonarQube | SonarQube | SonarQube |
dynamicsecurityscan |
Dynamic Security Scan | Dynamic Security Scan | IBM Cloud® Application Security (xml) |
staticsecurityscan |
Static Security Scan | Static Security Scan | IBM Cloud® Application Security (xml) |
vulnerabilityadvisor |
Vulnerability Advisor | Vulnerability Advisor | Vulnerability Advisor (JSON) |
Adding custom data sets
You can add your own custom data sets. Custom data sets support JUnit or XUnit, Mocha, Cobertura, lcov, and JaCoCo. To add custom data sets, use the following steps:
- Click the Menu icon > Platform Automation > Toolchains.
- On the Toolchains page, select your toolchain.
- From your toolchain's Overview page, on the IBM Cloud tools card, click DevOps Insights.
- Click Quality Dashboard.
- Click the Overflow icon > Configure data set.
- Click Add Quality Data Set.
- Select Custom Quality Data Sets.
- Complete all required fields, and click Submit
If a custom data set is deleted, any test results for that custom data set are deleted. For more information about deleting data sets, see Deleting your DevOps Insights data.