Quickstart

Testmo works with any test automation tool and framework to report your test results for test automation management. And it works with any workflow, whether you use CI/CD pipelines, a build server, or manually launch your automated tests. Integrating test automation with Testmo always works the same:

• Build your test suite with your favorite automation framework & tools

• Generate standard JUnit-style XML report files from your automation tool (examples)

• Submit results to Testmo with our cross-platform CLI tool

Your test results are automatically reported to Testmo for rich reporting and test automation tracking. See below for our quickstart guide to send your first test automation results to Testmo in minutes.

Run your tests & generate XML file

Simply build your automated tests with your favorite test automation tool and framework. Then run your tests and tell your automation tool to generate JUnit-style XML files, which has become a standard format to exchange test results between tools. This format is supported directly or indirectly by practically any automation tool.

➡️ We have many examples for all the popular test automation frameworks and tools.

Submit test results to Testmo

To submit your test results to Testmo, you simply use our cross-platform testmo CLI tool. The CLI tool is distributed as an NPM package and is easy to install on any system. Simply install our official @testmo/testmo-cli NPM package:

$ npm install -g @testmo/testmo-cli
$ testmo -h

Usage: testmo [options] [command]
[...]

We can now send the test results to Testmo. To do this, make sure to generate an API key in Testmo from your profile page. The API key is used to authenticate with Testmo to send the results. We can then use the testmo CLI tool so submit our results (note that we first set the TESTMO_TOKEN variable, which the tool expects):

Full example

$ export TESTMO_TOKEN=********
$ testmo automation:run:submit \
  --instance https://<your-name>.testmo.net \
  --project-id 1 \
  --name "Test run" \
  --source "unittests" \
  --results results/*.xml

Single line

If you run this example on a single command line, make sure to remove the backspaces:

$ export TESTMO_TOKEN=********
$ testmo automation:run:submit --instance https://<your-name>.testmo.net --project-id 1 --name "Test run" --source "unittests" --results results/*.xml

Windows

On Windows, the command line uses a slightly different syntax to set a variable:

> set TESTMO_TOKEN=********
> testmo automation:run:submit --instance https://<your-name>.testmo.net --project-id 1 --name "Test run" --source "unittests" --results results/*.xml

See command output

Collecting log files ..
Found 1 result file with a total of 855 tests
Created new automation run (ID: 254)
Created new thread (ID: 608)
Sending tests to Testmo ..
Uploading: [|||||||||||||||||||||||||] 100% | ETA: 0s | 855/855 tests
Successfully sent tests and completed run
Marked the run as completed  

That's it! 🎉 This will automatically analyze the XML result file, create a new test run in Testmo, submit all tests & results and mark the run as completed. There's no need to manually create any tests, map tests or IDs, or build any custom API code. Everything is handled automatically for you.

More resources & references

Now that you are familiar with submitting your test results to Testmo, you might also find the following additional examples, topics and references useful for more advanced workflows.

• Testmo automation overview

• Testmo automation concepts

• Integrating with CI/CD pipelines

• Testmo CLI guide and reference

• Automation tool examples