Testmo works with any test automation tool, including the popular TestNG unit testing framework for Java and other JVM-based languages. This quickstart guide provides an overview of how to report TestNG test automation results to Testmo.
TestNG comes with full support for generating JUnit-style XML files, which has become a standard format to exchange test results between tools. You can either run TestNG from the command line or as part of your build workflow. You can learn more in the TestNG documentation.
$ java org.testng.TestNG testng1.xml
testng1.xmlfile here specifies one of your TestNG suites. After executing your tests, TestNG will automatically generate JUnit-style XML report files in the
test-outputdirectory (if this is not the case, please make sure that the
org.testng.reporters.JUnitXMLReporterlistener is active).
To submit your test results to Testmo, you simply use our cross-platform
testmoCLI tool. The CLI tool is distributed as an NPM package and is easy to install on any system. Simply install our official
$ npm install -g @testmo/testmo-cli
$ testmo -h
Usage: testmo [options] [command]
We can now send the TestNG test results to Testmo. To do this, make sure to generate an API key in Testmo from your profile page. The API key is used to authenticate with Testmo to send the results. We can then use the
testmoCLI tool so submit our results (note that we first set the
TESTMO_TOKENvariable, which the tool expects):
$ export TESTMO_TOKEN=********
$ testmo automation:run:submit \
--instance https://<your-name>.testmo.net \
--project-id 1 \
--name 'TestNG test run' \
--source 'unittests' \
If you run this example on a single command line, make sure to remove the backspaces:
$ export TESTMO_TOKEN=********
$ testmo automation:run:submit --instance https://<your-name>.testmo.net --project-id 1 --name 'TestNG test run' --source 'unittests' --results test-output/**/*.xml
On Windows, the command line uses a slightly different syntax to set a variable:
> set TESTMO_TOKEN=********
> testmo automation:run:submit --instance https://<your-name>.testmo.net --project-id 1 --name 'TestNG test run' --source 'unittests' --results test-output/**/*.xml
That's it! 🎉 This will automatically analyze the XML result file, create a new test run in Testmo, submit all tests & results and mark the run as completed. There's no need to manually create any tests, map tests or IDs or build any custom API code. Everything is handled automatically for you.
In the above example, we first launched TestNG to generate the XML file and then used our CLI tool to submit the results in a second step. As an improvement to the above example, we can ask our CLI tool to launch TestNG (
testmothen starts and waits for TestNG to finish). This has the following additional benefits:
a) Capture full console output and send it to Testmo b) Accurately measure test times c) Record the TestNG exit code
Now that you are familiar with submitting your TestNG test results to Testmo, you might also find the following additional examples, topics and references useful for more advanced workflows.