Testmo Integrations
DocsIntegrationsREST APIBack to Testmo
  • Integrations
  • Major Tools
    • Jira
    • GitHub
    • GitLab
  • CI/CD
    • Azure Pipelines
    • Bitbucket
    • CircleCI
    • GitHub Actions
      • GitHub Jobs
    • GitLab CI/CD
      • GitLab Jobs
    • Jenkins
    • ➕Custom CI
  • Issue Trackers
    • Asana
    • Azure DevOps
    • ClickUp
    • GitHub Issues
    • GitLab Issues
    • Jira Cloud
    • Jira Server/DC
    • Linear
    • Monday.com
    • Redmine
    • Shortcut
    • Trac
    • Trello
    • YouTrack
    • ➕Custom Links
  • Automation
    • Appium
    • BrowserStack
    • Catch
    • Cucumber
    • Cypress
    • GoogleTest
    • Jasmine
    • Jest
    • JUnit
    • Minitest
    • Mocha / JavaScript
    • Nightwatch.js
    • NUnit
    • PHPUnit
    • Playwright
    • Postman
    • Pytest
    • Robot Framework
    • RSpec
    • Sauce Labs
    • Selenium
    • Testim
    • TestNG
    • WebdriverIO
    • XCTest / Xcode
    • xUnit.net
    • ➕More Tools
  • Enterprise auth
    • Azure & AD
    • Google
    • Okta
    • OneLogin
    • ➕Custom SAML
Powered by GitBook
On this page
  • Run Cucumber & generate XML file
  • Java, Ruby & Kotlin
  • JavaScript
  • Submit test results to Testmo
  • Bonus: Launch Cucumber with Testmo CLI
  • More resources & references

Was this helpful?

  1. Automation

Cucumber

PreviousCatchNextCypress

Last updated 2 years ago

Was this helpful?

Testmo works with any test automation tool, including the behavior-driven development (BDD) testing framework. This quickstart guide provides an overview of how to report Cucumber test automation results to Testmo to implement .

Run Cucumber & generate XML file

Cucumber comes with full support for generating JUnit-style XML files, which has become a standard format to exchange test results between tools. This works with all languages and platforms supported by Cucumber.

Java, Ruby & Kotlin

You can simply use the built-in junit formatter of Cucumber to generate the relevant XML files.

$ cucumber --format junit --out results/test-results.xml

JavaScript

$ npx cucumber-js --format=json | npx cucumber-junit > test-results.xml
$ npm install -g @testmo/testmo-cli
$ testmo -h

Usage: testmo [options] [command]
[...]
$ export TESTMO_TOKEN=********
$ testmo automation:run:submit \
  --instance https://<your-name>.testmo.net \
  --project-id 1 \
  --name "Cucumber test run" \
  --source "unittests" \
  --results results/*.xml

If you run this example on a single command line, make sure to remove the backspaces:

$ export TESTMO_TOKEN=********
$ testmo automation:run:submit --instance https://<your-name>.testmo.net --project-id 1 --name "Cucumber test run" --source "unittests" --results results/*.xml

On Windows, the command line uses a slightly different syntax to set a variable:

> set TESTMO_TOKEN=********
> testmo automation:run:submit --instance https://<your-name>.testmo.net --project-id 1 --name "Cucumber test run" --source "unittests" --results results/*.xml
See command output
Collecting log files ..
Found 1 result file with a total of 855 tests
Created new automation run (ID: 254)
Created new thread (ID: 608)
Sending tests to Testmo ..
Uploading: [|||||||||||||||||||||||||] 100% | ETA: 0s | 855/855 tests
Successfully sent tests and completed run
Marked the run as completed  

That's it! 🎉 This will automatically analyze the XML result file, create a new test run in Testmo, submit all tests & results and mark the run as completed. There's no need to manually create any tests, map tests or IDs or build any custom API code. Everything is handled automatically for you.

In the above example, we first launched Cucumber to generate the XML file and then used our CLI tool to submit the results in a second step. As an improvement to the above example, we can ask our CLI tool to launch Cucumber (testmo then starts and waits for Cucumber to finish). This has the following additional benefits:

a) Capture full console output and send it to Testmo b) Accurately measure test times c) Record the Cucumber exit code

Launch Cucumber with CLI tool

We can ask our CLI tool to launch Cucumber, so we can capture the console output and more:

$ export TESTMO_TOKEN=********
$ testmo automation:run:submit \
  --instance https://<your-name>.testmo.net \
  --project-id 1 \
  --name "Cucumber test run" \
  --source "unittests" \
  --results results/*.xml \
  -- cucumber --format junit --out results/test-results.xml
    ^ space!

Now that you are familiar with submitting your Cucumber test results to Testmo, you might also find the following additional examples, topics and references useful for more advanced workflows.

This will run your tests with Cucumber and automatically write all test results to an XML file in the results directory. You can also learn more in the .

For JavaScript-based Cucumber tests, you can install the popular package and use this to generate the XML files.

You can also find additional command line options in the .

Submit test results to Testmo

To submit your test results to Testmo, you simply use our cross-platform CLI tool. The CLI tool is distributed as an NPM package and is easy to install on any system. Simply install our official @testmo/testmo-cli NPM package:

We can now send the Cucumber test results to Testmo. To do this, make sure to in Testmo from your profile page. The API key is used to authenticate with Testmo to send the results. We can then use the testmo CLI tool so submit our results (note that we first set the TESTMO_TOKEN variable, which the tool expects):

Bonus: Launch Cucumber with Testmo CLI

Also learn more and see other examples in the full .

More resources & references

➡️
Cucumber documentation
cucumber-junit
package documentation
testmo
generate an API key
Testmo CLI guide
Testmo automation overview
Testmo automation concepts
Integrating with CI/CD pipelines
Testmo CLI guide and reference
Automation tool examples
Cucumber
Cucumber test management