Project

General

Profile

Feature #10328

Feature #10237: Refactor and clean up the automated test suite

Clean up features with Scenario Outlines

Added by anonym about 4 years ago. Updated 3 months ago.

Status:
Confirmed
Priority:
Normal
Assignee:
Category:
Test suite
Target version:
-
Start date:
10/03/2015
Due date:
% Done:

0%

Feature Branch:
Type of work:
Code
Blueprint:
Starter:
Affected tool:

Description

Features with lots of similar scenarios, like time_syncing.feature. could certainly be improved with "Scenario Outlines": https://github.com/cucumber/cucumber/wiki/Scenario-Outlines.

Here's why we could not do it in the past:

Since then, we've upgraded to Cucumber 2.4.0 on our CI and switched to the "Cucumber Reports" Jenkins plugin (#17080#note-12). This screenshot suggests that it supports Scenario Outlines.

Another option could be to pass --expand to cucumber.


Related issues

Blocked by Tails - Bug #10068: Upgrade to Jenkins 2.x, using upstream packages Resolved 01/08/2018
Blocked by Tails - Bug #17080: Upgrade Cucumber on Jenkins isotesters Resolved

Associated revisions

Revision 63ff0242 (diff)
Added by intrigeri about 3 years ago

Test suite: expand scenario outline into two scenarios.

The cucumber-testresult-plugin (0.7) plugin for Jenkins fails to parse
JSON output by Cucumber when scenario outlines are used.

refs: #10328

This seems to be fixed in
0.8-beta1 (https://issues.jenkins-ci.org/browse/JENKINS-21835)
but we're using a too old Jenkins version to upgrade.

History

#1 Updated by anonym about 4 years ago

  • Parent task set to #10237

#2 Updated by intrigeri about 3 years ago

  • Blocked by Bug #10068: Upgrade to Jenkins 2.x, using upstream packages added

#3 Updated by intrigeri over 1 year ago

FWIW I've just hit the Jenkins 1.x limitation again when working on the VeraCrypt test suite: I can't use scenario outlines so I'll have to duplicate one scenario ~8 times and another one ~6 times.

#4 Updated by intrigeri 3 months ago

  • Description updated (diff)

#5 Updated by intrigeri 3 months ago

#6 Updated by intrigeri 3 months ago

  • Related to deleted (Feature #10329: Improve gherkin in our features)

#7 Updated by intrigeri 3 months ago

  • Description updated (diff)

#8 Updated by intrigeri 3 months ago

  • Description updated (diff)

#9 Updated by intrigeri 3 months ago

  • Related to Bug #17080: Upgrade Cucumber on Jenkins isotesters added

#10 Updated by intrigeri 3 months ago

  • Related to deleted (Bug #17080: Upgrade Cucumber on Jenkins isotesters)

#11 Updated by intrigeri 3 months ago

  • Blocked by Bug #17080: Upgrade Cucumber on Jenkins isotesters added

#12 Updated by intrigeri 3 months ago

  • Description updated (diff)

The sysadmin team solved the blockers so in theory, we should now be able to use Scenario Outlines. Untested though!

Also available in: Atom PDF