Project

General

Profile

Bug #16281

Update the test suite for buster

Added by CyrilBrulebois about 2 months ago. Updated about 1 month ago.

Status:
In Progress
Priority:
Elevated
Category:
Test suite
Target version:
Start date:
01/05/2019
Due date:
% Done:

0%

QA Check:
Feature Branch:
Type of work:
Code
Blueprint:
Starter:
Affected tool:

Description

The test suite won't pass directly for the feature/buster branch, as some reference images will need updating etc. Let's keep track of those updates with this bug report.


Subtasks

Bug #16287: buster vs. ssh.feature: unable to connect to SFTP serverConfirmed

Bug #16314: Losing remote shell access with snapshots vs. persistenceConfirmed

Bug #16316: Black screen/apparent machine crash in test suite due to snapshot mechanism?Confirmed

Bug #16317: persistence.feature fails due to NetworkManager testConfirmed

Bug #16319: Regression in ssh.feature with busterIn Progress

Bug #16335: Gobby 0.5→0.6 changes in buster: test suite update neededIn ProgressCyrilBrulebois

Bug #16340: Seahorse/buster: No import button, no more iconsIn Progress

Bug #16341: Seahorse/buster: No more close buttonIn ProgressCyrilBrulebois


Related issues

Blocks Tails - Feature #13241: Core work 2018Q2 → 2019Q2: Test suite maintenance Confirmed 06/29/2017

Associated revisions

Revision 1bdac672 (diff)
Added by CyrilBrulebois about 2 months ago

Test suite: update reference images for Tails Greeter (refs: #16281).

Revision 35178e49 (diff)
Added by CyrilBrulebois about 2 months ago

Test suite: update reference image for Gnome Applications menu (refs: #16281).

The background is now blue instead of black by default, but that can
change depending on possible full screen windows. Let's deal with such
cases later, as they are encountered.

Revision aba71b0c (diff)
Added by CyrilBrulebois about 1 month ago

Test suite: update reference image for Gnome Activities Overview (refs: #16281).

The bottom edge is slightly different but the images are very similar.

Revision 64a4a6ba (diff)
Added by CyrilBrulebois about 1 month ago

Update reference images for persistence-setup wizard (refs: #16281, #16311).

There's a notification pop-up on top of the area covered by the
PersistenceWizardPresets.png reference image. As a consequence cropping
was performed to keep the text part only, trying to be future-proof (in
case the notification pop-up is gotten rid of or its dimensions get
changed).

Revision b8351ada (diff)
Added by CyrilBrulebois about 1 month ago

Update more greeter reference images (refs: #16281).

These are needed for root_access_control.feature, only changes are
slight differences in rendering.

Revision c870a2e2 (diff)
Added by CyrilBrulebois about 1 month ago

Update reference image for persistence passphrase in the greeter (refs: #16281).

This fixes one failure in with the untrusted_partitions feature.

Revision 3e14345b (diff)
Added by CyrilBrulebois about 1 month ago

Update reference image for unblocked partition in the greeter (refs: #16281).

Needed for persistence.feature, now that we have a workaround for snapshot
issues (#16316).

Revision c2954bc0 (diff)
Added by CyrilBrulebois about 1 month ago

Update reference image for deletion in persistence-setup (refs: #16281).

Revision bde12eef (diff)
Added by CyrilBrulebois about 1 month ago

Update reference images needed for timesync.feature (refs: #16281).

Those were mostly about the tor configuration tool, plus a few specific
settings in the greeter.

Notes:
- Candidate for TailsGreeterSpecificTorConfiguration.png was entirely
wrong.
- TorLauncherConnectingWindow.png had no candidate on the sikuli side,
as the window goes away after a while.

Revision 5e9b0170 (diff)
Added by CyrilBrulebois about 1 month ago

Make nautilus vs. ssh work (refs: #16281, #16319).

Revision bbcee2c9 (diff)
Added by CyrilBrulebois about 1 month ago

Update reference image for Tails Greeter (refs: #16281).

Needed for shutdown_applet.feature at least.

Revision ba87916f (diff)
Added by CyrilBrulebois about 1 month ago

Update reference images for evince feature (refs: #16281).

Note: The checks for apparmor's DENIED lines aren't passing at the
moment (#16321).

Revision 5e939618 (diff)
Added by CyrilBrulebois about 1 month ago

Update reference image for “Disable all networking” (refs: #16281).

Without this update, sikuli would find a fuzzy candidate that happens to
be the label describing the various options instead of finding the
actual button. This would lead to a test failure, as eth0 would pop up.

Revision f88918b8 (diff)
Added by CyrilBrulebois about 1 month ago

Update reference images for unsafe_browser feature (refs: #16281).

Revision 55da2855 (diff)
Added by CyrilBrulebois about 1 month ago

Update reference images for torified_gnupg feature (refs: #16281, #16340).

In the process, switch from a clicking a tool bar button that no longer
exists in buster, and use the context menu to import the selected key
(refs: #16340).

History

#1 Updated by CyrilBrulebois about 2 months ago

  • Status changed from New to In Progress

#2 Updated by CyrilBrulebois about 2 months ago

With these initial commits, at least thunderbird.feature is OK:

5 scenarios (5 passed)
42 steps (42 passed)

#3 Updated by intrigeri about 2 months ago

  • Blocks Feature #13241: Core work 2018Q2 → 2019Q2: Test suite maintenance added

Also available in: Atom PDF