Project

General

Profile

Bug #11463

Bug #10288: Fix newly identified issues to make our test suite more robust and faster

robust_notification_wait sometimes does not recognize the notification it's looking for

Added by intrigeri about 3 years ago. Updated about 3 years ago.

Status:
Confirmed
Priority:
Elevated
Assignee:
-
Category:
Test suite
Target version:
-
Start date:
05/23/2016
Due date:
% Done:

0%

Feature Branch:
test/11463-notification-not-recognized
Type of work:
Code
Blueprint:
Starter:
Affected tool:

Description


  Scenario: The 'Tor is ready' notification is shown when Tor has bootstrapped # features/checks.feature:53
calling as root: echo 'hello?'
call returned: [0, "hello?\n", ""]
[log] CLICK on (1024,384)
calling as root: /sbin/ifconfig eth0 | grep -q 'inet addr'
call returned: [1, "", ""]
calling as root: date -s '@1463925154'
call returned: [0, "Sun May 22 13:52:34 UTC 2016\n", ""]
    Given I have started Tails from DVD without network and logged in          # features/step_definitions/snapshots.rb:199
    And the network is plugged                                                 # features/step_definitions/common_steps.rb:161
[log] CLICK on (1007,762)
[log] CLICK on (1007,762)
[log] CLICK on (1007,762)
[profile] Finder.findAll START
[profile] Finder.findAll END: 76ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 94ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 79ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 81ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 78ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 93ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 64ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 92ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 85ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 78ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 75ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 68ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 78ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 75ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 78ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 89ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 88ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 74ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 81ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 86ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 82ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 82ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 90ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 79ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 80ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 83ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 76ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 66ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 88ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 72ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 93ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 76ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 84ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 76ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 65ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 83ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 92ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 75ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 80ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 98ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 75ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 77ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 75ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 74ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 75ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 76ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 82ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 95ms
[log] CLICK on (991,697)
[log] CLICK on (991,697)
[profile] Finder.findAll START
[profile] Finder.findAll END: 74ms
[log] CLICK on (991,697)
    When I see the 'Tor is ready' notification                                 # features/step_definitions/common_steps.rb:377
      Didn't not see notification 'TorIsReadyNotification.png' (Timeout::Error)
      ./features/support/helpers/misc_helpers.rb:83:in `rescue in try_for'
      ./features/support/helpers/misc_helpers.rb:33:in `try_for'
      ./features/step_definitions/common_steps.rb:68:in `robust_notification_wait'
      ./features/step_definitions/common_steps.rb:378:in `/^I see the 'Tor is ready' notification$/'
      features/checks.feature:56:in `When I see the 'Tor is ready' notification'
    Then Tor is ready                                                          # features/step_definitions/common_steps.rb:381
      Scenario failed at time 01:03:42

      Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_test-10376-fix-startup-page-roadmap-test-is-fragile/18/artifact/build-artifacts/01:03:42_The__Tor_is_ready__notification_is_shown_when_Tor_has_bootstrapped.png

      Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_test-10376-fix-startup-page-roadmap-test-is-fragile/18/artifact/build-artifacts/01:03:42_The__Tor_is_ready__notification_is_shown_when_Tor_has_bootstrapped.mkv

History

#1 Updated by intrigeri about 3 years ago

I'm going to flag this specific test as fragile, but if this fails here, there are good chances that it'll fail in other places, I guess.

#2 Updated by intrigeri about 3 years ago

  • Feature Branch set to test/11463-notification-not-recognized

#3 Updated by intrigeri about 3 years ago

  • Assignee set to anonym
  • Target version set to Tails_2.5

#4 Updated by intrigeri about 3 years ago

  • Priority changed from Normal to Elevated

#5 Updated by intrigeri about 3 years ago

  • Target version changed from Tails_2.5 to Tails_2.6

#6 Updated by intrigeri about 3 years ago

bertagaz: did if you see any such thing while doing #11087? If yes, I think that providing more debug logs + videos would help a lot here.

#7 Updated by bertagaz about 3 years ago

intrigeri wrote:

bertagaz: did if you see any such thing while doing #11087? If yes, I think that providing more debug logs + videos would help a lot here.

Nop, I don't remember having seen that in devel or stable. A quick grep into the logs archived by Jenkins does not bring any match too.

#8 Updated by intrigeri about 3 years ago

  • Target version deleted (Tails_2.6)

#9 Updated by intrigeri about 3 years ago

  • Assignee deleted (anonym)

Also available in: Atom PDF