Thunderbird "my Thunderbird inbox is non-empty" test consistently fails
It seems that since March 3, this step of "Scenario: Thunderbird can download the inbox with POP3" fails every time it runs, both on our shared Jenkins and on my local one:
Then my Thunderbird inbox is non-empty # features/step_definitions/thunderbird.rb:219 <false> is not true. (Test::Unit::AssertionFailedError) features/thunderbird.feature:49:in `Then my Thunderbird inbox is non-empty'
Some of the failures were caused by the mailbox being indeed empty (no idea why) but the test still fails while I've ensured there's a message there (confirmed by the test video). I suspect the Dogtail code that checks this is buggy.
I suppose your failures weren't on the stable branch?
My failures were on branches based on stable, that included the version of Thunderbird and its test suite that's in 3.12.1. I have no clue why the problem started to occur on March 3. FWIW, I've initially suspected someone did $things in the shared test mailbox that changed the behaviour of the test cases. The only thing I've found that correlates wrt. timing is that I've set up a new Jenkins isotester around the time the problem appeared, but I don't see how that's related. Anyways :)