This is the mail archive of the
gdb-patches@sourceware.org
mailing list for the GDB project.
Re: automated testing comment [Re: time to workaround libc/13097 in fsf gdb?]
- From: Pedro Alves <palves at redhat dot com>
- To: Doug Evans <xdje42 at gmail dot com>, Jan Kratochvil <jan dot kratochvil at redhat dot com>
- Cc: "gdb-patches at sourceware dot org" <gdb-patches at sourceware dot org>
- Date: Tue, 23 Sep 2014 15:59:37 +0100
- Subject: Re: automated testing comment [Re: time to workaround libc/13097 in fsf gdb?]
- Authentication-results: sourceware.org; auth=none
- References: <5411CFAE dot 7040805 at redhat dot com> <20140912115452 dot GA5626 at host2 dot jankratochvil dot net> <5412E3AC dot 80203 at redhat dot com> <20140912123320 dot GA8704 at host2 dot jankratochvil dot net> <5412EB1F dot 40309 at redhat dot com> <20140917201049 dot GA22880 at host2 dot jankratochvil dot net> <541C3FCF dot 4000400 at redhat dot com> <541C409E dot 6010408 at redhat dot com> <20140920213033 dot GA6255 at host2 dot jankratochvil dot net> <541F2311 dot 1040404 at redhat dot com> <20140923105855 dot GA10164 at host2 dot jankratochvil dot net> <CAP9bCMS1R1S36oh77wOU6FgphGY4+Q2t-Pg20ANi2JWWYe1xYA at mail dot gmail dot com>
On 09/23/2014 03:48 PM, Doug Evans wrote:
> On Tue, Sep 23, 2014 at 3:58 AM, Jan Kratochvil
> <jan.kratochvil@redhat.com> wrote:
>> And sure deploying automated testing with the current GDB testsuite as is
>> would not work now automatically as the testsuite has fuzzy results. Although
>> at least running new testcases (from the patch under review) would work which
>> would be sufficient in this case (but not in other cases - regression cases).
>
> Sometimes tests are flaky and one isn't aware of it, and not
> everything gets caught by patch review.
>
> IWBN if automated testing reran everything failing test N times (10?)
> and reported those results as something like "fail" (always failed) or
> "flaky" (inconsistent).
Indeed. I think that would be doable as part of gdb's own
testsuite machinery even, which would make it easily available
to every one.
Thanks,
Pedro Alves