Re: Confidence: Chopping between 5.2 and 6.0.1

[Donald Lee <MacPPC2%c.icompute.com@localhost>]

>Hi,
>
>On Mar 24, 2013, at 6:28 PM, Donald Lee wrote:
>
>> Replying to my own message.
>>
>> I lied.
>>
>> After re-testing the "-D 2011-05-03" version, I DID get it to fail.
>>
>> The test case I've been using runs 20 iterations of about 45 seconds each.
>> Normally, one run is enough, but sometimes it seems to run several iterations
>> clean, and then fail.  I **think* that something about the load on the
>> machine helps trigger the error.  I have tried to isolate this, but the
>> pattern is not clear.
>>
>> In any case, I ran the test 3 more times on the 2011-05-03 build, and it
>> failed 2 of the 3 runs.
>>
>> -D 2011-05-01 looks clean
>> -D 2011-05-03 looks bad.
>>
>> Looks to me like matt broke something. ;->
>>
>> I kept the several of the relevant build directories, so I am in a good
>> position to test fixes if they should appear.  I don't have a build dir
>> for HEAD, but could set one up.  My test scripts require some
>> relatively large data files, so they are not so easy to "deliver" to
>> someone else.
>
>I just want to make sure that I understand what is happening. Then the 
>development branch (NetBSD 6) on and after Mon May  2 02:01:33 UTC 2011 is 
>effected by this. Could this bug affect G3 systems? I want to do my own 
>testing. I didn't see a post on how you are doing your testing.
>
>Best Regards,
>Al


My testing was this:

mkdir usrX
cd usrX
export CVS_RSH="ssh"
export CVSROOT="anoncvs%anoncvs.NetBSD.org@localhost:/cvsroot"
cvs checkout -D 2011-mm-dd -P src
cd src
./build.sh tools kernel=GENERIC
<test kernel with test case>

My notes about testing in part look like this:

cvs checkout -D 2011-04-15 -P src - usr9 - netbsd 5.99.49 - clean - clean2 - c3 
c4 c5
cvs checkout -D 2011-04-25 -P src - usrd.delete - (buildfail)   netbsd 5.99.50
cvs checkout -D 2011-05-01 -P src - usrd - netbsd 5.99.51c -  c.q1 c.q2 c.q3 - 
clean
cvs checkout -D 2011-05-03 -P src - usre - netbsd 5.99.51d -  c.q1 c.q2 c.q3 
B.q4 b.q5 c.q6 BAD
cvs checkout -D 2011-05-04 -P src - usrf - netbsd 5.99.51e -  (cvs done)
cvs checkout -D 2011-05-05 -P src - usra - netbsd 5.99.51 - clean - bad2 - bad3
cvs checkout -D 2011-05-11 -P src - usrc - netbsd 5.99.51b - clean - clean bad1 
bad2 bad3

Everything prior to May 2 was clean.  Everything after May 2 was
bad.  I quit after doing 5/1 and 5/3 builds.

I'll let you be the judge of whether I checked out the right stuff.

I can also give you access to my test case.

-dgl-