155 new regressions
PASS -> ERROR: run/c/catch_05_A.d
FAIL -> ERROR: run/c/catch_05_A.d (-g)
PASS -> ERROR: run/c/catch_05_A.d (-inline)
PASS -> ERROR: run/c/catch_05_A.d (-fPIC)
PASS -> ERROR: run/c/catch_05_A.d (-O)
PASS -> ERROR: run/c/catch_05_A.d (-release)
FAIL -> ERROR: run/c/catch_05_A.d (-g -inline)
PASS -> ERROR: run/c/catch_05_A.d (-g -fPIC)
PASS -> ERROR: run/c/catch_05_A.d (-g -O)
FAIL -> ERROR: run/c/catch_05_A.d (-g -release)
PASS -> ERROR: run/c/catch_05_A.d (-inline -fPIC)
PASS -> ERROR: run/c/catch_05_A.d (-inline -O)
PASS -> ERROR: run/c/catch_05_A.d (-inline -release)
PASS -> ERROR: run/c/catch_05_A.d (-fPIC -O)
PASS -> ERROR: run/c/catch_05_A.d (-fPIC -release)
PASS -> ERROR: run/c/catch_05_A.d (-O -release)
PASS -> ERROR: run/c/catch_05_A.d (-g -inline -fPIC)
PASS -> ERROR: run/c/catch_05_A.d (-g -inline -O)
FAIL -> ERROR: run/c/catch_05_A.d (-g -inline -release)
PASS -> ERROR: run/c/catch_05_A.d (-g -fPIC -O)
PASS -> ERROR: run/c/catch_05_A.d (-g -fPIC -release)
PASS -> ERROR: run/c/catch_05_A.d (-g -O -release)
PASS -> ERROR: run/c/catch_05_A.d (-inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_A.d (-inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_A.d (-inline -O -release)
PASS -> ERROR: run/c/catch_05_A.d (-fPIC -O -release)
PASS -> ERROR: run/c/catch_05_A.d (-g -inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_A.d (-g -inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_A.d (-g -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_A.d (-inline -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_A.d (-g -inline -fPIC -O -release)
FAIL -> ERROR: run/c/catch_05_B.d
FAIL -> ERROR: run/c/catch_05_B.d (-g)
FAIL -> ERROR: run/c/catch_05_B.d (-inline)
PASS -> ERROR: run/c/catch_05_B.d (-fPIC)
PASS -> ERROR: run/c/catch_05_B.d (-O)
FAIL -> ERROR: run/c/catch_05_B.d (-release)
FAIL -> ERROR: run/c/catch_05_B.d (-g -inline)
PASS -> ERROR: run/c/catch_05_B.d (-g -fPIC)
PASS -> ERROR: run/c/catch_05_B.d (-g -O)
FAIL -> ERROR: run/c/catch_05_B.d (-g -release)
PASS -> ERROR: run/c/catch_05_B.d (-inline -fPIC)
PASS -> ERROR: run/c/catch_05_B.d (-inline -O)
FAIL -> ERROR: run/c/catch_05_B.d (-inline -release)
PASS -> ERROR: run/c/catch_05_B.d (-fPIC -O)
PASS -> ERROR: run/c/catch_05_B.d (-fPIC -release)
PASS -> ERROR: run/c/catch_05_B.d (-O -release)
PASS -> ERROR: run/c/catch_05_B.d (-g -inline -fPIC)
PASS -> ERROR: run/c/catch_05_B.d (-g -inline -O)
FAIL -> ERROR: run/c/catch_05_B.d (-g -inline -release)
PASS -> ERROR: run/c/catch_05_B.d (-g -fPIC -O)
PASS -> ERROR: run/c/catch_05_B.d (-g -fPIC -release)
PASS -> ERROR: run/c/catch_05_B.d (-g -O -release)
PASS -> ERROR: run/c/catch_05_B.d (-inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_B.d (-inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_B.d (-inline -O -release)
PASS -> ERROR: run/c/catch_05_B.d (-fPIC -O -release)
PASS -> ERROR: run/c/catch_05_B.d (-g -inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_B.d (-g -inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_B.d (-g -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_B.d (-inline -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_B.d (-g -inline -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_E.d
PASS -> ERROR: run/c/catch_05_E.d (-g)
PASS -> ERROR: run/c/catch_05_E.d (-inline)
PASS -> ERROR: run/c/catch_05_E.d (-fPIC)
PASS -> ERROR: run/c/catch_05_E.d (-O)
PASS -> ERROR: run/c/catch_05_E.d (-release)
PASS -> ERROR: run/c/catch_05_E.d (-g -inline)
PASS -> ERROR: run/c/catch_05_E.d (-g -fPIC)
PASS -> ERROR: run/c/catch_05_E.d (-g -O)
PASS -> ERROR: run/c/catch_05_E.d (-g -release)
PASS -> ERROR: run/c/catch_05_E.d (-inline -fPIC)
PASS -> ERROR: run/c/catch_05_E.d (-inline -O)
PASS -> ERROR: run/c/catch_05_E.d (-inline -release)
PASS -> ERROR: run/c/catch_05_E.d (-fPIC -O)
PASS -> ERROR: run/c/catch_05_E.d (-fPIC -release)
PASS -> ERROR: run/c/catch_05_E.d (-O -release)
PASS -> ERROR: run/c/catch_05_E.d (-g -inline -fPIC)
PASS -> ERROR: run/c/catch_05_E.d (-g -inline -O)
PASS -> ERROR: run/c/catch_05_E.d (-g -inline -release)
PASS -> ERROR: run/c/catch_05_E.d (-g -fPIC -O)
PASS -> ERROR: run/c/catch_05_E.d (-g -fPIC -release)
PASS -> ERROR: run/c/catch_05_E.d (-g -O -release)
PASS -> ERROR: run/c/catch_05_E.d (-inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_E.d (-inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_E.d (-inline -O -release)
PASS -> ERROR: run/c/catch_05_E.d (-fPIC -O -release)
PASS -> ERROR: run/c/catch_05_E.d (-g -inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_E.d (-g -inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_E.d (-g -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_E.d (-inline -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_E.d (-g -inline -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_F.d
FAIL -> ERROR: run/c/catch_05_F.d (-g)
PASS -> ERROR: run/c/catch_05_F.d (-inline)
PASS -> ERROR: run/c/catch_05_F.d (-fPIC)
PASS -> ERROR: run/c/catch_05_F.d (-O)
PASS -> ERROR: run/c/catch_05_F.d (-release)
FAIL -> ERROR: run/c/catch_05_F.d (-g -inline)
PASS -> ERROR: run/c/catch_05_F.d (-g -fPIC)
PASS -> ERROR: run/c/catch_05_F.d (-g -O)
FAIL -> ERROR: run/c/catch_05_F.d (-g -release)
PASS -> ERROR: run/c/catch_05_F.d (-inline -fPIC)
PASS -> ERROR: run/c/catch_05_F.d (-inline -O)
PASS -> ERROR: run/c/catch_05_F.d (-inline -release)
PASS -> ERROR: run/c/catch_05_F.d (-fPIC -O)
PASS -> ERROR: run/c/catch_05_F.d (-fPIC -release)
PASS -> ERROR: run/c/catch_05_F.d (-O -release)
PASS -> ERROR: run/c/catch_05_F.d (-g -inline -fPIC)
PASS -> ERROR: run/c/catch_05_F.d (-g -inline -O)
FAIL -> ERROR: run/c/catch_05_F.d (-g -inline -release)
PASS -> ERROR: run/c/catch_05_F.d (-g -fPIC -O)
PASS -> ERROR: run/c/catch_05_F.d (-g -fPIC -release)
PASS -> ERROR: run/c/catch_05_F.d (-g -O -release)
PASS -> ERROR: run/c/catch_05_F.d (-inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_F.d (-inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_F.d (-inline -O -release)
PASS -> ERROR: run/c/catch_05_F.d (-fPIC -O -release)
PASS -> ERROR: run/c/catch_05_F.d (-g -inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_F.d (-g -inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_F.d (-g -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_F.d (-inline -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_F.d (-g -inline -fPIC -O -release)
FAIL -> ERROR: run/c/catch_05_H.d
FAIL -> ERROR: run/c/catch_05_H.d (-g)
FAIL -> ERROR: run/c/catch_05_H.d (-inline)
PASS -> ERROR: run/c/catch_05_H.d (-fPIC)
PASS -> ERROR: run/c/catch_05_H.d (-O)
FAIL -> ERROR: run/c/catch_05_H.d (-release)
FAIL -> ERROR: run/c/catch_05_H.d (-g -inline)
PASS -> ERROR: run/c/catch_05_H.d (-g -fPIC)
PASS -> ERROR: run/c/catch_05_H.d (-g -O)
FAIL -> ERROR: run/c/catch_05_H.d (-g -release)
PASS -> ERROR: run/c/catch_05_H.d (-inline -fPIC)
PASS -> ERROR: run/c/catch_05_H.d (-inline -O)
FAIL -> ERROR: run/c/catch_05_H.d (-inline -release)
PASS -> ERROR: run/c/catch_05_H.d (-fPIC -O)
PASS -> ERROR: run/c/catch_05_H.d (-fPIC -release)
PASS -> ERROR: run/c/catch_05_H.d (-O -release)
PASS -> ERROR: run/c/catch_05_H.d (-g -inline -fPIC)
PASS -> ERROR: run/c/catch_05_H.d (-g -inline -O)
FAIL -> ERROR: run/c/catch_05_H.d (-g -inline -release)
PASS -> ERROR: run/c/catch_05_H.d (-g -fPIC -O)
PASS -> ERROR: run/c/catch_05_H.d (-g -fPIC -release)
PASS -> ERROR: run/c/catch_05_H.d (-g -O -release)
PASS -> ERROR: run/c/catch_05_H.d (-inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_H.d (-inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_H.d (-inline -O -release)
PASS -> ERROR: run/c/catch_05_H.d (-fPIC -O -release)
PASS -> ERROR: run/c/catch_05_H.d (-g -inline -fPIC -O)
PASS -> ERROR: run/c/catch_05_H.d (-g -inline -fPIC -release)
PASS -> ERROR: run/c/catch_05_H.d (-g -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_H.d (-inline -fPIC -O -release)
PASS -> ERROR: run/c/catch_05_H.d (-g -inline -fPIC -O -release)

Summary: (392K)
http://dstress.kuehne.cn/www/dstress.html

Details: (650K)
http://dstress.kuehne.cn/www/dmd-0.151.html

Log: (1.2M)
http://dstress.kuehne.cn/raw_results/linnux-amd64_dmd-0.151.log.gz

Thomas

I've finally updated my statistics file for the first time in ages!

http://pr.stewartsplace.org.uk/d/dstress.xls

Success rate up from 63.2% to 63.5%
(best 64.6% DMD 0.113)

Stability rate up from 97.3% to 97.7%

There seems to have been a surge of error results between 0.138 and 0.144 - weird.  The regression report for 0.138 doesn't show any such surge.  Have the numbers become mixed up?

Stewart.

-- 
-----BEGIN GEEK CODE BLOCK-----
Version: 3.1
GCS/M d- s:-@ C++@ a->--- UB@ P+ L E@ W++@ N+++ o K-@ w++@ O? M V? PS- PE- Y? PGP- t- 5? X? R b DI? D G e++++ h-- r-- !y
------END GEEK CODE BLOCK------

My e-mail is valid but not my primary mailbox.  Please keep replies on the 'group where everyone may benefit.

Stewart Gordon schrieb am 2006-04-06:
> There seems to have been a surge of error results between 0.138 and 0.144 - weird.  The regression report for 0.138 doesn't show any such surge.  Have the numbers become mixed up?

0.138 introduced "-fPIC"

(neither documented in the changelog nor in DMD's help message, but listed on http://www.digitalmars.com/d/html/d/dcompiler.html)

See also: http://www.digitalmars.com/d/changelog.html#new0145

The numbers are correct - compare the summaries from http://dstress.kuehne.cn/www/dmd-0.137.html and http://dstress.kuehne.cn/www/dmd-0.138.html

Thomas

Thomas Kuehne wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> Stewart Gordon schrieb am 2006-04-06:
>> There seems to have been a surge of error results between 0.138 and 0.144 - weird.  The regression report for 0.138 doesn't show any such surge.  Have the numbers become mixed up?
> 
> 0.138 introduced "-fPIC"
> 
> (neither documented in the changelog nor in DMD's help message, but
> listed on http://www.digitalmars.com/d/html/d/dcompiler.html)
<snip>

I see.  But what does "position independent code" mean?

> The numbers are correct - compare the summaries from
> http://dstress.kuehne.cn/www/dmd-0.137.html and
> http://dstress.kuehne.cn/www/dmd-0.138.html

Looking at 0.138, the lowest number of passes is 1299, but you've taken 1304 as the figure for that version.  Time to investigate the formula....

Stewart.

-- 
-----BEGIN GEEK CODE BLOCK-----
Version: 3.1
GCS/M d- s:-@ C++@ a->--- UB@ P+ L E@ W++@ N+++ o K-@ w++@ O? M V? PS- PE- Y? PGP- t- 5? X? R b DI? D G e++++ h-- r-- !y
------END GEEK CODE BLOCK------

My e-mail is valid but not my primary mailbox.  Please keep replies on the 'group where everyone may benefit.

Stewart Gordon schrieb am 2006-04-06:
> Thomas Kuehne wrote:
>> Stewart Gordon schrieb am 2006-04-06:

<snip>

> I see.  But what does "position independent code" mean?

from GCC's man page:
> -fPIC
>	If supported for the target machine, emit position-independent
>	code, suitable for dynamic linking and avoiding any limit on the
>	size of the global offset table.

<snip>

> Looking at 0.138, the lowest number of passes is 1299, but you've taken 1304 as the figure for that version.  Time to investigate the formula....

You are looking at revision 1108 (2006-03-21) instead of the
current 1133 (2006-04-05) one.

The formula looks for the worst test result of each test case.
Naturaly "untested" isn't considered a bad result.
There are 44 untested cases in the "-g -fPIC -O" configuration,
thus the highest possible number of global passes could have been
1343 (1299+44).

1343 >= 1304 >= 1299: sanity check passed

Thomas

Thomas Kuehne wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> Stewart Gordon schrieb am 2006-04-06:
>> There seems to have been a surge of error results between 0.138 and 0.144 - weird.  The regression report for 0.138 doesn't show any such surge.  Have the numbers become mixed up?
> 
> 0.138 introduced "-fPIC"
> 
> (neither documented in the changelog nor in DMD's help message, but
> listed on http://www.digitalmars.com/d/html/d/dcompiler.html)

"http://www.digitalmars.com/d/dcompiler.html" is the link here.

-- 
jcc7