-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

PASS -> FAIL
http://dstress.kuehne.cn/run/line_token_03.d
http://dstress.kuehne.cn/run/line_token_04.d

XFAIL -> ERROR http://dstress.kuehne.cn/nocompile/bug_constfold_575_A.d http://dstress.kuehne.cn/nocompile/bug_constfold_575_B.d http://dstress.kuehne.cn/nocompile/bug_constfold_575_C.d

XFAIL -> XPASS http://dstress.kuehne.cn/nocompile/bug_constfold_575_J.d http://dstress.kuehne.cn/nocompile/bug_constfold_575_O.d http://dstress.kuehne.cn/nocompile/bug_constfold_575_R.d

I'm not sure why, but repeating the following test cases with DMD-0.123 sometimes results in XFAIL and sometimes ERROR. http://dstress.kuehne.cn/nocompile/array_initialization_09.d http://dstress.kuehne.cn/nocompile/array_initialization_11.d

Summary: (370KB)
http://dstress.kuehne.cn/www/dstress.html

Snapshot: http://developer.berlios.de/project/showfiles.php?group_id=2732

Todo:
https://developer.berlios.de/pm/?group_id=2732

Thomas


-----BEGIN PGP SIGNATURE-----

iD8DBQFChS3O3w+/yD4P9tIRAvnrAKCREXIy4r52gdSNCpkWiRIInEENcACgw1u3
ufGCBBhf1BS/Ygyq2ix/1nc=
=MKpT
-----END PGP SIGNATURE-----

Success rate up from 63.1% through 66.3% to 66.4%
Stability rate up from 92.5% through 97.9% to 99.4%

http://smjg.port5.com/pr/d/dstress.xls

I see DStress has grown considerably over the last few versions.  Always a good sign.  Now, considering that we're at 0.123 with a 66.4 success rate at the moment, can we guess that we'll reach DMD 0.185 before we get to 1.0?  :-)

Stewart.

-- 
My e-mail is valid but not my primary mailbox.  Please keep replies on the 'group where everyone may benefit.

Stewart Gordon wrote:

| Success rate up from 63.1% through 66.3% to 66.4%

The XFAIL and FAIL data in your table seems to be interchanged.

Thomas

Thomas Kühne wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> Stewart Gordon wrote:
> 
> | Success rate up from 63.1% through 66.3% to 66.4%
> 
> The XFAIL and FAIL data in your table seems to be interchanged.

I copied and pasted the table as I normally do.  So they must have got interchanged on your page (which seems to be down at the mo).

Stewart.

-- 
My e-mail is valid but not my primary mailbox.  Please keep replies on the 'group where everyone may benefit.

Stewart Gordon wrote:

| Thomas Kühne wrote:
|
|> Stewart Gordon wrote:
|>
|> | Success rate up from 63.1% through 66.3% to 66.4%
|>
|> The XFAIL and FAIL data in your table seems to be interchanged.
|
|
| I copied and pasted the table as I normally do.  So they must have got
| interchanged on your page (which seems to be down at the mo).

Seems like I have to change the provider.

backup:
http://svn.berlios.de/viewcvs/*checkout*/dstress/www/dstress.html

Thomas

Thomas Kühne wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> Stewart Gordon wrote:
> 
>> Success rate up from 63.1% through 66.3% to 66.4%
> 
> The XFAIL and FAIL data in your table seems to be interchanged.

Fixed now.

Success rate up from 82.4% through 86.9% to 91.0%.

And is it me, or have the numbers of untested cases with respect to version gone rather random?

Stewart.

-- 
My e-mail is valid but not my primary mailbox.  Please keep replies on the 'group where everyone may benefit.

Stewart Gordon wrote:
| And is it me, or have the numbers of untested cases with respect to
| version gone rather random?

Older DMD versions are tested once in a while, however updating all of
them at once would result in approx. 27*2000 tests  ;)
Maybe I am going to store the test in a SQL db so that only
incremental updates of the changed/new tests are required.

Older GDC versions aren't tested due to some hard coded pathes in GDC
that would have to be fixed before installing several different GDC
versions side by side.

Thomas

"Stewart Gordon" <smjg_1998@yahoo.com> wrote in message news:d69pkm$1f26$1@digitaldaemon.com...
> Success rate up from 63.1% through 66.3% to 66.4%
> Stability rate up from 92.5% through 97.9% to 99.4%
>
> http://smjg.port5.com/pr/d/dstress.xls
>
> I see DStress has grown considerably over the last few versions.  Always a good sign.  Now, considering that we're at 0.123 with a 66.4 success rate at the moment, can we guess that we'll reach DMD 0.185 before we get to 1.0?  :-)

I keep fixing bugs, and Thomas keeps adding more test cases, makes me feel like I'm on a treadmill <g>. Furthermore, the same problem tends to be spread across many test cases. This means that some care must be taken in projecting trends.

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Walter schrieb am Wed, 18 May 2005 15:30:35 -0700:
>
> "Stewart Gordon" <smjg_1998@yahoo.com> wrote in message news:d69pkm$1f26$1@digitaldaemon.com...
>> Success rate up from 63.1% through 66.3% to 66.4%
>> Stability rate up from 92.5% through 97.9% to 99.4%
>>
>> http://smjg.port5.com/pr/d/dstress.xls
>>
>> I see DStress has grown considerably over the last few versions.  Always a good sign.  Now, considering that we're at 0.123 with a 66.4 success rate at the moment, can we guess that we'll reach DMD 0.185 before we get to 1.0?  :-)
>
> I keep fixing bugs, and Thomas keeps adding more test cases, makes me feel like I'm on a treadmill <g>. Furthermore, the same problem tends to be spread across many test cases. This means that some care must be taken in projecting trends.

Exactly. Sometimes one bug report results in some 25+ test cases to cover all native types and sometimes only 1-3 test cases.

One would have to look at the @uri@ and @date@ fields in the test cases in order to get a rough idea of the bug statistics.

Thomas


-----BEGIN PGP SIGNATURE-----

iD8DBQFCi+L33w+/yD4P9tIRAkehAKDJeECxrBL7ij+1p2KiLHztq9yRyQCcCIFt
B1WkkENBZjEAgmdTyftNqSQ=
=oGzw
-----END PGP SIGNATURE-----

>> I see DStress has grown considerably over the last few versions.  Always
>> a good sign.  Now, considering that we're at 0.123 with a 66.4 success
>> rate at the moment, can we guess that we'll reach DMD 0.185 before we
>> get to 1.0?  :-)
>
> I keep fixing bugs, and Thomas keeps adding more test cases, makes me feel
> like I'm on a treadmill <g>. Furthermore, the same problem tends to be
> spread across many test cases. This means that some care must be taken in
> projecting trends.

Hmm, the question is: When will you have finished? But i would need the statistics of DStress over time to calculate that (bad description... i mean the numbers "count of test cases" and "count of successfull test cases", but from the past, i.e. "how many test cases did DStress have when dmd 0.99 (for example) was released"). This way we could estimate the future growth?

Anyways, the earlier compilers already had most of the bugs the current DMD has, thus you are definitely making progress. :)  Very good work...

Ciao
uwe