Thread overview
[Issue 8156] New: Very slow compilation with string-imported file ~100 MiB
May 28, 2012
Denis Shelomovskij
May 29, 2012
dawg@dawgfoto.de
May 29, 2012
Denis Shelomovskij
May 28, 2012
http://d.puremagic.com/issues/show_bug.cgi?id=8156

           Summary: Very slow compilation with string-imported file ~100
                    MiB
           Product: D
           Version: D2
          Platform: All
        OS/Version: All
            Status: NEW
          Keywords: performance
          Severity: enhancement
          Priority: P2
         Component: DMD
        AssignedTo: nobody@puremagic.com
        ReportedBy: verylonglogin.reg@gmail.com


--- Comment #0 from Denis Shelomovskij <verylonglogin.reg@gmail.com> 2012-05-28 09:43:05 MSD ---
dmd takes 14 s with full load of one CPU core to include 40 MiB file
as a string import on my PC. During this dmd process slowly increases its
memory using by 2-3 MiB/s.

-- 
Configure issuemail: http://d.puremagic.com/issues/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
May 29, 2012
http://d.puremagic.com/issues/show_bug.cgi?id=8156


dawg@dawgfoto.de changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |dawg@dawgfoto.de


--- Comment #1 from dawg@dawgfoto.de 2012-05-29 06:35:25 PDT ---
I run into longer compilation times at about 300MB but at that point it's mainly due to paging in consecutive runs.

Are you processing/casting the string?
What OS are you on?
Are you seeing O(N^2) behavior?

-- 
Configure issuemail: http://d.puremagic.com/issues/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
May 29, 2012
http://d.puremagic.com/issues/show_bug.cgi?id=8156



--- Comment #2 from Denis Shelomovskij <verylonglogin.reg@gmail.com> 2012-05-29 19:26:35 MSD ---
(In reply to comment #1)
> I run into longer compilation times at about 300MB but at that point it's mainly due to paging in consecutive runs.
> 
> Are you processing/casting the string?
No CT processing, casting doesn't matter.

> What OS are you on?
Windows XP SP3

> Are you seeing O(N^2) behavior?
Yes. My timings in CSV format:
---
Size, MiB;Time, s
1;0
13.4;2
28.3;7
40.5;17
96.7;111
215;582
---

y = a * x^b approximation:
time(size) = 6.79E-00003 x^2.117 with R^2 = 0.9999

-- 
Configure issuemail: http://d.puremagic.com/issues/userprefs.cgi?tab=email
------- You are receiving this mail because: -------