On 2/16/2013 5:31 PM, Walter Bright wrote:
>
> On 2/16/2013 4:48 PM, Walter Bright wrote:
>>
>> On 2/16/2013 4:23 PM, Nick Sabalausky wrote:
>>> 'freebsd/lib32/libphobos2.a' appears to be old: 2012/11/15
>>>
>>
>>
>> It seems my ancient freebsd box is running out of memory. Argh. Anyone know how to increase the limit on virtual memory allocated to a process?
>
> Increasing the memory doesn't work - off to try desperate measures!

Done & uploaded.
_______________________________________________
dmd-beta mailing list
dmd-beta@puremagic.com
http://lists.puremagic.com/mailman/listinfo/dmd-beta

On Sat, Feb 16, 2013 at 09:49:01PM -0500, Nick Sabalausky wrote:
> On Sat, 16 Feb 2013 18:34:22 -0800
> Walter Bright <walter@digitalmars.com> wrote:
[...]
> > (It is a fast machine - 6 cores, 16Gb ram, it flies through the test suite!) _______________________________________________
> 
> Dayam!
[...]

I have a 6-core 32GB RAM machine. ;-)

Yet even I am running into out-of-memory problems when running Phobos' test suite in parallel. I used to be able to do it at -j6 (heck, sometimes I did -j8 just to max out the cores while some stuff is waiting on I/O), but nowadays the std.algorithm unittests for whatever reason take an incredible amount of memory to run -- or maybe it's DMD compiling the overly-gigantic std.algorithm clashing with whatever else is running ATM -- and even at -j2 or -j3 I risk seeing random OOM failures.

(But this is just my gut feeling, I didn't really look into what exactly was causing the OOMs. All I knew was that adding certain unittests to std.algorithm caused the test suite to OOM. Keeps my unittest-writing frenzy in check. :-P)


T

-- 
Some days you win; most days you lose.
_______________________________________________
dmd-beta mailing list
dmd-beta@puremagic.com
http://lists.puremagic.com/mailman/listinfo/dmd-beta

On Saturday, February 16, 2013 19:00:08 H. S. Teoh wrote:
> On Sat, Feb 16, 2013 at 09:49:01PM -0500, Nick Sabalausky wrote:
> > On Sat, 16 Feb 2013 18:34:22 -0800
> 
> > Walter Bright <walter@digitalmars.com> wrote:
> [...]
> 
> > > (It is a fast machine - 6 cores, 16Gb ram, it flies through the test suite!) _______________________________________________
> > 
> > Dayam!
> 
> [...]
> 
> I have a 6-core 32GB RAM machine. ;-)
> 
> Yet even I am running into out-of-memory problems when running Phobos' test suite in parallel. I used to be able to do it at -j6 (heck, sometimes I did -j8 just to max out the cores while some stuff is waiting on I/O), but nowadays the std.algorithm unittests for whatever reason take an incredible amount of memory to run -- or maybe it's DMD compiling the overly-gigantic std.algorithm clashing with whatever else is running ATM -- and even at -j2 or -j3 I risk seeing random OOM failures.
> 
> (But this is just my gut feeling, I didn't really look into what exactly was causing the OOMs. All I knew was that adding certain unittests to std.algorithm caused the test suite to OOM. Keeps my unittest-writing frenzy in check. :-P)

Anything template-heavy is going to have problems like this, and std.algorithm's unit tests are clearly going to be template-heavy. And the problem is worse on Windows, because dmd dies when it uses much more than 900MB. IIRC, there was a patch to the backend that was supposed to increase the amount of memory that it could use, but I don't know if it got merged or not, but regardless, it obviously isn't going to use anywhere near the full RAM on machine with 16GB or 32GB RAM, since it's a 32-bit process.

To fix the problem, the memory consumption of templates and CTFE needs to be reduced, and we probably need someone to sort out the GC that dmd has which doesn't work very well (at minimum, making it kick in when you go above some amount of memory usage would be a big improvement), but no one has spent time on that AFAIK.

- Jonathan M Davis
_______________________________________________
dmd-beta mailing list
dmd-beta@puremagic.com
http://lists.puremagic.com/mailman/listinfo/dmd-beta

On 2/17/13, Walter Bright <walter@digitalmars.com> wrote:
> Probably. I just have no idea how to do that :-(

Virtualbox works for me, and most new CPUs have hardware accelerated virtualization support.

On 2/17/13, Walter Bright <walter@digitalmars.com> wrote:
> (It is a fast machine - 6 cores, 16Gb ram, it flies through the test
> suite!)

I'm jealous. :p

Mine's only a quad-core, but it was a great value for the price (only
100$ for the CPU when it came out years ago, a steal).
_______________________________________________
dmd-beta mailing list
dmd-beta@puremagic.com
http://lists.puremagic.com/mailman/listinfo/dmd-beta

On Sun, 17 Feb 2013 04:56:03 +0100
Andrej Mitrovic <andrej.mitrovich@gmail.com> wrote:

> On 2/17/13, Walter Bright <walter@digitalmars.com> wrote:
> > Probably. I just have no idea how to do that :-(
> 
> Virtualbox works for me, and most new CPUs have hardware accelerated virtualization support.
> 

Sort of. Intel annoyingly uses hardware VM support to segregate their
market. With AMD you should be good, but with Intel it's more the
higher-end CPUs, and not the regular consumer-level ones.
_______________________________________________
dmd-beta mailing list
dmd-beta@puremagic.com
http://lists.puremagic.com/mailman/listinfo/dmd-beta

On 2/16/2013 7:17 PM, Jonathan M Davis wrote:
> IIRC, there was a patch to the backend that was supposed to increase
> the amount of memory that it could use, but I don't know if it got merged or
> not,

It did.
_______________________________________________
dmd-beta mailing list
dmd-beta@puremagic.com
http://lists.puremagic.com/mailman/listinfo/dmd-beta

On 2/16/2013 7:56 PM, Andrej Mitrovic wrote:
> On 2/17/13, Walter Bright <walter@digitalmars.com> wrote:
>> (It is a fast machine - 6 cores, 16Gb ram, it flies through the test
>> suite!)
> I'm jealous. :p
>
> Mine's only a quad-core, but it was a great value for the price (only
> 100$ for the CPU when it came out years ago, a steal).
>

I don't recall what I paid for it, but it was a cheapie from newegg.
_______________________________________________
dmd-beta mailing list
dmd-beta@puremagic.com
http://lists.puremagic.com/mailman/listinfo/dmd-beta

On 17 feb 2013, at 03:34, Walter Bright <walter@digitalmars.com> wrote:

> 
> On 2/16/2013 5:42 PM, Andrej Mitrovic wrote:
>> On 2/17/13, Walter Bright <walter@digitalmars.com> wrote:
>>> On 2/16/2013 4:23 PM, Nick Sabalausky wrote:
>>>> 'freebsd/lib32/libphobos2.a' appears to be old: 2012/11/15
>>>> 
>>> 
>>> It seems my ancient freebsd box is running out of memory.
>> Since you got yourself that new Win7 machine I bet it would run FreeBSD in a virtual machine faster than whatever box you have. :) _______________________________________________
>> 
> 
> Probably. I just have no idea how to do that :-(


Just install VirtualBox. Download an image with FreeBSD and install it in the virtual machine. Piece of cake :)

-- 
/Jacob Carlborg

_______________________________________________
dmd-beta mailing list
dmd-beta@puremagic.com
http://lists.puremagic.com/mailman/listinfo/dmd-beta

On 2/17/2013 3:23 AM, Jacob Carlborg wrote:
> On 17 feb 2013, at 03:34, Walter Bright <walter@digitalmars.com> wrote:
>
>> On 2/16/2013 5:42 PM, Andrej Mitrovic wrote:
>>> On 2/17/13, Walter Bright <walter@digitalmars.com> wrote:
>>>> On 2/16/2013 4:23 PM, Nick Sabalausky wrote:
>>>>> 'freebsd/lib32/libphobos2.a' appears to be old: 2012/11/15
>>>>>
>>>> It seems my ancient freebsd box is running out of memory.
>>> Since you got yourself that new Win7 machine I bet it would run
>>> FreeBSD in a virtual machine faster than whatever box you have. :)
>>> _______________________________________________
>>>
>> Probably. I just have no idea how to do that :-(
>
> Just install VirtualBox. Download an image with FreeBSD and install it in the virtual machine. Piece of cake :)
>

Hmm, does it install over Win7, or would I have to reinstall Win7?
_______________________________________________
dmd-beta mailing list
dmd-beta@puremagic.com
http://lists.puremagic.com/mailman/listinfo/dmd-beta

VirtualBox runs inside win7 as an application.

On Sun, Feb 17, 2013 at 10:37 PM, Walter Bright <walter@digitalmars.com>wrote:

>
> On 2/17/2013 3:23 AM, Jacob Carlborg wrote:
>
>> On 17 feb 2013, at 03:34, Walter Bright <walter@digitalmars.com> wrote:
>>
>>  On 2/16/2013 5:42 PM, Andrej Mitrovic wrote:
>>>
>>>> On 2/17/13, Walter Bright <walter@digitalmars.com> wrote:
>>>>
>>>>> On 2/16/2013 4:23 PM, Nick Sabalausky wrote:
>>>>>
>>>>>> 'freebsd/lib32/libphobos2.a' appears to be old: 2012/11/15
>>>>>>
>>>>>>  It seems my ancient freebsd box is running out of memory.
>>>>>
>>>> Since you got yourself that new Win7 machine I bet it would run FreeBSD in a virtual machine faster than whatever box you have. :) ______________________________**_________________
>>>>
>>>>  Probably. I just have no idea how to do that :-(
>>>
>>
>> Just install VirtualBox. Download an image with FreeBSD and install it in the virtual machine. Piece of cake :)
>>
>>
> Hmm, does it install over Win7, or would I have to reinstall Win7?
>
> ______________________________**_________________
> dmd-beta mailing list
> dmd-beta@puremagic.com
> http://lists.puremagic.com/**mailman/listinfo/dmd-beta<http://lists.puremagic.com/mailman/listinfo/dmd-beta>
>