On Sunday, June 02, 2013 16:42:12 Ellery Newcomer wrote:
> I thought the packages were generated using the scripts at
> 
> https://github.com/D-Programming-Language/installer/tree/master/linux
> 
> which pull the zip files from ftp.digitalmars.com

They may. I don't know what the current process is with regards to the rpms and debs, but that would mean that they are indeed using the zips, which is why you're having the problems that you're having.

> What would an automated process look like? I would think something like a script which makes a tarball out of the git repos and then some more which turn the tarball into rpm or deb or what have you?

Something like that. The autotester is already doing that sort of thing for building and running the unit tests. It shouldn't be that hard to make it then generate the correct packages as part of that for the cases where we want it, and if done right, the same process could be used on other boxes.

- Jonathan M Davis

On 6/2/2013 2:52 PM, Russel Winder wrote:
> Not being able to put symlinks in a zipfile has nothing to do with
> getting deb files and RPM files correct since they should be built from
> tarballs.

Anyone is welcome to help out with the scripts that create deb and rpm files, which are here:

  https://github.com/D-Programming-Language/installer

On Sunday, June 02, 2013 16:50:00 Walter Bright wrote:
> It already is broken up per OS:
> 
>    http://dlang.org/download.html

But the _zip_ file isn't. We keep asking for _that_ to be broken up. That's completely separate from whatever is going on with rpms or debs or exe installers. Plenty of people just use the zip file, and they don't want to have to download dmd for every OS it supports. And we are now having issues with symlinks because of the way the zip currently works. If we had a tarball for linux (or FreeBSD or Mac OS X, etc.), then that could trivially have the symlinks be correct, and the rpms and debs colud be correctly generated as well. Clearly, having everything in one zip is causing problems.

- Jonathan M Davis

On 06/02/2013 04:50 PM, Jonathan M Davis wrote:
> On Sunday, June 02, 2013 16:42:12 Ellery Newcomer wrote:
>> I thought the packages were generated using the scripts at
>>
>> https://github.com/D-Programming-Language/installer/tree/master/linux
>>
>> which pull the zip files from ftp.digitalmars.com
>
> They may. I don't know what the current process is with regards to the rpms
> and debs, but that would mean that they are indeed using the zips, which is
> why you're having the problems that you're having.
>
>> What would an automated process look like? I would think something like
>> a script which makes a tarball out of the git repos and then some more
>> which turn the tarball into rpm or deb or what have you?
>
> Something like that. The autotester is already doing that sort of thing for
> building and running the unit tests. It shouldn't be that hard to make it then
> generate the correct packages as part of that for the cases where we want it,
> and if done right, the same process could be used on other boxes.
>
> - Jonathan M Davis
>

where is this mythical autotester, anyways?

On Sunday, June 02, 2013 16:52:03 Walter Bright wrote:
> On 6/2/2013 2:52 PM, Russel Winder wrote:
> > Not being able to put symlinks in a zipfile has nothing to do with getting deb files and RPM files correct since they should be built from tarballs.
> 
> Anyone is welcome to help out with the scripts that create deb and rpm files, which are here:
> 
>    https://github.com/D-Programming-Language/installer

Well, Nick is looking into some of that stuff. Hopefully, he'll be able to sort it out.

- Jonathan M Davis

On 6/2/2013 4:54 PM, Jonathan M Davis wrote:
> On Sunday, June 02, 2013 16:50:00 Walter Bright wrote:
>> It already is broken up per OS:
>>
>>     http://dlang.org/download.html
>
> But the _zip_ file isn't. We keep asking for _that_ to be broken up.

There's no reason to, as broken up ones are available for each system.

On Sunday, June 02, 2013 16:57:08 Ellery Newcomer wrote:
> where is this mythical autotester, anyways?

Mythical? Oh ye of little faith:

http://d.puremagic.com/test-results/

dmd, druntime, and Phobos are built are their unit tests run after every commit. And the pull tester ( http://d.puremagic.com/test-results/pulls.ghtml?projectid=1 ) tests every pull request the same way (if the submitter is on the whitelist anyway). The code for the auto tester can be found here:

https://github.com/braddr/d-tester

- Jonathan M Davis

On Sunday, June 02, 2013 17:08:41 Walter Bright wrote:
> On 6/2/2013 4:54 PM, Jonathan M Davis wrote:
> > On Sunday, June 02, 2013 16:50:00 Walter Bright wrote:
> >> It already is broken up per OS:
> >>     http://dlang.org/download.html
> > 
> > But the _zip_ file isn't. We keep asking for _that_ to be broken up.
> 
> There's no reason to, as broken up ones are available for each system.

Except that those are rpms and debs and whatnot which are different. I'm far from the first to bring this up. It has been brought up repeatedly for quite some time that folks don't want the zip to contain everything. They want to get the zip (or tarball) for their specific OS and that's it. Using an rpm and deb is fundamentally different, and if that were enough, why do we even have the zip? Separating the OSes out and having an installer are two separate issues (much as they have to be separated out for the installers), and most of us want the zip to be separated. I don't think that much of anyone around here thinks that the zip should contain all of the OSes. I believe that you're the only one that's actually thought that it was a good idea whenever it's been discussed. And the zip is only going to get bigger and bigger as we add shared library support (and possibly more OSes in the future).

Regardless, the symlink issue alone shows that using the zip file format for *nix is a mistake. Any packages released for *nix needs to support symlinks correctly.

- Jonathan M Davis

On 06/02/2013 05:08 PM, Jonathan M Davis wrote:
> On Sunday, June 02, 2013 16:57:08 Ellery Newcomer wrote:
>> where is this mythical autotester, anyways?
>
> Mythical? Oh ye of little faith:
>
> http://d.puremagic.com/test-results/
>
> dmd, druntime, and Phobos are built are their unit tests run after every
> commit. And the pull tester ( http://d.puremagic.com/test-results/pulls.ghtml?projectid=1 ) tests every pull request the same way (if
> the submitter is on the whitelist anyway). The code for the auto tester can be
> found here:
>
> https://github.com/braddr/d-tester
>
> - Jonathan M Davis
>

what distro are those linux tests performed on?

On 06/02/2013 05:15 PM, Jonathan M Davis wrote:
> On Sunday, June 02, 2013 17:08:41 Walter Bright wrote:
>
> Regardless, the symlink issue alone shows that using the zip file format for
> *nix is a mistake. Any packages released for *nix needs to support symlinks
> correctly.
>
> - Jonathan M Davis
>

Is it so hard to convert the zip to tarball in the installer scripts?

(hint: no)