Thread overview
dubproxy: Easy private repos and code.dlang.org mirror
Aug 16, 2019
Robert Schadek
Aug 16, 2019
Robert Schadek
Aug 19, 2019
Guillaume Piolat
Aug 19, 2019
Andre Pany
Jun 25, 2020
Andre Pany
August 16, 2019
# dubproxy

dubproxy is a library and cli to efficently use private dub packages and mirror
code.dlang.org, all without a private registry.
It is a standalone library/cli and is completely transparent for dub.

## private libraries

Sometimes a dub project needs access to private library.
Subpackages are one solution, but getting dub to correctly work with subpackages
is not always easy.
Therefor, it is sometimes desirable to complete split out subpackages into there
own dub project.
Dubproxy allows to do that.
One of dubproxy's features is to take local/remote dub projects, located in a
git, and insert them into ~/.dub/packages such that dub thinks its just another
package from code.dlang.org.

## code.dlang.org mirroring

Code.dlang.org is not always accessible, but a still might be required right
now.
Maybe you are on a flight to dconf or code.dlang.org is down.
Dubproxy allows you to get a storable list of all packages and upstream urls.
This list can then be used by dubproxy to get a particular package or
package-version.
You need internet access of course.
As time of writing this Aug. 2019 all gits of all package of code.dlang.org
require about 6.5 GB of space.

## Examples

1. Get dubproxy(cli)
```sh
$ dub fetch dubproxy
$ dub run dubproxy
```

2. put dubproxy in your path or use `$ dub run dubproxy --`
3. get list of code.dlang.org packages
```sh
$ dubproxy -m -n codedlangorg.json
```

4. get a package from a dubproxyfile
```sh
$ dubproxy -i codedlangorg.json -g xlsxd
```
By default dubproxy will try to place the git in system default dub directory.

5. get a package and place the git a user specified directory
```sh
$ dubproxy -i codeldangorg.json -g xlsxreader -f GitCloneFolder
$ dubproxy -i codeldangorg.json -g xlsxreader:v0.6.1 -f GitCloneFolder
```

6. place the dub package in a user specified directory
```sh
$ dubproxy -i codeldangorg.json -g graphqld -o SomePackageFolder
```

7. get multiple packages
```sh
$ dubproxy -i codeldangorg.json -g graphqld -g inifiled
```

8. get all packages in a file (run before long flight)
```sh
$ dubproxy -i codeldangorg.json -a -u
```

The `-u` is necessary to disable user interaction, because some listed packages
on code.dlang.org do not exist anymore and github.com therefore askeds for a
username password combination.

9. dub is not in your path
```sh
$ dubproxy -d path_to_dub
```

10. git is not in your path
```sh
$ dubproxy -p path_to_git
```

11. generate a dummy dubproxy.json file with filename myPrivateProjects.json
```sh
$ dubproxy --dummy --dummyPath myPrivateProjects.json
```

12. get help
```sh
$ dubproxy -h
```

## PRs are always welcome!

About Kaleidic Associates
-------------------------
We are a boutique consultancy that advises a small number of hedge fund clients.
We are not accepting new clients currently, but if you are interested in working
either remotely or locally in London or Hong Kong, and if you are a talented
hacker with a moral compass who aspires to excellence then feel free to drop me
a line: laeeth at kaleidic.io

We work with our partner Symmetry Investments, and some background on the firm
can be found here:

http://symmetryinvestments.com/about-us/

August 16, 2019
classic noob error: forget the urls

* https://code.dlang.org/packages/dubproxy
* https://github.com/symmetryinvestments/dubproxy

August 19, 2019
On Friday, 16 August 2019 at 14:31:14 UTC, Robert Schadek wrote:
> classic noob error: forget the urls
>
> * https://code.dlang.org/packages/dubproxy
> * https://github.com/symmetryinvestments/dubproxy

UP

This sounds super useful for those of use stuck with path-based dependencies. Easier than self-hosting a DUB registry probably?
August 19, 2019
On Monday, 19 August 2019 at 15:11:54 UTC, Guillaume Piolat wrote:
> On Friday, 16 August 2019 at 14:31:14 UTC, Robert Schadek wrote:
>> classic noob error: forget the urls
>>
>> * https://code.dlang.org/packages/dubproxy
>> * https://github.com/symmetryinvestments/dubproxy
>
> UP
>
> This sounds super useful for those of use stuck with path-based dependencies. Easier than self-hosting a DUB registry probably?

As side remark, in addition to self-hosting a Dub registry in the meantime you can also use a Maven repository (artifactory/nexus) or just use a local folder/network folder (using Dub file system provider).

Ok, we should add some more info to Dub help page explaining the different repository providers (dub/maven/file system).

Kind regards
Andre
August 20, 2019
On Monday, 19 August 2019 at 15:29:55 UTC, Andre Pany wrote:
[...]
>
> Ok, we should add some more info to Dub help page explaining the different repository providers (dub/maven/file system).
>
Yes! Please :-)
June 25, 2020
On Tuesday, 20 August 2019 at 10:24:41 UTC, Martin Tschierschke wrote:
> On Monday, 19 August 2019 at 15:29:55 UTC, Andre Pany wrote:
> [...]
>>
>> Ok, we should add some more info to Dub help page explaining the different repository providers (dub/maven/file system).
>>
> Yes! Please :-)

Finally you can find the information here:
https://dub.pm/package-suppliers

Kind regards
André