Thread overview | ||||||||
---|---|---|---|---|---|---|---|---|
|
January 15, 2017 Silvermirror to mirror websites | ||||
---|---|---|---|---|
| ||||
Github: https://github.com/dhasenan/silvermirror Silvermirror is a tool to mirror websites -- download them locally and serve copies of them. Compared to wget, which is the standard tool, its advantages are: * Resumability * Reduced memory usage (at least 20x in my tests) * Consistent URL mapping * Correctness (fewer assumptions about URL/file mapping) * Human-readable output * A simple builtin template engine * An index of pages available Future directions: * Integrated fulltext search * Better templates * Better excludes |
January 15, 2017 Re: Silvermirror to mirror websites | ||||
---|---|---|---|---|
| ||||
Posted in reply to Chris Wright | You forgot to add a license/unlicense... |
January 15, 2017 Re: Silvermirror to mirror websites | ||||
---|---|---|---|---|
| ||||
Posted in reply to Dukc | On Sun, 15 Jan 2017 09:53:16 +0000, Dukc wrote:
> You forgot to add a license/unlicense...
Thanks, fixed! MIT licensed, unless someone needs it under another.
|
January 15, 2017 Re: Silvermirror to mirror websites | ||||
---|---|---|---|---|
| ||||
Posted in reply to Chris Wright | On Sunday, 15 January 2017 at 02:28:34 UTC, Chris Wright wrote:
> Github: https://github.com/dhasenan/silvermirror
>
> Silvermirror is a tool to mirror websites -- download them locally and serve copies of them.
What is the version of D that Silvermirror is compiled under ?
Nick
|
January 15, 2017 Re: Silvermirror to mirror websites | ||||
---|---|---|---|---|
| ||||
Posted in reply to Nick B | On Sun, 15 Jan 2017 21:30:47 +0000, Nick B wrote:
> On Sunday, 15 January 2017 at 02:28:34 UTC, Chris Wright wrote:
>> Github: https://github.com/dhasenan/silvermirror
>>
>> Silvermirror is a tool to mirror websites -- download them locally and serve copies of them.
>
>
> What is the version of D that Silvermirror is compiled under ?
>
> Nick
I'm still on 2.071.1. Are you experiencing issues on another version?
|
January 16, 2017 Re: Silvermirror to mirror websites | ||||
---|---|---|---|---|
| ||||
Posted in reply to Chris Wright | On Sunday, 15 January 2017 at 23:32:34 UTC, Chris Wright wrote: > On Sun, 15 Jan 2017 21:30:47 +0000, Nick B wrote: > > > I'm still on 2.071.1. Are you experiencing issues on another version? No, just checking. Thanks Nick |
Copyright © 1999-2021 by the D Language Foundation