Thread overview |
---|
April 10, 2016 vibe.d kafka driver & probabilistic linear counting | ||||
---|---|---|---|---|
| ||||
we pushed 2 new projects: a native kafka driver to work with the vibe.d eventloop http://code.dlang.org/packages/kafka-d it's not full featured yet (no zookeeper) but the basic use cases work fine. throughput depends on the buffer sizes but we achieved gigabit speeds in benchmarks. thanks to Piotr for most of the implementation. after unsuccessful C bindings to redis hyperloglog datastructure i came to the conclusion that a linear probabilistc counter should be sufficient for many use cases. even contains some optimizations for UUID. thanks Ilya for the implementation: http://code.dlang.org/packages/lincount |
April 11, 2016 Re: vibe.d kafka driver & probabilistic linear counting | ||||
---|---|---|---|---|
| ||||
Posted in reply to yawniek | On Sunday, 10 April 2016 at 10:51:38 UTC, yawniek wrote: > we pushed 2 new projects: > > a native kafka driver to work with the vibe.d eventloop > http://code.dlang.org/packages/kafka-d > it's not full featured yet (no zookeeper) but the basic use cases work fine. > throughput depends on the buffer sizes but we achieved gigabit speeds in benchmarks. > thanks to Piotr for most of the implementation. The news on Kafka are really great! Thanks a lot for the work! Did you inform the Kafka developers that there is a new language supported? Maybe this could be added to this Wiki page which lists all supported libs and languages: https://cwiki.apache.org/confluence/display/KAFKA/Clients. Regards, André |
April 12, 2016 Re: vibe.d kafka driver & probabilistic linear counting | ||||
---|---|---|---|---|
| ||||
Posted in reply to André | On Monday, 11 April 2016 at 09:08:34 UTC, André wrote:
> On Sunday, 10 April 2016 at 10:51:38 UTC, yawniek wrote:
>> we pushed 2 new projects:
>>
>> a native kafka driver to work with the vibe.d eventloop
>> http://code.dlang.org/packages/kafka-d
>> it's not full featured yet (no zookeeper) but the basic use cases work fine.
>> throughput depends on the buffer sizes but we achieved gigabit speeds in benchmarks.
>> thanks to Piotr for most of the implementation.
>
> The news on Kafka are really great! Thanks a lot for the work! Did you inform the Kafka developers that there is a new language supported? Maybe this could be added to this Wiki page which lists all supported libs and languages: https://cwiki.apache.org/confluence/display/KAFKA/Clients.
>
> Regards,
> André
Not yet, i have too little outside feedback yet. So please test and fill tickets with bugs/feature requests on gh
|
Copyright © 1999-2021 by the D Language Foundation