Jump to page: 1 2
Thread overview
Slides share: DMesos - Not only a re-implementation of Mesos
Jul 10, 2017
鲜卑拓跋枫
Jul 10, 2017
Joakim
Jul 10, 2017
Joakim
Jul 13, 2017
Patrick Schluter
Jul 10, 2017
Andy Smith
Jul 12, 2017
鲜卑拓跋枫
Jul 12, 2017
鲜卑拓跋枫
Jul 13, 2017
Iain Buclaw
Jul 15, 2017
鲜卑拓跋枫
Jul 15, 2017
Iain Buclaw
Jul 16, 2017
鲜卑拓跋枫
Jul 14, 2017
Dsby
Jul 15, 2017
鲜卑拓跋枫
Jul 15, 2017
鲜卑拓跋枫
Jul 16, 2017
Dsby
Jul 18, 2017
鲜卑拓跋枫
July 10, 2017
Dear all,
   I am a D-language amateur from China, and just want to share you with a slides from me that post on MesosCon Asia 2017(Beijing):
   https://mesosconasia2017.sched.com/event/AZc6/dmesos-not-only-a-re-implementation-of-mesos-ce-feng-li-emc#
   I do really wanna to implement the design or "dream" as described in this slides,
your help and suggestion are very welcome!
   Thanks!

BRs,
Koo
July 10, 2017
On Monday, 10 July 2017 at 17:29:01 UTC, 鲜卑拓跋枫 wrote:
> Dear all,
>    I am a D-language amateur from China, and just want to share you with a slides from me that post on MesosCon Asia 2017(Beijing):
>    https://mesosconasia2017.sched.com/event/AZc6/dmesos-not-only-a-re-implementation-of-mesos-ce-feng-li-emc#
>    I do really wanna to implement the design or "dream" as described in this slides,
> your help and suggestion are very welcome!
>    Thanks!

Wow, you've done your research!  Lot of good D stuff in those slides, nice to see the ldc team's work on ARM and GPUs has been noticed (glad to see a mention of my Android builds too).

I had never heard of Mesos until now, shows how I don't track cloud at all.  I'm actually skeptical of cloud- I think mobile p2p will eat most of the cloud- but a lot of these distributed D cloud libraries you want can be repurposed for mobile too.
July 10, 2017
On 07/10/2017 02:16 PM, Joakim wrote:
> I'm actually skeptical of cloud- I think mobile p2p will eat most of the cloud-

I've been REALLY hoping p2p will eat...cloud^H^H^H^H^Hcentralized internet services[1], but if I were a betting man I'd bet heavily against it. For one thing, for p2p to kill "cloud" we'd realistically need IPv6 to become much more ubiquitous, and that just isn't happening.

And I think the #2 reason IPv6 isn't happening (behind plain old inertia) is that it would *allow* p2p to overtake cloud. Which brings me to the next reason I don't think p2p will kill "cloud": All the big players with all the money and the power all LOVE "cloud" because it allows them to hoard more power, control and money, whereas p2p would completely destroy that frontier for them.

Also, replacing "cloud" with p2p would mean more reliance on user's devices actually having decent storage and upload bandwidth, but non-power-users (ie the vast majority of people, if you don't live in hipster valley) are ambivalent towards that, and it would raise the price of their devices, AND they don't want to deal with running low on storage, or backing things up, so they love "cloud" too.

Both the engineer and the humanitarian in me both REALLY want to see p2p eat "cloud", but I just don't see it realistically happening.

[1] The word "clould" bugs me to no end. It's the tech sector's equivalent to "smurf" - stupid word is used to mean *anything* internet-releated, even "internet" itself.
July 10, 2017
On Monday, 10 July 2017 at 18:45:34 UTC, Nick Sabalausky (Abscissa) wrote:
> On 07/10/2017 02:16 PM, Joakim wrote:
>> I'm actually skeptical of cloud- I think mobile p2p will eat most of the cloud-
>
> I've been REALLY hoping p2p will eat...cloud^H^H^H^H^Hcentralized internet services[1], but if I were a betting man I'd bet heavily against it. For one thing, for p2p to kill "cloud" we'd realistically need IPv6 to become much more ubiquitous, and that just isn't happening.

I don't think it's necessary, but it would be nice to have.

> And I think the #2 reason IPv6 isn't happening (behind plain old inertia) is that it would *allow* p2p to overtake cloud.

I think you underestimate how well ipv6 has already done on mobile:

https://blogs.akamai.com/2016/06/preparing-for-ipv6-only-mobile-networks-why-and-how.html

That post is now more than a year old, extrapolate accordingly.

> Which brings me to the next reason I don't think p2p will kill "cloud": All the big players with all the money and the power all LOVE "cloud" because it allows them to hoard more power, control and money, whereas p2p would completely destroy that frontier for them.

Sure, many of the big tech players have built or are building giant cloud businesses, so they're not going to be interested in p2p, especially since there's no proven p2p business model.  Look at how BitTorrent Inc. floundered for more than a decade, before finally sinking recently.

This just means someone new will have to come in and knock the big boys off, maybe you. ;)

> Also, replacing "cloud" with p2p would mean more reliance on user's devices actually having decent storage and upload bandwidth, but non-power-users (ie the vast majority of people, if you don't live in hipster valley) are ambivalent towards that, and it would raise the price of their devices, AND they don't want to deal with running low on storage, or backing things up, so they love "cloud" too.

A midrange smartphone or tablet these days comes with 2-3 GBs of RAM, 32-64 GBs of flash storage, an ARM chip about as powerful as a desktop chip from 3-5 years ago, and a 4G LTE chip that provides dozens of Mbits/s both ways.  Please tell me what they're missing, you can buy all that for $200-300.

> Both the engineer and the humanitarian in me both REALLY want to see p2p eat "cloud", but I just don't see it realistically happening.

All you have to think about is whether the hardware is capable enough: we both know that it is.  Then, the software will flow downhill to where it can be executed most cheaply and reliably, _once_ there's a p2p business model.  It may take time for the dumb engineers to figure this out, but someone finally will, and when he strikes gold, the p2p gold rush will follow.

> [1] The word "clould" bugs me to no end. It's the tech sector's equivalent to "smurf" - stupid word is used to mean *anything* internet-releated, even "internet" itself.

Heh, I was surprised recently to hear someone actually use the term as a real "cloud," ie they were referring to both mobile devices and servers in the data server, a true distributed cloud.  But yeah, most of the time it's just a new buzzword for ye olde client-server computing.
July 10, 2017
On Monday, 10 July 2017 at 17:29:01 UTC, 鲜卑拓跋枫 wrote:
> Dear all,
>    I am a D-language amateur from China, and just want to share you with a slides from me that post on MesosCon Asia 2017(Beijing):
>    https://mesosconasia2017.sched.com/event/AZc6/dmesos-not-only-a-re-implementation-of-mesos-ce-feng-li-emc#
>    I do really wanna to implement the design or "dream" as described in this slides,
> your help and suggestion are very welcome!
>    Thanks!
>
> BRs,
> Koo

Wow - very cool stuff. Wish I could have heard the talk - was it recorded at all? D could really benefit from some sort of 'project X' that will propel it to the next level. (Much like rails did for ruby, numpy/pandas did for python, akka/spark for scala). A D re-implementation of the mesos/akka/raft stack was one of the things that could be it.

Best of luck with the project. I'll be watching it with a lot of interest!

Cheers,

A.

July 12, 2017
On Monday, 10 July 2017 at 20:45:01 UTC, Andy Smith wrote:
> On Monday, 10 July 2017 at 17:29:01 UTC, 鲜卑拓跋枫 wrote:
>> Dear all,
>>    I am a D-language amateur from China, and just want to share you with a slides from me that post on MesosCon Asia 2017(Beijing):
>>    https://mesosconasia2017.sched.com/event/AZc6/dmesos-not-only-a-re-implementation-of-mesos-ce-feng-li-emc#
>>    I do really wanna to implement the design or "dream" as described in this slides,
>> your help and suggestion are very welcome!
>>    Thanks!
>>
>> BRs,
>> Koo
>
> Wow - very cool stuff. Wish I could have heard the talk - was it recorded at all? D could really benefit from some sort of 'project X' that will propel it to the next level. (Much like rails did for ruby, numpy/pandas did for python, akka/spark for scala). A D re-implementation of the mesos/akka/raft stack was one of the things that could be it.
>
> Best of luck with the project. I'll be watching it with a lot of interest!
>
> Cheers,
>
> A.

In general, the videos of MesosCon will be uploaded to Youtube within one or two month. But unfortunately, I gave the talk in Chinese since the content of this slides is relatively rich and my English is poor:).
July 12, 2017
On Monday, 10 July 2017 at 17:29:01 UTC, 鲜卑拓跋枫 wrote:
> Dear all,
>    I am a D-language amateur from China, and just want to share you with a slides from me that post on MesosCon Asia 2017(Beijing):
>    https://mesosconasia2017.sched.com/event/AZc6/dmesos-not-only-a-re-implementation-of-mesos-ce-feng-li-emc#
>    I do really wanna to implement the design or "dream" as described in this slides,
> your help and suggestion are very welcome!
>    Thanks!
>
> BRs,
> Koo


Thanks to your attention!
As this slides exposed: I do have some ideas about implement the data center in D language via kernel space/user space/runtime repartition and redesign, the corresponding experiments are on the way, but many technical challenges still need to be overcome, I will update relevant information timely.
July 13, 2017
On Monday, 10 July 2017 at 18:45:34 UTC, Nick Sabalausky (Abscissa) wrote:
> On 07/10/2017 02:16 PM, Joakim wrote:
>> I'm actually skeptical of cloud- I think mobile p2p will eat most of the cloud-
>
> I've been REALLY hoping p2p will eat...cloud^H^H^H^H^Hcentralized internet services[1], but if I were a betting man I'd bet heavily against it. For one thing, for p2p to kill "cloud" we'd realistically need IPv6 to become much more ubiquitous, and that just isn't happening.
>
> And I think the #2 reason IPv6 isn't happening (behind plain old inertia) is that it would *allow* p2p to overtake cloud. Which brings me to the next reason I don't think p2p will kill "cloud": All the big players with all the money and the power all LOVE "cloud" because it allows them to hoard more power, control and money, whereas p2p would completely destroy that frontier for them.
>
> Also, replacing "cloud" with p2p would mean more reliance on user's devices actually having decent storage and upload bandwidth, but non-power-users (ie the vast majority of people, if you don't live in hipster valley) are ambivalent towards that, and it would raise the price of their devices, AND they don't want to deal with running low on storage, or backing things up, so they love "cloud" too.
>
> Both the engineer and the humanitarian in me both REALLY want to see p2p eat "cloud", but I just don't see it realistically happening.
>
> [1] The word "clould" bugs me to no end. It's the tech sector's equivalent to "smurf" - stupid word is used to mean *anything* internet-releated, even "internet" itself.

May be this companay can make it happen
http://www.piedpiper.com/
;-)
July 13, 2017
On Monday, 10 July 2017 at 17:29:01 UTC, 鲜卑拓跋枫 wrote:
> Dear all,
>    I am a D-language amateur from China, and just want to share you with a slides from me that post on MesosCon Asia 2017(Beijing):
>    https://mesosconasia2017.sched.com/event/AZc6/dmesos-not-only-a-re-implementation-of-mesos-ce-feng-li-emc#
>    I do really wanna to implement the design or "dream" as described in this slides,
> your help and suggestion are very welcome!
>    Thanks!
>

GDC:
 - complete support armel, armhf
 - partial or bare-metal only support aarch64


Only bare-metal? As far as I'm concerned, all targets have full compiler support.  The druntime and phobos libraries less so on that front. ;-)

Iain.
July 14, 2017
On Monday, 10 July 2017 at 17:29:01 UTC, 鲜卑拓跋枫 wrote:
> Dear all,
>    I am a D-language amateur from China, and just want to share you with a slides from me that post on MesosCon Asia 2017(Beijing):
>    https://mesosconasia2017.sched.com/event/AZc6/dmesos-not-only-a-re-implementation-of-mesos-ce-feng-li-emc#
>    I do really wanna to implement the design or "dream" as described in this slides,
> your help and suggestion are very welcome!
>    Thanks!
>
> BRs,
> Koo

我也希望能用D做出来。
我们也在研究过raft, akka这些技术。 raft算法的翻译我同事也有个port到D版本的。只是具体什么样,我没参与也没关心。
我们也在上海,我看链接里介绍,你现在也在上海工作,在EMC?
只是不知道你们开始做没?
« First   ‹ Prev
1 2