7 ms·
An update on container support on Google Cloud Platform
- jbeda 12y agoWe are particularly excited about Kubernetes. We are taking the ideas for how we do cluster management at Google and creating an open source project to manage Docker containers. https://github.com/GoogleCloudPlatform/kubernetes https://github.com/GoogleCloudPlatform/kubernetes
- deleted 12y ago[deleted]
- boundlessdreamz 12y agoSlightly offtopic - I haven't used docker yet but can docker be used to run Ubuntu on GCE? That seems to be possible by using a ubuntu base image?
- patrickaljord 12y agoYes, it is.
- wmf 12y agoUbuntu can run directly on GCE. http://doit-intl.com/blog/2014/5/31/how-to-install-ubuntu-server-on-gce http://doit-intl.com/blog/2014/5/31/how-to-install-ubuntu-se...
- tonfa 12y agoWow, why is it so complicated? Can't you do it from the console?
- martythemaniak 12y agoBecause they don't have ready-made ubuntu images, so you have to make your own first. The simpler solution is to use their ready-made Debian images, which can be easily configured via CLI or API.
- nivertech 12y agoNote that some Google's Debian Wheezy images are specifically optimized for their Andromeda SDN [1], especially when they running on us-central1-b or europe-west1-a zones, where Andromeda is enabled [2]. Also Ubuntu 14.04 LTS has much worse performance than Ubuntu 12.04 LTS, so it's better to stick to 12.04 LTS for now. In my opinion it's better to port to Debian or to run Ubuntu image inside container hosted on Debian, until they will have native Ubuntu support. [1] http://gigaom.com/2014/04/02/google-launches-andromeda-a-software-defined-network-underlying-its-cloud/ http://gigaom.com/2014/04/02/google-launches-andromeda-a-sof... [2] http://googlecloudplatform.blogspot.co.il/2014/04/enter-andromeda-zone-google-cloud-platforms-latest-networking-stack.html http://googlecloudplatform.blogspot.co.il/2014/04/enter-andr...
- planckscnst 12y agoThis post was written by Eric Brewer, the author of CAP theorem.
- mp99e99 12y agoIs that the same Eric Brewer from Inktomi?
- michaelmior 12y agoYes, that's him :)
- seiji 12y agoI imagine he's done some noteworthy things since? That's like introducing Elon Musk as "Founder of X.com." Essentially it comes across as "I'm a fan of your early work, but nothing you've done since matters."
- planckscnst 12y agoHe's done a bunch of stuff, but CAP is probably his most popular work. Even Wikipedia says that's what he's "known for".
- deleted 12y ago[deleted]
- michaelmior 12y ago"Everything at Google, from Search to Gmail, is packaged and run in a Linux container." Was this something which Google had previously disclosed? Seems a bit surprising to me.
- jbeda 12y agoYeah -- I talked about it a couple of weeks ago at GlueCon. Also shared that we launch over 2 billion containers every week. My slides from the talk: https://speakerdeck.com/jbeda/containers-at-scale https://speakerdeck.com/jbeda/containers-at-scale PDF: http://slides.eightypercent.net/GlueCon%202014%20-%20Containers%20At%20Scale.pdf http://slides.eightypercent.net/GlueCon%202014%20-%20Contain...
- michaelmior 12y agoThanks for the link!
- zmanian 12y agoI went to a talk on Omega on Box.com about a year ago. At that point Omega was still about managing Google's giant statically linked binaries. Did Google switch to containers in a year? Maybe that answer is in your slides? If so crazy...
- zeroxfe 12y agoThe statically linked binaries run inside the containers. Static linking gives you a certain kind of portability (no need for library dependencies on the machine.) The containers give you isolation, resource management, etc.
- zmanian 12y agoThe way it has been explained to me is that Google's fat binaries have no dependencies beyond libc. The task scheduler would just have to deploy that one file to one or more machines to get it to run. Containers are much more flexible that statically linked binaries. You could have multiple binaries in a container sharing a common set of dynamically linked files. Fat binaries inside containers sounds a bit like the worst of both worlds...
- PanMan 12y agoI know Google runs at a huge scale, but isn't even for them 2 billion containers / week a LOT? I assume a lot of these only run for a really short time? Are containers the new scripts?
- jbeda 12y agoI can't give specifics but a lot of these are short lived. For example, if you launch a MapReduce it'll typically launch containers for each of the workers and then take them down when the MR is done. This also doesn't speak to the number of long running containers. There are plenty that don't stop/start during the week I grabbed that number.
- derefr 12y agoIf docker images are fancy static binaries, then docker containers are fancy OS processes. Going through two billion OS PIDs in a week doesn't seem that hard.
- martinp 12y agoStill seems like a lot, 2 billion a week is over 3300 every second. Says a lot about the scale at which Google operates.
- planckscnst 12y ago_The Datacenter as a Computer_ [1] is a free book written by Googlers that helps get your head around that scale. [1] http://www.morganclaypool.com/doi/abs/10.2200/S00516ED2V01Y201306CAC024 http://www.morganclaypool.com/doi/abs/10.2200/S00516ED2V01Y2...
- cmelbye 12y ago> Are containers the new scripts? They certainly seem to work well for that. Heroku, for example, uses containers for not just persistent processes (application servers, workers) but also short-lived processes. Tasks that run on a schedule (hourly, daily, etc.) are run by, you guessed it, starting up a container running a processes which exits when it's finished. One-off commands like maintenance scripts or REPLs work the same way.