Endocode is a company inspired and driven by open source methodologies. It is safe to say that we have touched bases with this company called Red Hat in the past. Founded more than 20 years ago, Red Hat has been busy proving that the open source way of developing and contributing software - collaboratively, transparent and meritocratic - is the future of IT. Today, Red Hat is the world’s leading provider of open source enterprise IT products, with it’s main areas of technologies being middleware, operating system, virtualization, storage, mobile and cloud computing.
cc-by-sa 3.0 Thomas Wegner/Berlin Buzzwords (no changes made) Last week was a busy week. Endocode was spread out across Europe, listening and contributing to the newest buzz. While some of our team were in Amsterdam at the GCP Next, finding out what’s new in Kubernetes 1.3, Endocode’s Thomas Fricke was contributing at the Berlin Buzzwords. It was the seventh time that the Berlin Buzzwords brought interesting and inspiring people together, to listen to keynotes and talks, ask questions and discuss ideas and experiences.
In our world of DevOps and Open Source, February is a month to look forward to. Like a fusion of Christmas and Easter, FOSDEM and Config Management Camp bring together developers of free and Open Source software and create a feast of conversation, contribution and fantastic meetings. Endocode’s Sebastian Sucker, Matthias Schmitz and Julian Strobl took a little trip to Belgium this year and enjoyed the wonders that could be found at Config Management Camp 2016 in Gent.
Check out our self-made Kubernetes Cluster made of Rasperry Pis @cfgmgmtcamp! Credit: Matthias Schmitz It’s time for Open Source Events, it’s time for FOSDEM and it’s time for Config Management Camp. Endocode will be right in the middle of it: We are proud to be a part of Config Management Camp 2016 in Gent. Endocode’s Julian Strobl will give an exciting talk about container orchestration with Kubernetes by Google and Docker containers.
In our last blog post we gave you a short introduction to Linux namespaces. Part 2 will go deeper into user namespaces and current problems that Linux containers face today. Among them, resource accounting and container privileges are top culprits. Currently, processes on the host may still share some resource accounting within processes inside containers. The question of how many processes the same user and owner of containers must have is one of the many examples.
Containers are lightweight virtualization tools that give the illusion of separation and isolation to processes. They are not a security technology, but they do offer some isolation like filesystem operations and network operations, using Linux namespaces. However, as more containers are deployed we continue to find problems that need to be addressed. Among them, resource accounting and container privileges are top culprits. For now we will give you a quick overview over Linux namespaces.
Credit: Jamie Scott, CC BY-SA 4.0, cropped We live in interesting times. Clusters and clouds are becoming ever more popular, software finds itself increasingly packaged up in containers, infrastructure is being retooled along all these lines, and DevOps is stepping up as the way to handle these new realities. Now, just as much as ever, it is essential to keep your IT skills up-to-date so you can ride the wave of change.
In part 2 of this series, we learned about Docker and how you can use it to deploy the individual components of a stream processing pipeline by containerizing them. In the process, we also saw that it is can get a little complicated. This part will show how to tie all the components together using CoreOS. We already introduced CoreOS in part 1 of this series, so go back and take a look if you need to familiarize yourself.
Building a stream processing pipeline with Kafka, Storm and Cassandra – Part 2: Using Docker Containers
In case you missed it, part 1 of this series introduced the applications that we’re going to use and explained how they work individually. In this post, we’ll see how to run Zookeeper, Kafka, Storm and Cassandra clusters inside Docker containers on a single host. We’re going to use Ubuntu 14.04 LTS as the base operating system. Introducing Docker Docker is a software platform used for the packaging and deployment of applications which are then run on a host operating system in their own isolated environment.
Introduction Computer clusters have been with us quite a few years now in one form or another, but several trends have come together to make them incredibly important today. Low-cost commodity hardware, ubiquitous fast networking, and solid distributed systems have all helped usher in today’s era of server farms and “Big Data”, things which make clusters a critical tool. In a cluster, multiple computers (or nodes) are connected together through a network.