Issue 32 – 31st July 2011

A busy week for content, only partly down to OSCON it seems. Hopefully you’ll have time to read a selection of introductions, delve into a few publicly available Puppet and Chef repositories and add a few new tools to your toolbox.

News

A fantastic article by Mathias Meyer entitled Web Operations 101 For Developers. It really is a great introduction to operations and associated concerns from those coming from a development background. Definitely worth circulating amongst your work colleagues whichever side of the tracks you’re from.

http://www.paperplanes.de/2011/7/25/web_operations_101_for_developers.html

More and more tools are coming with rich API’s, often exposing data as JSON. Familiar tools like grep can be used on this data but in a fairly brute force way, they have no understanding of the overall document structure. That’s where jgrep from Pieter Loubser comes in. Here’s some useful examples from R.I. Pienaar.

http://www.devco.net/archives/2011/07/29/rich-data-on-the-cli.php

It looks like Ben Rockwood has stumbled upon a treasure trove of useful reading material for anyone interested in the management/process side of devops. A fantastic post for anyone in search of a solid list of book recommendations.

http://cuddletech.com/blog/?p=642

When learning a new tool it’s often useful to see more than just simple examples, and be able to explore an entire project. Open source is generally very good at libraries, examples and tools, less so on entire working code bases. So I enjoyed looking through the a Chef repository in use at CERN and the Debian project puppet repo this week.

http://code.hep.wisc.edu/
http://anonscm.debian.org/gitweb/?p=mirror/dsa-puppet.git;a=summary

It’s easy to forget that the Vagrant configuration file is just Ruby, which means you can do some quite simple optimisations for multi-box environments. This Gist shows a quick example.

https://gist.github.com/1108747

Great talk from Jordan Sissel at Oscon on Logstash and where it’s aiming to fit into the whole logging puzzle. The slides themselves are worth going through anyway, but you can also get the speakers notes (from the actions button at the bottom) which give more background.

https://docs.google.com/present/view?id=0Aa9liCTsAyzRZGNtd3dkOTRfNjV3bXFnNHNnbQ&hl=en_US&pli=1

Another What is Devops post, but one that acts as a bit of a history up till now for those that are just hearing about the term. It’s also nicely written and balanced, mentioning both positive and negative points, all in a very readable manner.

http://dev-spout.blogspot.com/2011/07/what-is-devops.html

The Joel Test is well known amongst developers as an opinionated but useful quick look at what you can improve across a software team. Thomas Limoncelli has just published a similar list of systems administration. It comprises 32 questions (which is probably a few too many to be quick in my opinion) that you can use to pin point areas to improve.

http://everythingsysadmin.com/the-test.html

Exactly what your configuration management tool should manage has been a hot topic of late, with several good discussions that I’m aware of about packages vs configuration. This article from Sean OMeara explains the approach he prefers, which I thought was neatly summed up by “Don’t edit config files. Instead, edit the truth.”

http://blog.afistfulofservers.net/post/8140290279/configuration-management-strategies

A worthwhile article that talks about the different audiences for packaging, praising both apt for its features and tools like Leiningen for solving developers problems. Leiningen is a clojure tool similar in purpose to Bundler, and interestingly it’s in the process of being packaged for Debian.

http://technomancy.us/151

Tools

The fabled deployinator, Etsy’s inhouse deployment tool, has been open sourced as mentioned last week. The code is on GitHub and more documentation is being added all the time. I’d love someone to write up experiences of getting this up and running and where they see it fitting.

https://github.com/etsy/deployinator

Dell have open sourced a tool they have been using to bring up a multi-node OpenStack cloud on bare metal. It appears to use Chef under the hood. Worth a look if you’re wanting to investigate OpenStack.

http://bartongeorge.net/2011/07/26/dell-announces-availability-of-openstack-solution-open-sources-crowbar-software-framework/
https://github.com/dellcloudedge/crowbar