Comments on: Slides for Velocity Talk 2009

By: allspaw

allspaw — Thu, 10 Sep 2009 15:45:23 +0000

Hey James – I don’t actually have a copy of the original video. O’Reilly had it sent to blip.tv and I think only they have the original, which is a bummer.

By: James Kavanagh

James Kavanagh — Thu, 10 Sep 2009 14:52:25 +0000

Hi John,

Great share, thank you. Really insightful.
Is there any chance I could get a copy of the original video? We’d really like to show this to some management folks but only the second part that concerns culture.

James

By: DBA survival BLOG » Blog Archive » A great talk

DBA survival BLOG » Blog Archive » A great talk — Fri, 10 Jul 2009 08:16:09 +0000

[...] a look at Kitchen Soap [...]

By: Velocity 2009 « Joel Weierman

Velocity 2009 « Joel Weierman — Wed, 01 Jul 2009 06:32:48 +0000

[...] The two highlights of the three day event were a talk by John Allspawl and Paul Hammond @ Flickr (http://www.kitchensoap.com/2009/06/23/slides-for-velocity-talk-2009/) and John Adams at Twitter (http://tiny.cc/LXS3D) talking about web [...]

By: Steve Conover

Steve Conover — Fri, 26 Jun 2009 05:53:35 +0000

“As long as those stats files exist in a common location and follow that format, devs can add or subtract to those metrics themselves and know that they’ll be automatically pulled into the various monitoring and metrics goodness. No need to write yet another crapload of extra metric-specific scripts.”

Very interesting, thanks for sharing.

By: Steve Conover

Steve Conover — Fri, 26 Jun 2009 02:37:27 +0000

“how do deploys that cause structural changes to the data change things”

to be clearer, are deploys involving structural data changes treated specially in any way, or are these like any other “10 deploys per day” change?

By: Steve Conover

Steve Conover — Fri, 26 Jun 2009 02:35:49 +0000

On another topic – could you give a general outline of how your deploy is accomplished? How is the actual update of servers accomplished, how do deploys that cause structural changes to the data change things? Just curious.

-Steve

By: allspaw

allspaw — Thu, 25 Jun 2009 20:55:35 +0000

Steve:

Yeah…so it’s about as for a number of backend applications, developers can write a basic ’stats’ file with metrics/counts about the application, something like:

images_processed=12
external_http_fetches=15
etc.

we then have a process that can come by and slurp those values and metric names into ganglia. We also use the same format to feed nagios and check against a similarly-formatted file which define low and high-water marks to alert on.

As long as those stats files exist in a common location and follow that format, devs can add or subtract to those metrics themselves and know that they’ll be automatically pulled into the various monitoring and metrics goodness. No need to write yet another crapload of extra metric-specific scripts.

By: Steve Conover

Steve Conover — Thu, 25 Jun 2009 00:48:12 +0000

Do you know if the conferece folks are going to post the video?

Also I think Paul mentioned that you’ve made it easy for developers to produce their own stats via gmetric…could you briefly explain what you do here?

Thanks -Steve

By: Steve Conover

Steve Conover — Wed, 24 Jun 2009 17:52:39 +0000

Excellent talk, my favorite at the conference so far, thank you. The duet format was a real success too.