Slides for Velocity Talk 2009

by allspaw on June 23, 2009

UPDATE: blip.tv has the video of the talk as well, below. Jeez I have some major bed-head.

That was a blast! I had never done a ‘duet’ talk before. Here are the slides:

…and the video of it is here:

{ 10 comments… read them below or add one }

James Wheare June 24, 2009 at 12:13 am

Nice slides, do you know if this talk was filmed/recorded?

allspaw June 24, 2009 at 5:23 am

It was! I’m not 100% sure when (or where) the video will be up, but I’ll ask the O’Reilly folks and post an update here. Thanks a lot!

Steve Conover June 24, 2009 at 9:52 am

Excellent talk, my favorite at the conference so far, thank you. The duet format was a real success too.

Steve Conover June 24, 2009 at 4:48 pm

Do you know if the conferece folks are going to post the video?

Also I think Paul mentioned that you’ve made it easy for developers to produce their own stats via gmetric…could you briefly explain what you do here?

Thanks -Steve

allspaw June 25, 2009 at 12:55 pm

Steve:

Yeah…so it’s about as for a number of backend applications, developers can write a basic ‘stats’ file with metrics/counts about the application, something like:

images_processed=12
external_http_fetches=15
etc.

we then have a process that can come by and slurp those values and metric names into ganglia. We also use the same format to feed nagios and check against a similarly-formatted file which define low and high-water marks to alert on.

As long as those stats files exist in a common location and follow that format, devs can add or subtract to those metrics themselves and know that they’ll be automatically pulled into the various monitoring and metrics goodness. No need to write yet another crapload of extra metric-specific scripts.

Steve Conover June 25, 2009 at 6:35 pm

On another topic – could you give a general outline of how your deploy is accomplished? How is the actual update of servers accomplished, how do deploys that cause structural changes to the data change things? Just curious.

-Steve

Steve Conover June 25, 2009 at 6:37 pm

“how do deploys that cause structural changes to the data change things”

to be clearer, are deploys involving structural data changes treated specially in any way, or are these like any other “10 deploys per day” change?

Steve Conover June 25, 2009 at 9:53 pm

“As long as those stats files exist in a common location and follow that format, devs can add or subtract to those metrics themselves and know that they’ll be automatically pulled into the various monitoring and metrics goodness. No need to write yet another crapload of extra metric-specific scripts.”

Very interesting, thanks for sharing.

James Kavanagh September 10, 2009 at 6:52 am

Hi John,

Great share, thank you. Really insightful.
Is there any chance I could get a copy of the original video? We’d really like to show this to some management folks but only the second part that concerns culture.

James

allspaw September 10, 2009 at 7:45 am

Hey James – I don’t actually have a copy of the original video. O’Reilly had it sent to blip.tv and I think only they have the original, which is a bummer.

Leave a Comment

{ 4 trackbacks }