Some Things We Did Today

Moving one of our eight photoserving farms from hardware Layer7 URL hash balancing (expensive, has limits) to L4 DSR balancing with CARP (cheap and simple) and figuring out how to juggle 18,000 requests/second while we do it. Built yet some more automated query analysis reporting (with some yummy MySQLProxy) Added yet another aggregated graph of
Continue reading…

More back-of-envelope-math…

Via kottke: some good examples of doing rough math in your head, causing you to guess about assumptions all along the way. IMHO, being able to do this is one of the things that makes a good web ops person. The examples might be “useless”, but the process is invaluable.

Too big to use utility computing ?

Dear users of S3, EC2, and other ‘utility’ computing stuffs: Here’s a crude and completely oversimplified evolution of infrastructure needs of a growing website, with an assumption: Have you ‘outgrown’ your original use of utility computing, for whatever reason ? If so, what was the reason? Financial? Technical? Why I’m asking: I’m in the process
Continue reading…

Datacenter Operating Systems

I’m probably late in getting to this, but seeing the article in the WSJ about the RAD project made me stop to take a look. It appears to be a collection of different projects, all relating to infrastructure deployment/management and various research topics surrounding it. Looks cool so far.

Loving Dashboard Spy.

I’m probably very late to this party, but I just discovered Dashboard Spy. Given the amount of “data porn” that folks in webops look at on a daily basis, this sort of stuff is pretty damn interesting. I’m especially loving the current trend of developing ‘business’ dashboards, since it can fit in quite nicely with
Continue reading…