All posts by pmh

Cogent/Level 3 and Telus show multiple backbone links are a really good idea

Recent disputes involving Internet network service providers have underlined the importance of having redundant connections to the Internet, even for modest web sites and businesses.

dead links
In two recent incidents Internet backbone providers intentionally cut off network traffic and caused major disruptions for hundreds of sites and thousands of paying customers.

This summer Telus, the second largest telecommunications company in Canada, decided to blockade one specific web site for political reasons due to a labour dispute (the site was that of the Telecommunications Workers Union) and ended up blockading hundreds of others due to the technological method used. The folly was that users on other providers’ networks were not affected in the least and smaller networks that purchase connectivity from Telus were also cut off. You can read the details of the story on Michael Geist’s site in several articles including this one .

This month Level 3 Communications cut off data flowing from Cogent Communications citing commercial reasons. The result was a serious disruption not only for users but also for many sites whose connectivity depended on what is known as a peering agreement between Cogent and Level 3. A Google news search will give you the latest developments or you can read this story at Cnet.

reducing the risk
That Internet network providers would use, some would say abuse, their power for commercial ends is not surprising. This has been predicted since the Internet moved from public funding into private hands. It has happened before and no doubt will happen again. It is up to individuals and businesses to protect themselves where possible.

The use of multiple Internet connections, links to different backbone providers, has been common for large businesses since the early days. Hosting providers, whether they run their own data centres or re-brand services of a hosting “wholesaler”, have always touted the risk mitigation benefits of their connection to multiple Internet backbones like Level 3, AT&T, Cable & Wireless, Global Crossing, Sprint, NTT/Verio, etc., etc.

But small to mid-sized enterprises are not likely to have the resources to configure, deploy, and manage multiple links. Even larger enterprises would rather avoid the cost and complexity of managing and monitoring multiple networks. This is not a task for the average IT department. This work is highly specialized and good specialists are not cheap.

hosting services offer multiple backbones
For many the answer is to outsource essential Internet site infrastructure to a large and reliable hosting service.

I’m sometimes concerned about the loss of control when IT services are outsourced, but with a good hosting provider the risks are minimal and the benefits many. The risks are minimal because external hosting arrangements can be tailored to provide minimal services. The only essential ones are the physical location and the multiple network connections. Let the hosting centre provide these. Use your own servers, if you wish, under a basic co-location plan or opt for virtual servers with an inexpensive plan that, nonetheless, will include the same benefits of multiple network links.

In almost all cases a well run hosting service that is located in a purpose-built facility is a better choice than an in-house data centre. Access to multiple Internet backbones is one of the main reasons.

buyer beware
Beware: “redundant” and “multiple” don’t necessarily mean the same thing. Network providers who offer their own data centre services will speak of “redundant” connections, but these are likely to be multiple links to their own backbone only. It may not seem to them like good business sense to offer backup connectivity via their rivals.

As well, many smaller providers simply re-brand the services of a larger network. It pays to have the details of all the networks involved researched and mapped out.

Choosing a suitable hosting provider isn’t a trivial exercise and it’s usually best not to rely entirely on a vendor’s assessment of their own facilities. If you can afford it, an independent evaluation might be worthwhile. In any case, my recommendation would be to go with a hosting provider that is independent of any network service provider, of course.

Cheers,
-pmh

Should Adam Curry be excited about his Gmail account quota?

“08:20 Adam loves Gmail. Great because of the large storage space available. Works well for receiving audio comments. Also loves search based e-mail. As of today, Adam’s quota is 4GB.” – Adam Curry’s show notes for The Daily Source Code podcast, Daily Source Code 248

$3.42 worth of excitement?
Hey, I think that Gmail is great too! But I thought it would be interesting to put this in perspective in terms of IT economics.

Google has given Adam Curry, Podcaster Extrordinaire, 4Gb of storage. Around here you can buy a 200Gb external USB drive for about $0.85 USD per Gb. Just how excited should you be about a $3.42 service?

Now, Gmail must be using a fault-tolerant storage architecture that likely involves mirroring (2x the number of disks required for a given amount of data) and/or RAID-3 or RAID-5 (roughly an additional 30% space required for the parity data necessary to recover from a failed disk).

So, the 4Gb of storage may require as much as 6Gb x 2 = 12Gb and these large arrays are made up of individual disks that are significantly more expensive per unit than the disk in my local computer store (faster spindle speed of 15K versus 7K, larger buffer, faster interface). But an efficient storage area network (SAN) based on serial ATA disks (SATA) or even a directly attached storage array (DAS) brings costs down a lot – even after software and management costs are considered.

This is not a rigorous analysis, but my guess is that Adam’s 4Gb. is costing Gmail less than $6 USD per Gb per year on an efficiently utilized SAN. Ok… that’s $24 or $2 per month. Add bandwidth and overhead costs to get the full picture.

Alternatives to Gmail for the enterprise.
For business, there are commercial alternatives to Gmail. An enterprise may chose to dispense go to a private online mail service. Such services carry no advertising and can offer the same storage and search capabilities. To maintain the organization’s brand they will use your organization’s Internet domain name.

Another alternative, if your organization is large enough, is to run your own web-based mail server (and I’m not referring to Microsoft’s Outlook Web Access, OWA).

But even for large businesses, there are good reasons to outsource mail to a service that will not only provide superior search capabilities, but also will provide records management and archiving that will comply with government and other legal requirements for data retention and retrieval.

I’ll have more to say on the requirements of enterprise e-mail another time.

What is Adam worth to Gmail, anyway?
Getting back to Gmail: For Adam, the search facility is worth a lot. That’s really Gmail’s added value for him. Of course Google expects to make money on Gmail accounts through advertising. That’s not my area of expertise, but I’d be interested to hear how much a power user like Adam is actually worth to Gmail… not counting the promotional factor of regular mentions of the Gmail brand in The Daily Source Code podcast.

Cheers!
-pmh

The value of trivia

Even trivia has value.

Last evening I met with a couple of former colleagues & friends at The Rampant & Rose for an evening of live trivia. Live trivia, by definition, means that you actually play with your opponents in the same room rather than over the network with a game control. Therefore we actually get to size up the opposition in person.

The winning team was the Killer Bees with a sizable lead. Our team, the Guinness Guzzlers, ended up in the middle of the pack. The team with the lowest score (but the highest energy level) was the youngest group there.

While the Killer Bees average age was not noticeably greater than most of us, I wondered whether winning at trivia was related to how many time one has been around the block.

In my career I have made good use of the technical “trivia” that one collects from project to project (and, yes, even during conversations in the bar after work). When looking to fill a position or role with an “experienced” resource it seems to me that what is really being asked for is someone who has amassed a great amount of trivia in the required areas.

And, just as in an evening of trivia, the ones with the broadest and most varied experience are likely to be the most valuable – especially in a difficult situation. In technical endevours the most valuable experience comes from some degree of triumph over failure. The more you get to attempt repairs of something that has gone wrong, the more you learn (and hopefully, retain).

Cheers!
A tall glass of Guinness