Lawyer Bait

The views expressed herein solely represent the author’s personal views and opinions and not of anyone else - person or organization.

Tuesday, March 15, 2011

The Seismic Shift of Data Center Planning

Friends of mine know that I have been beating on a drum for over 15 years about proper site selection for data centers. In fact I have recently blogged about it again and with all that is happening in Japan, it got me thinking even more about it. The other thing I have also spent more time thinking about is disaster recovery for obvious reasons.

I will say it again - site selection is the most important feature of a data center. The 9.0 earthquake merely reinforces that in a big way. I would not want to be a data center owner/operator in silicon valley - 10 years ago or now. The two biggest reasons are:

1. Seismic activity
2. Logistics post disaster

The first reason is more obvious today beacuse of the Japan earthquake. While well designed in and of themselves - they were not designed to withstand a 9.0. Logical oversight in my opinion. If the worst earthquake to date was 6, designing one for 2000 times worse seems logical. Until it happens.

The second reason is even more impactful when we we look at not only the immediate aftermath of the earthquake but of the tsunami that hit right afterwards. I have seen about 30 minutes of videos and my layman observation is it is worse than a flood because the earthquake loosens everything and gives it mobility and when you add a wall of water to move debris around - and by debris I mean cars, buildings, and dumpsters - it clogs streets with several feet of debris to have to move to make pathways passable again. This means that people cannot get to or leave the data center, and fuel deliveries for generators are hampered, service vehicles cannot get to them and in some cases entry ways and exits are blocked at the data center itself.

So what are some solutions?

Take site selection seriously. Look at your disaster recovery plans - not which data center your customer data will fail over to - but the logistic issues you will be faced with in the event of a real disaster happening. Is there food and water for employees? How far away is the fuel for the generators? Are there multiple ways to get it there? What happens if public transit cannot operate? Can you bike or canoe your way there if necessary? What about the conduits carrying electricity and telecom to the site? Can they withstand a ground shift of 20 feet (Japan is 13 feet closer to the US after the earthquake). How far away are the power plants? What is their capability to provide service? How will they do this? What is the wind direction? If you are near railroad tracks, what is carried on them that is toxic or can close pathways to and from the facility? Who are your neighbors? Is there anything that can float or blow into your facility? Into the infrastructure yard?

Things to avoid - don't base a decision on how quick you can get in and out for a site tour. Don't think about how easy it is to get to and from the office/data center, look around the facility at the roads, the access points, railroad tracks (especially active ones), flight paths (remember 9/11 when they grounded all planes and sent those in the air to the nearest airport?), and don't think something bad won't happen because it never has.

bytegrid@gmail.com is how to reach me.

Ask the right questions and invest

Tuesday, February 1, 2011

Green Dtata Center Retrofit Financing Available - Game changer?

I have been spending some time, ok a lot of time, looking at why companies are not taking advantage of the various rebates and incentives for making data centers more energy efficient. There are so many programs offered by utilities, state and local Governments, and the green energy marketplace I wanted to figure out why more projects weren't getting off the ground. What I found can be summed up in a word - money.

Without exception, access to financing was the number one reason projects never got started. Companies would engage utilities, energy audit firms, constuction firms and other professionals to examine their current energy usage so that they can establish a baseline of what their energy usage profile is today. Many of these services are provided free of charge, and some firms charge for their services.

Once the basline was established through a thorough energy audit, a project plan was drafted detailing the equipment that could be installed to harvest energy savings. In most cases I found that the savings were substatial - 30-50% on average. In real numbers, if a data center operator spends $200,000 per month on their electricity, they would pay $100,000-140,000 per month with the new equipment, saving upwards of $1M per year. This is a no brainer, right?

Unfortunately it is not a no brainer and here is why: The new equipment to harvest the savings is expensive and goes on balance sheet. so if a company has an extra million dollars or two to spend, will it be spent on a data center upgrade or retrofit or on expanding the business? Most companies opt for not spending the capex to harvest the savings or only spend money on very short term ROI projects and only take a fraction of the savings back.

So once I figured out that the issue wasn't a desire to do these things (who wants to be known as the company that doesn't support green initiatives), or that they didn't know where to start or what to do - after all they had the audit and project plan in their hands - I focused my attention on solving the problem - where can I find or put together a financing solution that solves the problems?

I would love to tell you that I was smart enough to know exactly who to call to solve the problem  - but as many of you know me, know that I am not that smart, but I am lucky in the sense that I am not afraid to pick up the phone and ask a lot of questions and learn what I don't know. So I learned a lot and then got lucky when a colleague in the financial industry called me and said 'I think I have something'.

Something indeed.

We have put together a financing program for companies who want to go green, harvest energy savings, and eliminate the capex up to 100% for the equipment., installation, and maintenance services. The beauty of the program is that the savings are dovetailed into the financing so the owner/operator is never out of pocket for the savings because if the savings are 30% per year and the cost of financing amounts to 15% per year, not only does the company get the benefit of the cost savings, they can structure it so that they add cushion to their monthly opex.

Of course if a company has money in their budget for capex purchases they can spend that allocation and finance the rest and do even better. So what's the catch?

At a high level here are the conditions that must be met:

1. Project sizes need to be in the $5M-100M range, based on an energy audit that has been done (or will be done)
2. The Owner operator must have investment grade credit (BBB or better)
3. The owner operator must be willing to sign a new maintenance agreeement on the equipment so the lender knows the new equipment will be taken care of

The whole process - from the energy audit to project start is about six weeks - or less.

The program right now is geared towards the large data center users for obvious reasons - they use a lot of electricity, a lot of it inefficiently, and the greatest improvement can be made with these users. Rest assured that I am working on options for smaller companies with smaller footprints so stay tuned. The other benefit to this program is it is specific to the savings - any tax breaks or additional rebates are kept by the owner operator and not factored into the program.

If you want more information on this program please email Pelagic Advisors and they will reach out.

Monday, January 10, 2011

More on Site Selection - Where is the Holistic View?

I got a requirement sent to me on Friday afternoon for a site selection on a large requirement >50Mw. Based on what I know about users looking for sites in the marketplace I would bet an Egg Nog Latte that it was the requirement for the Social Security Administration's data center project that has gone sideways.

The Office of the Inspector General OIG issued a report back in April of 2010 about the criteria and process that put a smile on my face:

"While the reviewers concluded that the agency had developed a "highly sophisticated" list of site-selection criteria for the project expected to cost more than $800 million, they found the process for narrowing site properties down to a short list to have been problematic.

Mandatory selection criteria the agency developed could also have excluded too many locations.

"In particular, when developing the mandatory selection criteria, it does not appear that consideration was given to the serious fiscal impact that exclusions would have in the electrical power cost arena over the life cycle of the data center," summary of the inspector general's report read.
Information was also limited in evaluation of telecommunications criteria.

It was not clear from the report's summary whether one or several location had been identified. The agency did not release the document in its entirety.

Why is this humorous to me?

The things that were excluded - cost of power and telecom infrastructure were cited. Hello? The two most important criteria for a selection were overlooked? Wow. Who was doing the selecting? Was the 'highly sophisticated' criteria designed to mask breathtaking incompetence?

As a result the requirement (if it is the requirement) is back on the street for round 2. If you are involved with the site selection process for the SSA (or any other organization) I am happy to give you my site selection criteria checklist. It's simple, I have used it myself for years, and it works. Email me - bytegrid@gmail.com and I will send you a copy. Free. Yes free. I look at it as an investment of goodwill to keep my taxes down paying for a project that is big, expensive, and uses MY money to pay for it.

The other interesting thing to have noted in the requirement which I laughed out loud over was that Economic Incentives were weighted as high as power and telecom infrastructure in the selection criteria. Folks, Economic incentives go away after a few years. Data centers stay around for 15-30. Economic incentives help in the short term, but how many elected officials stay in office 15-30 years? That is a lot of election cycles and political agendas to factor in.

There is also the mandate from Vivek Kundra issued in February of 2010 that they will need to factor into their decision. This entails highly efficient, green powered facilities that will be flexible enough to handle the IT changes in virtualization, the inclusion of legacy applications and hardware, and CIO agendas. It's a tall order, however it's so damn simple when you focus on the lowest common denominators. The same ones they overlooked in the first requirement.

Wednesday, January 5, 2011

The Modular Data Center Choices - half baked?

Anyone who knows me or follows this blog at all knows that I have been a strong proponent of modular solutions for many years - two years in fact when I first blogged about container ROI on 1/8/09 using the IRS as the example. Since then many solutions have been designed, some deployed, and all of them rarely discussed. Still scratching my head on that one - I would want to do business with a company that is delivering the most cost effective and carbon footprint lowering solutions available.

Today, there was an announcement over at Reuters about another Data Center Anywhere offering from Telehouse which we can add to Lee Technologies, i/o Data Centers, BladeRoom and others. I have looked at all of them, talked with their Management teams, reviewed deployment documents, seen costs, proposals, the whole nine yards on these 'solutions'. You know what they are  (data center anywhere solutions) half baked. If that.

The smart companies (Lee, BladeRoom, HP in my opinion) have figured out that while they may not be in the real estate development business they work with those who are.

Without exception each  DCA 'solution' has a 'Batteries not Included' clause. In other words - they are as awesome as a Ferrari with no fuel system. It absolutely STUNS me that in this day and age of partners, specialization of product and service, and the fact that the modern data center buiness is approaching its 30th birthday that no one has put ALL of the pieces together into a TRUE solution. A true solution is a cup of coffee, not the possibility of opening your own Starbucks.

Since I hate people who bitch and don't provide solutions so here is my two cents on a TRUE solution:

Modular manufacturers need to find and work with owner operators of data centers to find and make ready sites that are 'modular ready'. It's not like a modular solution isn't a data center with the same lowest common denominators - power & fiber.

I know  what you're thinking -

That data center companies are reluctant to embrace the modular solutions (they have inefficient buildings to fill)

I am a manufacturer not a real estate guy (you aren't selling many units without someplace with power & fiber to put them are you?)

The market is not mature (You haven't done your homework)

So what has happened is that customers are tasked with filling in these gaps themselves and the reason they are coming to you, the manufacturer, is to buy a data center SOLUTION, not a piece of one.

Most end customers are even less equipped to handle these filling of gaps than the people allegedly in the (modular) data center business and as a result the solutions havn't been flying off the assembly line. If you want a full solution - ping me - bytegrid@gmail.com - I have done my homework and will get you your cup of coffee...

Monday, December 20, 2010

Site Selection - A Case Study?

I received a call from a friend of mine earlier today who called to ask if I had seen the data center requirement posted for the CIA. I had heard about it and got to thinking about what they would do to kick off the site selection process. Then I realized that if the requirements were posted, they must have done a lot of homework already. You would think anyway. So I thought I would brainstorm here on my blog and take you through my thought process. and then see how much of what I think about are in the posted requirements.

 I will qualify this blog post with a disclaimer - the only specs I know are that they want a 200,000 square foot facility built out in 40,000 square foot chunks/phases. I have not read any document or article related to it.

So when I look at the requirement as I understand it - my high level criteria would be:

1. Available inexpensive power, ideally with a green power source that is off grid
2. Available network connections to Government TIC (Trusted Internet Connection) sites
3. Proximity to US military bases to insure that staff can get to a facility if needed
4. Risk profile for natural disasters, man made disasters (civil unrest/planes into buildings, etc), financial condition of location States, geologic topography, and political risk.

So for #1, availability of cheap power and preference to a green power source that is off grid is in the top slot for a reason. Data centers number one expense is power, and data centers are typically operated for 15+ years. Virtualization, while reducing floor space actually increases density and draw of power for more powerful servers, and the power needs to be 'green' per the mandate by Vivek Kundra, the CIO for the United States.

To my knowledge there are two sites that COULD satisfy this requirement today - but it would take a signed contract to mobilze the funds and people to construct the power systems, and one would get knocked out of the running because of proximity to DC proper. A box of anthrax, or a suitcase dirty bomb with nuclear waste within 40 miles would make it 'inoperable' at least on the surface. So this isn't a data center requirment, it's a power plant with one customer - a data center.

On to #2, which deals with network connectivity, and not just in the general sense but specific to a TIC site. There are 100 of them in the US, so that limits things too if that is a dealbreaker - and it should be. Data needs to flow to the facility and out of the facility to provide credible intelligence to our Government and to other Governments friendly with the United States. Since we arent talking DSL pipes, these need to be 100GB pipes or better. Redundant too. This will be expensive since there is not a lot of fiber in the boonies - I know, I live in 'the boonies' (kind of).

Number 3 is important because in the event of some really bad shit going down on a major scale, people need to get in and out of the facility no matter what. The ability to use runways and other infrastructure specific to logistics is crucial. People can fly to a base and get choppered in, HUM-V'ed in or some combination of planes and automobiles. Sorry trains. There is also the 'able to sleep at night' piece having jets and Blackhawks able to scramble and be airborne in seconds to sanitize any threat if needed.

Number 4 should be a given, and arguably #1. When I think about Ashburn VA and the amount of data that is captured, processed and stored at the end of a runway is breathtaking oversight in my opinion. Knowing I can get mobile network reception on the approach to Dulles means that people bent on harming the United States and its citizens can do major harm sitting in Verizon's parking lot and pressing send. Katrina got everyone's attention with natural disasters on a major scale, but what about wildfires that close roads, burn telephone poles, and melt insulation around copper lines? Ice storms that make roads impassable and cause tree branches to cut power and telecommunication lines or the earthquake that hits and while the seismically engineered building hardly feels anything, the 60 miles of conduit housing telecom fiber gets severed by a bridge collapsing or ground shaking separation of the conduit itself? Topography needs to be factored in as well for redundant microwave links, sensors for all sorts of data needing to be captured, analyzed and used in making educated decisions?

I added a vector that has not been too much of an issue to date but one I think about - the financial condition of a State. I will use California as the example - the State is teetering on bankruptcy if you believe the mainstreet media outlets. The issue won't be whether or not the State can afford to keep the power plants operating, but the civil unrest that occurs when people get incredibly pissed off. Mobs like to burn things, flip over cars, and do other things that make no sense to me. Looting happens. If there is no water or electricity all kinds of crazy things can happen. Guess what? Data centers plan to have water and electricity no matter what, making them a target.

The point in all of this, is that before you even start touring facilities, virtualizing, seeing who is out there, and putting together requirements based on square feet and phases, you better have done your homework, or you - CIA data center - will be the next disaster to recover from.

Tuesday, December 7, 2010

Pause for new thought stream

I was just reading the tweets from the Gartner DC event in Las Vegas and had a random thought to solicit feedback on:

Is the term managed storage really just data management with a new coat of paint?

Discuss...

Monday, December 6, 2010

Site Selection - Part Two of a Multipart Series - Modular = What changes?

First off thanks to all of you who reached out and sent comments on the first part of the series about how Site Selection is often overlooked. Some of the feedback inspired me to stretch this into a multipart series, and so now I will delve into another favorite topic I began writing about in April 2009  - modular and containerized options and  for the purposes of this entry, how they factor into a site selection.

Modular data centers from companies like Lee Technologies, in the US and BladeRoom based in the UK, are coming into their own and being deployed at a pretty good clip. I think data center people and investors alike are starting to get it as to why these options are compelling:

1. Cost. I can deploy a facility in a quarter for half the cost. That means that I get what I want whether it's density, footprint, speed of capacity, or operational efficiency for a lot less than a traditional data center Suite. As an owner operator it means I don't overbuild, I don't pay for a 100,000 square foot facility to be built and then wait until ten 10,000 sqaure foot rooms are sold. Cha-Ching all around

2. Speed. I can get them deployed quickly - usually in less time than it takes my broker to fly in a team to look at several facilities in several markets and tell me 'Stop me when you see something you like'. Thousands of cores, petabytes of space in 3 months. Me likey.

3. Consistency of product. Can anyone point me to a data center company that has the exact same layout, generator brand, UPS equipment, switchgear, masonry, or even layout in their facilities? Me either. Imagine the money and time saved supporting the same make and model of data center and its components? Modular solutions are the Southwest Airlines of the data center business. Southwest only flies Boeing 737's. Why? Because any pilot and flight crew can work on any plane in the fleet. Makes sense for data centers as well.

4. Simplicity. If I can get the same data center solution in multiple places from a single vendor with a single contract, with terms and conditions the same why wouldn't I make that my first choice? I have experienced first hand getting a phone call from a customer whose main reason for calling me was because we had a contract with them and they needed space fast and didnt have 6 weeks to work with a competitor to hammer out a different contract.

5. Logistics - How do you find an insured and bonded mover? There are millions of dollars invested in the cargo so you want to choose wisely. You will also need to pay attention to overpass/underpass heights since your solution will likely arrive by truck. You will also want to have an address, since many deliveries will be handled by out of state/non-local firms so giving directions to old barns or favorite fishing holes won't likely cut it.

6.Medium voltage electricians: Container/modular solutions by in large require more medium voltage electricians than low voltage so having local contractors with those skill sets are a factor. (Chicago has thousands, some remote areas may have 2). Also you will want to factor in the Unions and whether or not you are in a right to work or union state.
So all of this is great, but how does site selection tie into all of this?

Well modular solutions change the model for data center companies and companies looking to go modular.

For the data center company, it trips them up. Why? If you just paid $100M for a big 100,000 square foot building with no land and 5 mw of power, you could take a container or modular solution and gobble up that power footprint inside your building in a heartbeat, and still have 90,000 square feet of expensive building you can't do anything with until you spend millions more to get more power and have to wait 18 months to get it.  Or turn it into a raquetball court for employees I suppose. It impacts site selection for owner operators because they don't have to find big buildings to turn into data centers or build big buildings to chop up into computer rooms.

It also opens the door to a smarter model. One where they can buy land, do inexpensive improvements and pour concrete pads while they are working with the client to finish off the design of their facility. The data center is built, tested and shipped to the site where it is assembled in a couple of days and commisioned and ready for gear. The biggest issue is that there is no vendor that has emerged as a modular centric data center operator. X/O is the closest in supporting containers, but that's all I know of and the solution is far from complete. Today's owner operators will need to amortize their real estate and free up cash to make the switch and augment what they are doing, but that is a seismic shift in thinking, operations, and development, that I think a modular centric company would do better.

For end customers/tenants the site selection has been an issue for containers and modular solutions as well. Do we have land? Is it zoned? Is there power? Is it reliable? Is it in flight paths? Could a Waste Management dumpster truck get confused and pull our container away? How much is a generator? How many do we need? Can we even put diesel on site in a tank? Who will design the modular solution? What's a good UPS? Who understands power distribution and building codes? Where do we plug it in? Does it have a plug?

These are questions I have fielded or helped answer that past two years. many are funny today, but all legit.

Many companies who build and run their own facilities do have the people to figure it out, and Lee Technologies  and BladeRoom both have designers to help get it right. The issue is still - what makes a good site? Send an email to me at bytegrid@gmail.com and I will send you my site selection guide which lays out all the questions you'll want to ask no matter which way you go.

Special thanks to Steve Manos at Lee Technologies for his contribution in this blog post. Steve can be reached at smanos@leetechnologies.com