Moore's Law, and Shugarts Law, and a pile of other IT laws which suggest that you get more bang for your buck with each passing year do not account for the reality of large enterprise IT.
If you slavishly follow their dictates, what you'd expect is that the price of IT should tend towards nothing over time. There should be so much processor, network and disk capacity available that the optimal decision is to use the largest amount possible in any situation to minimise the other key input to any particular system: people.
But the economics of this break down in a large enterprise, and here is the reason.
Firstly, IT budgets are expected to contract, year on year. That's because, in theory, the cost of all the hardware and stuff comes down. Its also because we are supposedly getting more efficient. The mantra is "do more with less", and by hook or by crook, most IT organisations manage to do so.
In the meantime, of course, demand for IT resources is increasing. It is increasing at a very, very rapid rate. I know we are in a constant rush to provision more storage, network and processor to keep up with the demand, usually remaining just one step ahead. And a key driver of this demand is end-user computing. Transaction volumes aren't going up so much, but all those end users building little applications that move pictures and videos, OLAP Cubes and large Excel data sets certainly know how to consume resources.
The resource requirements are increasing more quickly than the IT Laws are providing discounts. Couple that with shrinking IT budgets, and what you have is increasing internal scarcity. The demand doesn't just evaporate, however.
The gap between the price to satisfy all this demand, and the discount provided by the IT Laws are a pair of open jaws that are getting wider. And in the past, we've used our IT budgets to subside things to the point where no one noticed. IT budget shrinkage is knocking that on the head, now.
This is going to lead to a pretty big price hike for large corporate IT pretty soon. What else would you expect? Unsatisfied pent up demand for resource coupled with scarcity of supply always leads to price increases.
I know some readers will be thinking that Software as Service and various other new models are the answer to this problem. They're not though. All they do is shift the ever-expanding resource requirement somewhere else. Instead of needing more capacity in disk and processor, now you need it in network.
But there probably is an answer, and its one that's been staring us in the face for decades. Use local resources. Make use of the capabilities that are already in the technology on the desk. Peer to peer at the edge is fantastically more efficient than centralisation of everything.
I think the time is coming when we'll have to accept the end of centralised IT. Bigger is not necessarily better, and this may be one case where scale efficiencies simply don't apply.