Why doesn't it make sense for GPUs to have caches ?

It is new technology and was never eally needed until recently with the high graphics demanding games on the market now. Crysis 2 brings GPUs to their knees if they are not ready for it.