Not an inherently terrible idea, although I’m worried that this may lead to a larger trend of destroyed buildings replacing regular buildings to the point where cities are practically uninhabitable, with a proportionate decrease in loot to the point of complete unplayability. Such topics always seem to come up whenever a topic like this is discussed, often attempting to insinuate themselves under the thin veneer of realism that the original idea provides.
Upon reflection, this may be a bad idea after all.