I personally don't think that Google spend money to store your data if they aren't actively using it, though I can understand the sentiment. That said, you might as well switch it off if privacy is something you care about.