A fundamental idea of Georgism is that the land belongs to everybody, so rather than owning land, one essentially rents it from the people. More desirable land is rented at a higher rate. If the land you are renting could be making someone else millions with a higher productivity use, then you need to pay for the privilege of not using it for that higher productivity use.