I was at a conference that did that. The end result was that there was no way to prevent people who hadn't paid for lunch and coffee from just walking up to the buffet table and taking lunch and coffee, and the food being gone before everybody who had paid for lunch had eaten.
I wish conferences offered two rates: one for just the talks, and one for talks + (coffee,wifi,lunch).