If someone wants to start a business and call it lifestyle, great for them. It usually tells their business is not all their is in their life, and that's great.

When someone else calls a business "lifestyle" just because it is small, i believe it is condescending.

If I called the CEO of the 20-employees plumbing company i sometimes use, and asked him "how's your lifestyle business doing?" he would probably hang up on me.