So I just bought a new Macbook which although is amazingly thin is also somewhat underpowered. I also own a beefy Mac Pro (the trash can) and the thought had crossed my mind that I might use remote desktop to utilize the power of my Mac Pro from the convenience of my new Macbook. For gaming, latency is a huge issue, but I could deal with 50ms latency when doing my work if it meant not having my system lag in other respects. I only wish there was a OS X equivalent.
You should try Steam streaming - you can run your full and regular desktop in it (by using fake passthrough apps), and is how I often use Lightroom and Solidworks from my Macbook in bed.
Coming from VNC and Remote Desktop, it's remarkable how low the latency is. In many cases, because I can get a signifcantly higher framerate by remote rendering, the latency is better than if I was doing stuff locally.
For games, it's worked pretty well with everything you'd be happy playing with a gamepad (e.g. GTAV, but not CoD).