Yosemite is a total mess, but it has gotten slightly better with 10.10.3 (if you are willing to ignore the Photos app, which launches constantly for no reason).
If you are willing to mess with drivers, you may want to try installing Linux. On a 2013 Air, battery life and performance (even graphics!) are surprisingly better with Debian Jessie than with OS X. Of course, it is a newer model than yours, but the drivers will only be more stable and mature with a 2011. Especially if you have 4 GB RAM and you're running into a memory barrier with OS X, you should see a significant improvement.
My iPhone and a couple flash drives do this, probably because it thinks my scanner is a camera. Unfortunately I can't stop it from launching (assuming I can disable it in Preferences) until it will actually launch—I have left it beachballing for a very long time and it still has not finished launching, so I just force quit it.
Open the Image Capture application, and you can change the setting at the bottom-left of the window. It seems to get increasingly hidden with each OS release.
This used to be the only place to change the setting—which was ridiculous because virtually no one ever used Image Capture (especially because iPhoto opened by default). But to Apple's credit, you can now also change this preference in Photos. Of course, as the previous poster pointed out, you have to actually wait for Photos to finish launching. But at least it's there now!
If you are willing to mess with drivers, you may want to try installing Linux. On a 2013 Air, battery life and performance (even graphics!) are surprisingly better with Debian Jessie than with OS X. Of course, it is a newer model than yours, but the drivers will only be more stable and mature with a 2011. Especially if you have 4 GB RAM and you're running into a memory barrier with OS X, you should see a significant improvement.