Ugh I logged in through OAuth and it automatically made me follow their Twitter account. There should have more fine-grained control over what applications can do without asking/telling me.