Seems like a Mumble server accomplishes the same thing. You can get general channels with an open mic or push-to-talk, and you can also do open mic or push-to-talk with individuals. Mumble is free and open source and runs on a toaster-quality cloud instance with CD quality audio and no latency.

Kudos for someone doing the IRC->Slack but for voice chat/Mumble.