Android 5+ (or maybe 5.1) includes this - you can set it to priority notifications only, and then turn calls on but say to only include calls from your contacts.