The real issue may be one of the ones you mentioned. It could also be that employees who spend at least some significant time in person are more effective than those who are and always were fully remote.