> they typically just partner with existing banks

Grocery stores or Walmart?

Grocery stores often have a branch of an existing bank inside them, but the ones that don't often provide some financial services like cashing checks.

Wal-marts cash checks, do money transfers, and provide debit cards which act as a pseudo-bank account since they can be used with direct deposit etc.