One problem with scaling quantum computers is that while the individual qbits are small getting more and more stable, it is unclear how to miniaturize the stuff needed to read and write qubits. Those are still components you can touch with your hands without breaking them, so you can't have millions in one device.