Because people can decide to go live in another place, quit their job and get another one in the new place.

One of the reason some people do not move is due to being comfortable and at travel distance to their job.

Under this light you can see what happened to several European cities with high rent due to University: as soon as Covid made students go home to their parents as classes were online, there was a huge drop in rent prices.