Properly done Target Row Refresh has a circuit-size cost around 0.1-0.2% and a performance cost of 0% or <0.1% depending on whether an attack is happening.

The serious impacts show up when you can't rely on it being done properly, and have to use expensive workarounds.