I have a silly take on this: to avoid rocking the floating city you throw the rocket overboard, let it re-orient itself upright, then use the main thruster to slow down the fall and then move up.