There's a risk but there's also great reward if it is done properly. The only way to maximize utility of any individual player is to play cooperatively[0]. A single actor might get a momentary advantage by defecting from cooperation, but it decreases their total eventual rewards and frankly it quickly becomes a net negative in many cases.
That said, I'm not very confident such a situation would happen in reality. I'm not confident current industry leaders can see past a quarter and nearly certain they can't see past 4. Current behavior already indicates that they are unwilling to maximize their own profits. A rising tide lifts all ships, but many will forgo the benefit this gives them to set out to explore for new and greater riches and instead are only able to envy the other ships rising with them. It can be easy to lose sight of what you have if you are too busy looking at others.
It's mostly because the actual stated and actualized goal of real AI is clearly bad.
It's like if you approached me and said "I'm going to erase meaning from your life. You will want for nothing. The entire paradigm of reality will be changed: your entire evolutionary struggle, made meaningless. You will want for nothing: "be" nothing. Also this might potentially kill you or some rich person or more likely nation-state could enslave you."
The actual stated goals seem negative to me. I'm not very interested in erasing and surpassing human achievement in every way. It seems inherently bad. I don't think that's an absurd perspective.
I think the disconnect here is asked in "what is the purpose of life" and I don't think any reasonable interpretation of that is "be obscenely comfortable".
That said, I'm not very confident such a situation would happen in reality. I'm not confident current industry leaders can see past a quarter and nearly certain they can't see past 4. Current behavior already indicates that they are unwilling to maximize their own profits. A rising tide lifts all ships, but many will forgo the benefit this gives them to set out to explore for new and greater riches and instead are only able to envy the other ships rising with them. It can be easy to lose sight of what you have if you are too busy looking at others.
[0] Simplified example illustrated by Iterative Prisoner's Dilemma: https://www.youtube.com/watch?v=Ur3Vf_ibHD0
[0.1] Can explain more if needed but I don't think this is hard to understand.