How much fatigue though? I'm often tired but I've gotten used to it and can go through my day.

Ever fallen asleep on the shitter? Or just suddenly out of nowhere an extremely strong urge to sleep?

I fell asleep in the middle of conversations a couple of times...

This could be sleep apnea. Do you snore a lot or have people noticed not breathing for periods during your sleep, causing you to wake up? Ask an SO or something to keep an eye out if you can and tell you if they notice it.

For me, I'd crash straight after work one day a week, I just couldn't last till the evening (I work an office job, so no physical tiredness). Also, I recall driving on a highway was terrible, I'd start nodding off after 10mins.