I used to browse lowendbox which occasionally has good deals from smaller companies who've been around for at least a few years but there's always a risk one day they'll sell, shut down operations or worse just disappear. However, if budget is your number one priority, you can get a years VPS hosting for low double digit dollars a year.
Nowadays a host personal projects on scaleway and netcup (EU based). I've been with the first for a could of years and the second for 6 months now, good service from both.
If you're mainly hosting static* or cacheable content, you may even get by with a raspberry pi running behind cloudflare's free plan with cache enabled. If you don't mind all traffic to your site being served by such a third party of course.
* If you only have static content, GitHub pages can be considered too.
$5/mo - but there are plenty of decent VPS for $5/yr - the catch is they will be IPv6 only for port 80 so you chuck it behind Cloudflare (carrying static load as well).
The low end world will shock anyone who has only ever seen AWS pricing.
Quite, and the $40-60 a year bracket for a VPS is quite normal, but the original message was "decent VPS for $10/yr". Linode certainly doesn't go that low - at least last time I checked.
I saw an VPS from Italy I think for in the region of $20/year some time back, Sephiroth87 was after a $10/year VPS recommendation, not a $60/year one that hvgk suggested.
