There is absolutely a difference in perception, especially noticeable with metal/non-metal.
Drink a soda from a can and then the same kind from a glass? Night and day. Try experimenting with spoons to eat: wooden, plastic, different metals. You really notice that, or you should: the spoon goes right on your tongue to introduce the food.
What? Definitely happens, latest when one of the cheaper thinner bottle types have been sitting a bit too long in the hot the plastic taste becomes intense.
And even if below noticing levels I think plastic molecules have been detected in such beverages, but uncertain here.
Which is sometimes unavoidable, but to be precise, the same even on hot days without direct sun exposure, lets stop pea counting. You will easily find studies that stuff from PET production like acetaldehyde goes into the beverage and impacts taste.
But certainly also kind of what you are used to, always surprising for some folks to learn that for others chlorine water is associated with freshness, while clean water is a bit foul.