You're right. This is how people with an agenda misuse facts. But just because specific facts can be misused does not mean we abandon using facts at all. Many facts are biased. All personal experiences are biased. Being less wrong is the goal.