I think that racists will always find symbols to rally around [1]. Theres a greater danger, I think, in bestowing so much power on a symbol that its use must be tightly controller. Regular people committed the atrocities of WWII, not a piece of cloth. Forgetting that is dangerous.

Evil is not a magical force, it's something every human being is capable of under the right (wrong?) circumstances [2].

[1] http://www.nytimes.com/2015/06/19/us/on-facebook-dylann-roof...

[2] https://en.wikipedia.org/wiki/The_Act_of_Killing