I read some contemporary articles in a Private Eye annual from the 1960s and the problem was not really the noise but the structural damage that was (allegedly) being caused. I don't know how real that was, but in the UK concerns over structural damage to buildings was what lead to the ban.

As for this plane, what are the elements of the design that reduce sonic booms? The comically long nose?