Sinusoids are also special because they are eigenfunctions of the derivative operator.

The physics result is actually probably a consequence of that.

At the end of the day the whole lesson of modern math is that its useful to view things from many perspectives.