An important second part of that quote is also that, from god's perspective, there would be impossible numbers that only a meta-god could access, and so on and so on.

And it's not so much that math as we currently understand it cannot solve some problems, but more along the lines that math has used math to prove that there are some problems that math cannot solve.