In all fairness, I never took "freshman calculus" either; that said, most undergraduate math degrees require either real or complex analysis, and at the graduate programs with which I am familiar you would have a very difficult time passing the qualifying exams if you weren't comfortable working with Taylor series.