There is no text in the constitution protecting either a right to abortion or any broader right to privacy. There is specific text in the constitution protecting speech and association; in fact, it's the first enumerated right. Abortion has a much higher hill to climb than free association.