Off the top of my head, I would say it's because the atoms are small and they form lots of bonds, carbon in particular. Diamond is a tetrahedral structure and I think the other really hard substances are also,