All math skills to be a construction worker are learned throughout your school years (sadly) I think. So I think you don't need to go to college, just finish high school. But, go to college to have a higher paying position (recommended).