Many problems in computational vision and visual perception that involve inferences over noisy, local measurements have been formulated with a geometrical component. Our goal is to organize a number of such problems according to their geometric content, to isolate a common thread between them that leads to differential geometry; and to introduce ideas from differential geometry to show how they can structure new approaches to seemingly unrelated computational vision problems.