Men who are fit in middle age may have lower risks of some cancers in later years, a new study finds.