Visual cortex is present in the:
Occipital lobe
Temporal lobe
Frontal lobe
Parietal lobe
The lateral geniculate body receives retinal fibres of both the eyes (from temporal half of the retina of the same side and nasal half of the retina of the opposite side) through optic tract and gives rise to fibres of the optic radiation which convey visual impulses to the visual cortex of the occipital lobe.
Primary visual area is situated mainly on the medial surface of the occipital lobe in the walls and floor of the posterior part of the calcarine sulcus (postcalcarine  sulcus) and extends around the occipital pole onto the lateral surface of the occipital lobe as far as the lunate sulcus.
Reference: TEXTBOOK OF ANATOMY HEAD, NECK AND Brain, Volume III, second edition page no  384, 393