Do You Need Proprioceptive States in Visuomotor Policies?