So far it has been hard to gauge what the general consensus on Brexit is among the men and women on the ground