‘You’d think that with the affluency of the area, shoppers would hit M&S more, but we’ve got the highest market share in the town’