Farmers don’t make up that much of the Labour vote – but that doesn’t mean the government can afford to be complacent about rural communities.