It was clear to anyone who sat through the upland farming session at the NFU Conference that Natural England has a reputation problem.