No the council weren't wrong. Rubbish dumped on private property is the responsibility of the property owner.
Farmers have this problem almost daily with bills for removal in one recent case £40k!
That the council was uncaring and unhelpful however goes without saying.