A man says illegally dumped asbestos was left near his home and the council took months to clear it.