Click your Friends tab, then "All connections." Find the person you want to delete, and click the x next to their name. I think you can also choose to block people, which means that even if you post on someone else's wall, s/he won't be able to see it(or so I have been told).