How do you deal with neighbors that come over to talk everytime your outside?

Trying not to be rude, but I can't walk away easily as the neighbor just follows and keeps talking. :( I'd like to be able to do stuff outside and enjoy our property without worrying about this. :argh: