Memory leech
A person, place or thing that when nearby, or directly confronted, causes you to lose track of your thinking. A memory leech can cause you to forget words, or whole ideas.
Whenever I'm talking to my friend, Jordan, I just cannot remember what I wanted to say. He's definately a memory leech.