teeth on edge

The feeling of extreme irritation or annoyance resulting from an individuals behavior, or an unpleasant stimuli (ie. nails on a chalkboard)

Phrase is derived from the tingling/painful sensation felt in one's teeth after eating something cold, or biting into something hard.