I plead the 5th

Pleading the 5th means to not self-incriminate yourself, but it has the connotation of meaning that you did it.
The reason for this connotation is because if you didn't do it, why wouldn't you just say no?
It's a way of not saying "yes you did something" but hinting that you did, but they can't really say you hinted at it.

My friend is high and can't answer with a simple yes or no.

A term that mostly black people say