To get in someone's hair

To get someone out of one's hair
to cause someone to stop annoying oneself.

• What do I have to do to get this guy out of my hair.

to stop annoying someone.

• Will you get out of my hair! You are a real pain!