to cause you to be unable to think or work
That constant buzzing noise is driving me to distraction. Usage notes: sometimes used in the form do something to distraction (to be unable to think of anything else): It is obvious that he loves her to distraction.
Related vocabulary: