I think I found a fix for you!
Assuming you are using Windows, cause I'm not sure if this fix works for other operating systems, trying lowering your overall audio input volume in your system settings, like "System > Sound > Properties". I had to lower mine down by half to get it to work properly, I was having the same trouble that you were having.
Hope this helps!