I figured it out, for me anyway. My headphones were causing it, so I disabled them and used Realtek HD Audio instead of my headset and it fixed it. I guess we'll just have to have a bit lower quality audio in order to play the game.

I've also tried a bunch of stuff such as disabling that windows game mode, playing on 32bit, and disabling fullscreen optimizations.