I found the issue was specific to me, that I had the shell folder paths (User Shell Folders and Shell Folders) were mapped to a non-existent drive in my registry. This meant that the game was trying to save settings and profiles to a drive that didn't exist.

Fixing those paths meant resolved the issue. For more information, I'd suggest looking up "error 1327 invalid drive".