Upon initial observation this appears to fix the issue while maintaining the dirt, will keep you posted on the results!
Edit: I was mistaken, the dirt disappears after a while. If you can figure out how to get the visualsettings.dat to work without disrupting the facial hair, it'll be a winner!
I've got the same issue going on in my game as well. I love this mod but I might have to nix it if it turns out it's causing the bruising or whatever it is!