I had been doing "Clean projects selected below" and that didn't do
anything. I just tried "Clean all projects" and that worked for some
reason... why one worked and not the other is beyond me (yes, I had the
one project I've created selected).
Now it seems that when I turn everything back on it's working properly.