As far as I remember, I've only ever found it at the dwarven necromancer's house. In my latest game, I avoided all the weak enemies on purpose, hoping to get the skull later on. However, I did not.
Are there any other locations you guys remember finding the skull at?